2023-09-12T15:48:22.502 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-12T15:48:22.503 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --name pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi --owner scheduled_pdonnell@teuthology --verbose --archive /home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395106 -- /home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395106/orig.config.yaml 2023-09-12T15:48:22.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-12T15:48:22.633 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395106 branch: wip-batrick-testing-20230912.122437 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: pdonnell@redhat.com first_in_suite: false job_id: '7395106' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-batrick-testing-20230912.122437 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 2110e00747b31a0d73768c9e5229da18b26b8aa0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2110e00747b31a0d73768c9e5229da18b26b8aa0 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20230912.122437 sha1: 3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9684 sha1: 2110e00747b31a0d73768c9e5229da18b26b8aa0 sleep_before_teardown: 0 subset: 236/256 suite: fs suite_branch: wip-batrick-testing-20230912.122437 suite_path: /home/teuthworker/src/github.com_batrick_ceph_3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: 3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOxJ6kOmsgrZXrBHdjyaS3FupS2DpNCg992poiRE3v9HGGdki+q8Ob8IfsM20edNUkDFrcwcJBFX6N1WyRlzY5I= smithi144.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFGsfkI/BaqRd4Q1OApYBZ/aE2WGKfM+H3kyeG0/zSMqM24+9vzyWS47Hj9eFoaxf1k/B1kRMo2LbDZqWjD2hXo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-12_14:07:50 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1394 2023-09-12T15:48:22.634 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f/qa; will attempt to use it 2023-09-12T15:48:22.634 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f/qa/tasks 2023-09-12T15:48:22.635 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-12T15:48:22.637 INFO:teuthology.task.internal:Checking packages... 2023-09-12T15:48:22.660 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2110e00747b31a0d73768c9e5229da18b26b8aa0' 2023-09-12T15:48:22.660 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-12T15:48:22.661 INFO:teuthology.packaging:ref: None 2023-09-12T15:48:22.661 INFO:teuthology.packaging:tag: None 2023-09-12T15:48:22.661 INFO:teuthology.packaging:branch: wip-batrick-testing-20230912.122437 2023-09-12T15:48:22.661 INFO:teuthology.packaging:sha1: 2110e00747b31a0d73768c9e5229da18b26b8aa0 2023-09-12T15:48:22.662 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-batrick-testing-20230912.122437 2023-09-12T15:48:22.873 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6088.g2110e007 2023-09-12T15:48:22.874 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-12T15:48:22.880 INFO:teuthology.task.internal:no buildpackages task found 2023-09-12T15:48:22.880 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-12T15:48:22.931 INFO:teuthology.task.internal:Saving configuration 2023-09-12T15:48:22.948 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-12T15:48:22.965 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-12T15:48:22.990 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395106', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-12 15:43:11.215329', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOxJ6kOmsgrZXrBHdjyaS3FupS2DpNCg992poiRE3v9HGGdki+q8Ob8IfsM20edNUkDFrcwcJBFX6N1WyRlzY5I='} 2023-09-12T15:48:23.011 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395106', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-12 15:43:11.213752', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFGsfkI/BaqRd4Q1OApYBZ/aE2WGKfM+H3kyeG0/zSMqM24+9vzyWS47Hj9eFoaxf1k/B1kRMo2LbDZqWjD2hXo='} 2023-09-12T15:48:23.011 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-12T15:48:23.021 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-09-12T15:48:23.022 INFO:teuthology.task.internal:roles: ubuntu@smithi144.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-09-12T15:48:23.022 INFO:teuthology.run_tasks:Running task console_log... 2023-09-12T15:48:23.117 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7feeb8534b80>, signals=[15]) 2023-09-12T15:48:23.118 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-12T15:48:23.130 INFO:teuthology.task.internal:Opening connections... 2023-09-12T15:48:23.130 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2023-09-12T15:48:23.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-12T15:48:23.200 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi144.front.sepia.ceph.com 2023-09-12T15:48:23.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-12T15:48:23.267 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-12T15:48:23.278 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2023-09-12T15:48:23.301 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2023-09-12T15:48:23.301 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-09-12T15:48:23.361 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2023-09-12T15:48:23.362 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8" 2023-09-12T15:48:23.362 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2023-09-12T15:48:23.362 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2023-09-12T15:48:23.362 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8" 2023-09-12T15:48:23.362 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8" 2023-09-12T15:48:23.363 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-12T15:48:23.363 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-09-12T15:48:23.363 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-12T15:48:23.363 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2023-09-12T15:48:23.363 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-12T15:48:23.364 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-12T15:48:23.364 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-12T15:48:23.364 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-09-12T15:48:23.390 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2023-09-12T15:48:23.413 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2023-09-12T15:48:23.413 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-09-12T15:48:23.473 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2023-09-12T15:48:23.473 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8" 2023-09-12T15:48:23.474 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2023-09-12T15:48:23.474 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2023-09-12T15:48:23.474 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8" 2023-09-12T15:48:23.474 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2023-09-12T15:48:23.474 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-12T15:48:23.475 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-09-12T15:48:23.475 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-12T15:48:23.475 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2023-09-12T15:48:23.475 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-12T15:48:23.475 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-12T15:48:23.475 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-12T15:48:23.476 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-09-12T15:48:23.497 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-12T15:48:23.511 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-12T15:48:23.548 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-12T15:48:23.548 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2023-09-12T15:48:23.551 DEBUG:teuthology.orchestra.run.smithi144:> test '!' -e /home/ubuntu/cephtest 2023-09-12T15:48:23.572 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-12T15:48:23.584 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-12T15:48:23.584 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2023-09-12T15:48:23.612 DEBUG:teuthology.orchestra.run.smithi144:> test -z $(ls -A /var/lib/ceph) 2023-09-12T15:48:23.643 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-12T15:48:23.703 INFO:teuthology.run_tasks:Running task kernel... 2023-09-12T15:48:23.721 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-09-12T15:48:23.722 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-09-12T15:48:23.723 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-09-12T15:48:23.723 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-12T15:48:23.724 DEBUG:teuthology.orchestra.run.smithi144:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-12T15:48:23.743 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-12T15:48:23.744 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-09-12T15:48:23.747 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-12T15:48:23.748 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-09-12T15:48:23.978 DEBUG:teuthology.task.kernel:sha1 for client.1 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-12T15:48:23.979 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-09-12T15:48:23.979 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2023-09-12T15:48:24.000 INFO:teuthology.orchestra.run.smithi144.stdout:4.18.0-489.el8.x86_64 2023-09-12T15:48:24.001 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-12T15:48:24.001 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-09-12T15:48:24.002 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum upgrade -y linux-firmware 2023-09-12T15:48:24.033 DEBUG:teuthology.task.kernel:sha1 for client.0 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-12T15:48:24.033 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-09-12T15:48:24.034 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2023-09-12T15:48:24.055 INFO:teuthology.orchestra.run.smithi112.stdout:4.18.0-489.el8.x86_64 2023-09-12T15:48:24.055 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-12T15:48:24.055 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-09-12T15:48:24.056 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum upgrade -y linux-firmware 2023-09-12T15:48:27.355 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 8 - AppStream 49 MB/s | 33 MB 00:00 2023-09-12T15:48:27.441 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 8 - AppStream 43 MB/s | 33 MB 00:00 2023-09-12T15:48:35.665 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 8 - BaseOS 22 MB/s | 47 MB 00:02 2023-09-12T15:48:35.797 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 8 - BaseOS 21 MB/s | 47 MB 00:02 2023-09-12T15:48:42.882 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 8 - Extras 46 kB/s | 18 kB 00:00 2023-09-12T15:48:42.971 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 8 - Extras 46 kB/s | 18 kB 00:00 2023-09-12T15:48:43.616 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 8 - Extras common packages 12 kB/s | 6.9 kB 00:00 2023-09-12T15:48:43.697 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 6.9 kB 00:00 2023-09-12T15:48:43.893 INFO:teuthology.orchestra.run.smithi112.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-09-12T15:48:44.007 INFO:teuthology.orchestra.run.smithi144.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-09-12T15:48:45.954 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 8.3 MB/s | 16 MB 00:01 2023-09-12T15:48:49.785 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 412 kB/s | 24 kB 00:00 2023-09-12T15:48:52.776 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 1.8 MB/s | 16 MB 00:08 2023-09-12T15:48:53.536 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2023-09-12T15:48:53.537 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2023-09-12T15:48:53.537 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repo Size 2023-09-12T15:48:53.537 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2023-09-12T15:48:53.538 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrading: 2023-09-12T15:48:53.538 INFO:teuthology.orchestra.run.smithi112.stdout: linux-firmware noarch 20230824-118.git0e048b06.el8 baseos 286 M 2023-09-12T15:48:53.538 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T15:48:53.538 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2023-09-12T15:48:53.538 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2023-09-12T15:48:53.539 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrade 1 Package 2023-09-12T15:48:53.539 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T15:48:53.539 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 286 M 2023-09-12T15:48:53.539 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2023-09-12T15:48:56.556 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 282 kB/s | 24 kB 00:00 2023-09-12T15:49:00.354 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2023-09-12T15:49:00.355 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2023-09-12T15:49:00.355 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repo Size 2023-09-12T15:49:00.356 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2023-09-12T15:49:00.356 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrading: 2023-09-12T15:49:00.356 INFO:teuthology.orchestra.run.smithi144.stdout: linux-firmware noarch 20230824-118.git0e048b06.el8 baseos 286 M 2023-09-12T15:49:00.356 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T15:49:00.356 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2023-09-12T15:49:00.356 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2023-09-12T15:49:00.357 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrade 1 Package 2023-09-12T15:49:00.357 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T15:49:00.357 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 286 M 2023-09-12T15:49:00.357 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2023-09-12T15:49:14.427 INFO:teuthology.orchestra.run.smithi112.stdout:linux-firmware-20230824-118.git0e048b06.el8.noa 14 MB/s | 286 MB 00:20 2023-09-12T15:49:14.428 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2023-09-12T15:49:14.428 INFO:teuthology.orchestra.run.smithi112.stdout:Total 14 MB/s | 286 MB 00:20 2023-09-12T15:49:15.623 INFO:teuthology.orchestra.run.smithi144.stdout:linux-firmware-20230824-118.git0e048b06.el8.noa 19 MB/s | 286 MB 00:15 2023-09-12T15:49:15.623 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2023-09-12T15:49:15.623 INFO:teuthology.orchestra.run.smithi144.stdout:Total 19 MB/s | 286 MB 00:15 2023-09-12T15:49:16.134 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2023-09-12T15:49:16.193 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2023-09-12T15:49:16.193 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2023-09-12T15:49:17.322 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2023-09-12T15:49:17.387 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2023-09-12T15:49:17.388 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2023-09-12T15:49:17.982 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2023-09-12T15:49:18.005 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2023-09-12T15:49:19.182 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2023-09-12T15:49:19.215 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2023-09-12T15:49:36.881 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2023-09-12T15:49:37.236 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-09-12T15:49:37.461 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-09-12T15:49:37.685 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-09-12T15:49:37.686 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-09-12T15:49:38.201 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2023-09-12T15:49:38.472 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-09-12T15:49:38.473 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T15:49:38.473 INFO:teuthology.orchestra.run.smithi112.stdout:Upgraded: 2023-09-12T15:49:38.473 INFO:teuthology.orchestra.run.smithi112.stdout: linux-firmware-20230824-118.git0e048b06.el8.noarch 2023-09-12T15:49:38.473 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T15:49:38.473 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2023-09-12T15:49:38.545 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-09-12T15:49:38.658 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-09-12T15:49:38.659 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-12T15:49:38.797 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-09-12T15:49:38.882 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-09-12T15:49:38.883 DEBUG:teuthology.orchestra.run.smithi112:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-09-12T15:49:38.885 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi112.front.sepia.ceph.com to complete... 2023-09-12T15:49:39.022 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-09-12T15:49:39.022 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-09-12T15:49:39.734 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-09-12T15:49:39.734 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T15:49:39.734 INFO:teuthology.orchestra.run.smithi144.stdout:Upgraded: 2023-09-12T15:49:39.734 INFO:teuthology.orchestra.run.smithi144.stdout: linux-firmware-20230824-118.git0e048b06.el8.noarch 2023-09-12T15:49:39.735 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T15:49:39.735 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2023-09-12T15:49:39.928 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-09-12T15:49:39.928 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-12T15:49:40.151 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-09-12T15:49:40.152 DEBUG:teuthology.orchestra.run.smithi144:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-09-12T15:49:40.154 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi144.front.sepia.ceph.com to complete... 2023-09-12T15:50:07.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12 15:50:07 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-09-12T15:50:07.378 INFO:teuthology.orchestra.run.smithi112.stderr:FINISHED --2023-09-12 15:50:07-- 2023-09-12T15:50:07.378 INFO:teuthology.orchestra.run.smithi112.stderr:Total wall clock time: 28s 2023-09-12T15:50:07.378 INFO:teuthology.orchestra.run.smithi112.stderr:Downloaded: 1 files, 363M in 28s (13.0 MB/s) 2023-09-12T15:50:07.380 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-09-12T15:50:07.380 DEBUG:teuthology.orchestra.run.smithi112:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-09-12T15:50:07.445 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12 15:50:07 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-09-12T15:50:07.446 INFO:teuthology.orchestra.run.smithi144.stderr:FINISHED --2023-09-12 15:50:07-- 2023-09-12T15:50:07.446 INFO:teuthology.orchestra.run.smithi144.stderr:Total wall clock time: 27s 2023-09-12T15:50:07.446 INFO:teuthology.orchestra.run.smithi144.stderr:Downloaded: 1 files, 363M in 27s (13.6 MB/s) 2023-09-12T15:50:07.447 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-09-12T15:50:07.447 DEBUG:teuthology.orchestra.run.smithi144:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-09-12T15:50:09.063 INFO:teuthology.orchestra.run.smithi112.stdout:Verifying... ######################################## 2023-09-12T15:50:09.105 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing... ######################################## 2023-09-12T15:50:09.111 INFO:teuthology.orchestra.run.smithi144.stdout:Verifying... ######################################## 2023-09-12T15:50:09.155 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing... ######################################## 2023-09-12T15:50:09.214 INFO:teuthology.orchestra.run.smithi112.stdout:Updating / installing... 2023-09-12T15:50:09.264 INFO:teuthology.orchestra.run.smithi144.stdout:Updating / installing... 2023-09-12T15:50:47.098 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-09-12T15:50:47.167 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-09-12T15:51:10.250 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi144.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-09-12T15:51:10.251 DEBUG:teuthology.orchestra.run.smithi144:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-09-12T15:51:10.313 INFO:teuthology.orchestra.run.smithi144.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-12T15:51:10.313 INFO:teuthology.orchestra.run.smithi144.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-09-12T15:51:10.314 INFO:teuthology.orchestra.run.smithi144.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-09-12T15:51:10.314 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-09-12T15:51:10.314 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-09-12T15:51:10.314 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-09-12T15:51:10.314 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-09-12T15:51:10.315 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-09-12T15:51:10.315 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-09-12T15:51:10.315 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-09-12T15:51:10.315 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-09-12T15:51:10.315 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-09-12T15:51:10.316 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-09-12T15:51:10.316 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-09-12T15:51:10.316 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-09-12T15:51:10.316 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-09-12T15:51:10.316 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-09-12T15:51:10.317 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-09-12T15:51:10.317 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-09-12T15:51:10.317 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-09-12T15:51:10.317 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-09-12T15:51:10.317 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-09-12T15:51:10.317 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-09-12T15:51:10.318 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-09-12T15:51:10.318 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-09-12T15:51:10.318 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-09-12T15:51:10.318 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-09-12T15:51:10.318 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-09-12T15:51:10.319 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-09-12T15:51:10.319 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-09-12T15:51:10.319 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-09-12T15:51:10.319 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-09-12T15:51:10.319 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-09-12T15:51:10.320 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-09-12T15:51:10.320 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-09-12T15:51:10.320 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-09-12T15:51:10.320 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-09-12T15:51:10.320 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-09-12T15:51:10.321 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-09-12T15:51:10.321 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-09-12T15:51:10.321 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-09-12T15:51:10.321 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-09-12T15:51:10.321 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-09-12T15:51:10.322 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-09-12T15:51:10.322 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-09-12T15:51:10.322 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-09-12T15:51:10.322 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-09-12T15:51:10.322 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-09-12T15:51:10.323 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-09-12T15:51:10.323 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-09-12T15:51:10.323 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-09-12T15:51:10.323 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-09-12T15:51:10.323 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-09-12T15:51:10.323 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-09-12T15:51:10.324 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-09-12T15:51:10.324 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-09-12T15:51:10.324 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-09-12T15:51:10.324 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-09-12T15:51:10.324 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-09-12T15:51:10.325 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-09-12T15:51:10.325 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-09-12T15:51:10.325 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-09-12T15:51:10.325 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-09-12T15:51:10.325 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-09-12T15:51:10.326 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-09-12T15:51:10.326 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-09-12T15:51:10.326 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-09-12T15:51:10.326 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-09-12T15:51:10.326 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-09-12T15:51:10.327 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-09-12T15:51:10.327 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-09-12T15:51:10.327 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-09-12T15:51:10.327 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-09-12T15:51:10.327 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-09-12T15:51:10.328 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-09-12T15:51:10.328 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-09-12T15:51:10.328 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-09-12T15:51:10.328 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-09-12T15:51:10.328 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-09-12T15:51:10.329 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-09-12T15:51:10.329 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-09-12T15:51:10.329 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-09-12T15:51:10.329 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-09-12T15:51:10.329 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-09-12T15:51:10.329 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-09-12T15:51:10.330 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-09-12T15:51:10.330 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-09-12T15:51:10.330 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-09-12T15:51:10.330 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-09-12T15:51:10.330 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-09-12T15:51:10.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-09-12T15:51:10.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-09-12T15:51:10.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-09-12T15:51:10.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-09-12T15:51:10.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-09-12T15:51:10.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-09-12T15:51:10.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-09-12T15:51:10.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-09-12T15:51:10.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-09-12T15:51:10.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-09-12T15:51:10.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-09-12T15:51:10.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-09-12T15:51:10.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-09-12T15:51:10.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-09-12T15:51:10.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-09-12T15:51:10.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-09-12T15:51:10.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-09-12T15:51:10.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-09-12T15:51:10.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-09-12T15:51:10.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-09-12T15:51:10.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-09-12T15:51:10.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-09-12T15:51:10.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-09-12T15:51:10.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-09-12T15:51:10.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-09-12T15:51:10.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-09-12T15:51:10.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-09-12T15:51:10.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-09-12T15:51:10.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-09-12T15:51:10.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-09-12T15:51:10.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-09-12T15:51:10.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-09-12T15:51:10.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-09-12T15:51:10.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-09-12T15:51:10.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-09-12T15:51:10.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-09-12T15:51:10.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-09-12T15:51:10.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-09-12T15:51:10.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-09-12T15:51:10.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-09-12T15:51:10.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-09-12T15:51:10.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-09-12T15:51:10.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-09-12T15:51:10.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-09-12T15:51:10.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-09-12T15:51:10.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-09-12T15:51:10.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-09-12T15:51:10.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-09-12T15:51:10.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-09-12T15:51:10.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-09-12T15:51:10.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-09-12T15:51:10.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-09-12T15:51:10.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-09-12T15:51:10.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-09-12T15:51:10.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-09-12T15:51:10.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-09-12T15:51:10.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-09-12T15:51:10.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-09-12T15:51:10.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-09-12T15:51:10.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-09-12T15:51:10.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-09-12T15:51:10.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-09-12T15:51:10.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-09-12T15:51:10.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-09-12T15:51:10.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-09-12T15:51:10.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-09-12T15:51:10.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-09-12T15:51:10.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-09-12T15:51:10.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-09-12T15:51:10.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-09-12T15:51:10.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-09-12T15:51:10.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-09-12T15:51:10.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-09-12T15:51:10.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-09-12T15:51:10.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-09-12T15:51:10.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-09-12T15:51:10.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-09-12T15:51:10.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-09-12T15:51:10.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-09-12T15:51:10.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-09-12T15:51:10.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-09-12T15:51:10.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-09-12T15:51:10.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-09-12T15:51:10.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-09-12T15:51:10.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-09-12T15:51:10.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-09-12T15:51:10.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-09-12T15:51:10.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-09-12T15:51:10.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-09-12T15:51:10.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-09-12T15:51:10.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-09-12T15:51:10.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-09-12T15:51:10.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-09-12T15:51:10.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-09-12T15:51:10.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-09-12T15:51:10.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-09-12T15:51:10.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-09-12T15:51:10.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-09-12T15:51:10.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-09-12T15:51:10.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-09-12T15:51:10.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-09-12T15:51:10.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-09-12T15:51:10.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-09-12T15:51:10.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-09-12T15:51:10.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-09-12T15:51:10.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-09-12T15:51:10.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-09-12T15:51:10.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-09-12T15:51:10.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-09-12T15:51:10.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-09-12T15:51:10.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-09-12T15:51:10.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-09-12T15:51:10.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-09-12T15:51:10.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-09-12T15:51:10.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-09-12T15:51:10.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-09-12T15:51:10.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-09-12T15:51:10.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-09-12T15:51:10.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-09-12T15:51:10.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-09-12T15:51:10.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-09-12T15:51:10.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-09-12T15:51:10.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-09-12T15:51:10.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-09-12T15:51:10.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-09-12T15:51:10.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-09-12T15:51:10.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-09-12T15:51:10.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-09-12T15:51:10.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-09-12T15:51:10.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-09-12T15:51:10.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-09-12T15:51:10.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-09-12T15:51:10.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-09-12T15:51:10.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-09-12T15:51:10.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-09-12T15:51:10.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-09-12T15:51:10.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-09-12T15:51:10.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-09-12T15:51:10.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-09-12T15:51:10.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-09-12T15:51:10.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-09-12T15:51:10.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-09-12T15:51:10.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-09-12T15:51:10.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-09-12T15:51:10.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-09-12T15:51:10.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-09-12T15:51:10.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-09-12T15:51:10.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-09-12T15:51:10.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-09-12T15:51:10.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-09-12T15:51:10.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-09-12T15:51:10.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-09-12T15:51:10.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-09-12T15:51:10.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-09-12T15:51:10.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-09-12T15:51:10.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-09-12T15:51:10.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-09-12T15:51:10.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-09-12T15:51:10.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-09-12T15:51:10.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-09-12T15:51:10.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-09-12T15:51:10.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-09-12T15:51:10.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-09-12T15:51:10.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-09-12T15:51:10.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-09-12T15:51:10.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-09-12T15:51:10.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-09-12T15:51:10.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-09-12T15:51:10.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-09-12T15:51:10.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-09-12T15:51:10.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-09-12T15:51:10.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-09-12T15:51:10.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-09-12T15:51:10.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-09-12T15:51:10.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-09-12T15:51:10.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-09-12T15:51:10.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-09-12T15:51:10.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-09-12T15:51:10.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-09-12T15:51:10.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-09-12T15:51:10.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-09-12T15:51:10.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-09-12T15:51:10.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-09-12T15:51:10.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-09-12T15:51:10.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-09-12T15:51:10.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-09-12T15:51:10.366 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-09-12T15:51:10.366 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-09-12T15:51:10.366 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-09-12T15:51:10.366 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-09-12T15:51:10.366 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-09-12T15:51:10.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-09-12T15:51:10.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-09-12T15:51:10.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-09-12T15:51:10.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-09-12T15:51:10.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-09-12T15:51:10.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-09-12T15:51:10.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-09-12T15:51:10.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-09-12T15:51:10.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-09-12T15:51:10.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-09-12T15:51:10.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-09-12T15:51:10.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-09-12T15:51:10.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-09-12T15:51:10.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-09-12T15:51:10.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-09-12T15:51:10.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-09-12T15:51:10.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-09-12T15:51:10.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-09-12T15:51:10.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-09-12T15:51:10.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-09-12T15:51:10.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-09-12T15:51:10.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-09-12T15:51:10.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-09-12T15:51:10.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-09-12T15:51:10.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-09-12T15:51:10.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-09-12T15:51:10.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-09-12T15:51:10.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-09-12T15:51:10.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-09-12T15:51:10.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-09-12T15:51:10.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-09-12T15:51:10.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-09-12T15:51:10.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-09-12T15:51:10.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-09-12T15:51:10.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-09-12T15:51:10.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-09-12T15:51:10.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-09-12T15:51:10.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-09-12T15:51:10.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-09-12T15:51:10.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-09-12T15:51:10.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-09-12T15:51:10.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-09-12T15:51:10.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-09-12T15:51:10.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-09-12T15:51:10.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-09-12T15:51:10.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-09-12T15:51:10.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-09-12T15:51:10.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-09-12T15:51:10.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-09-12T15:51:10.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-09-12T15:51:10.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-09-12T15:51:10.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-09-12T15:51:10.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-09-12T15:51:10.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-09-12T15:51:10.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-09-12T15:51:10.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-09-12T15:51:10.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-09-12T15:51:10.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-09-12T15:51:10.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-09-12T15:51:10.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-09-12T15:51:10.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-09-12T15:51:10.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-09-12T15:51:10.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-09-12T15:51:10.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-09-12T15:51:10.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-09-12T15:51:10.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-09-12T15:51:10.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-09-12T15:51:10.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-09-12T15:51:10.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-09-12T15:51:10.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-09-12T15:51:10.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-09-12T15:51:10.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-09-12T15:51:10.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-09-12T15:51:10.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-09-12T15:51:10.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-09-12T15:51:10.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-09-12T15:51:10.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-09-12T15:51:10.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-09-12T15:51:10.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-09-12T15:51:10.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-09-12T15:51:10.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-09-12T15:51:10.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-09-12T15:51:10.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-09-12T15:51:10.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-09-12T15:51:10.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-09-12T15:51:10.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-09-12T15:51:10.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-09-12T15:51:10.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-09-12T15:51:10.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-09-12T15:51:10.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-09-12T15:51:10.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-09-12T15:51:10.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-09-12T15:51:10.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-09-12T15:51:10.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-09-12T15:51:10.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-09-12T15:51:10.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-09-12T15:51:10.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-09-12T15:51:10.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-09-12T15:51:10.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-09-12T15:51:10.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-09-12T15:51:10.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-09-12T15:51:10.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-09-12T15:51:10.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-09-12T15:51:10.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-09-12T15:51:10.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-09-12T15:51:10.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-09-12T15:51:10.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-09-12T15:51:10.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-09-12T15:51:10.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-09-12T15:51:10.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-09-12T15:51:10.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-09-12T15:51:10.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-09-12T15:51:10.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-09-12T15:51:10.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-09-12T15:51:10.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-09-12T15:51:10.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-09-12T15:51:10.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-09-12T15:51:10.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-09-12T15:51:10.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-09-12T15:51:10.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-09-12T15:51:10.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-09-12T15:51:10.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-09-12T15:51:10.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-09-12T15:51:10.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-09-12T15:51:10.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-09-12T15:51:10.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-09-12T15:51:10.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-09-12T15:51:10.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-09-12T15:51:10.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-09-12T15:51:10.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-09-12T15:51:10.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-09-12T15:51:10.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-09-12T15:51:10.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-09-12T15:51:10.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-09-12T15:51:10.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-09-12T15:51:10.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-09-12T15:51:10.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-09-12T15:51:10.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-09-12T15:51:10.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-09-12T15:51:10.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-09-12T15:51:10.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-09-12T15:51:10.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-09-12T15:51:10.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-09-12T15:51:10.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-09-12T15:51:10.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-09-12T15:51:10.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-09-12T15:51:10.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-09-12T15:51:10.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-09-12T15:51:10.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-09-12T15:51:10.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-09-12T15:51:10.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-09-12T15:51:10.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-09-12T15:51:10.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-09-12T15:51:10.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-09-12T15:51:10.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-09-12T15:51:10.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-09-12T15:51:10.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-09-12T15:51:10.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-09-12T15:51:10.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-09-12T15:51:10.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-09-12T15:51:10.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-09-12T15:51:10.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-09-12T15:51:10.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-09-12T15:51:10.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-09-12T15:51:10.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-09-12T15:51:10.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-09-12T15:51:10.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-09-12T15:51:10.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-09-12T15:51:10.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-09-12T15:51:10.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-09-12T15:51:10.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-09-12T15:51:10.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-09-12T15:51:10.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-09-12T15:51:10.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-09-12T15:51:10.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-09-12T15:51:10.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-09-12T15:51:10.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-09-12T15:51:10.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-09-12T15:51:10.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-09-12T15:51:10.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-09-12T15:51:10.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-09-12T15:51:10.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-09-12T15:51:10.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-09-12T15:51:10.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-09-12T15:51:10.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-09-12T15:51:10.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-09-12T15:51:10.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-09-12T15:51:10.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-09-12T15:51:10.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-09-12T15:51:10.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-09-12T15:51:10.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-09-12T15:51:10.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-09-12T15:51:10.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-09-12T15:51:10.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-09-12T15:51:10.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-09-12T15:51:10.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-09-12T15:51:10.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-09-12T15:51:10.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-09-12T15:51:10.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-09-12T15:51:10.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-09-12T15:51:10.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-09-12T15:51:10.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-09-12T15:51:10.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-09-12T15:51:10.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-09-12T15:51:10.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-09-12T15:51:10.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-09-12T15:51:10.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-09-12T15:51:10.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-09-12T15:51:10.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-09-12T15:51:10.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-09-12T15:51:10.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-09-12T15:51:10.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-09-12T15:51:10.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-09-12T15:51:10.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-09-12T15:51:10.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-09-12T15:51:10.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-09-12T15:51:10.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-09-12T15:51:10.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-09-12T15:51:10.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-09-12T15:51:10.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-09-12T15:51:10.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-09-12T15:51:10.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-09-12T15:51:10.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-09-12T15:51:10.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-09-12T15:51:10.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-09-12T15:51:10.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-09-12T15:51:10.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-09-12T15:51:10.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-09-12T15:51:10.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-09-12T15:51:10.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-09-12T15:51:10.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-09-12T15:51:10.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-09-12T15:51:10.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-09-12T15:51:10.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-09-12T15:51:10.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-09-12T15:51:10.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-09-12T15:51:10.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-09-12T15:51:10.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-09-12T15:51:10.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-09-12T15:51:10.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-09-12T15:51:10.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-09-12T15:51:10.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-09-12T15:51:10.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-09-12T15:51:10.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-09-12T15:51:10.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-09-12T15:51:10.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-09-12T15:51:10.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-09-12T15:51:10.418 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-09-12T15:51:10.418 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-09-12T15:51:10.418 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-09-12T15:51:10.418 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-09-12T15:51:10.418 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-09-12T15:51:10.419 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-09-12T15:51:10.419 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-09-12T15:51:10.419 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-09-12T15:51:10.419 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-09-12T15:51:10.419 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-09-12T15:51:10.420 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-09-12T15:51:10.420 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-09-12T15:51:10.420 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-09-12T15:51:10.420 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-09-12T15:51:10.420 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-09-12T15:51:10.420 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-09-12T15:51:10.421 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-09-12T15:51:10.421 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-09-12T15:51:10.421 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-09-12T15:51:10.421 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-09-12T15:51:10.421 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-09-12T15:51:10.422 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-09-12T15:51:10.422 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-09-12T15:51:10.422 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-09-12T15:51:10.422 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-09-12T15:51:10.422 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-09-12T15:51:10.423 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-09-12T15:51:10.423 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-09-12T15:51:10.423 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-09-12T15:51:10.423 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-09-12T15:51:10.423 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-09-12T15:51:10.424 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-09-12T15:51:10.424 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-09-12T15:51:10.424 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-09-12T15:51:10.424 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-09-12T15:51:10.424 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-09-12T15:51:10.425 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-09-12T15:51:10.425 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-09-12T15:51:10.425 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-09-12T15:51:10.425 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-09-12T15:51:10.425 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-09-12T15:51:10.425 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-09-12T15:51:10.426 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-09-12T15:51:10.426 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-09-12T15:51:10.426 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-09-12T15:51:10.426 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-09-12T15:51:10.426 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-09-12T15:51:10.427 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-09-12T15:51:10.427 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-09-12T15:51:10.427 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-09-12T15:51:10.427 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-09-12T15:51:10.427 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-09-12T15:51:10.428 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-09-12T15:51:10.428 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-09-12T15:51:10.428 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-09-12T15:51:10.428 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-09-12T15:51:10.428 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-09-12T15:51:10.429 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-09-12T15:51:10.429 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-09-12T15:51:10.429 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-09-12T15:51:10.429 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-09-12T15:51:10.429 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-09-12T15:51:10.430 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-09-12T15:51:10.430 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-09-12T15:51:10.430 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-09-12T15:51:10.430 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-09-12T15:51:10.430 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-09-12T15:51:10.431 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-09-12T15:51:10.431 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-09-12T15:51:10.431 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-09-12T15:51:10.431 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-09-12T15:51:10.431 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-09-12T15:51:10.433 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-09-12T15:51:10.433 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-09-12T15:51:10.434 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-09-12T15:51:10.434 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-09-12T15:51:10.434 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-09-12T15:51:10.434 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-09-12T15:51:10.434 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-09-12T15:51:10.435 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-09-12T15:51:10.435 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-09-12T15:51:10.435 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-09-12T15:51:10.435 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-09-12T15:51:10.435 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-09-12T15:51:10.436 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-09-12T15:51:10.436 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-09-12T15:51:10.436 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-09-12T15:51:10.436 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-09-12T15:51:10.436 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-09-12T15:51:10.437 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-09-12T15:51:10.437 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-09-12T15:51:10.437 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-09-12T15:51:10.437 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-09-12T15:51:10.437 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-09-12T15:51:10.438 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-09-12T15:51:10.438 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-09-12T15:51:10.438 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-09-12T15:51:10.438 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-09-12T15:51:10.438 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-09-12T15:51:10.438 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-09-12T15:51:10.439 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-09-12T15:51:10.439 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-09-12T15:51:10.439 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-09-12T15:51:10.439 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-09-12T15:51:10.439 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-09-12T15:51:10.440 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-09-12T15:51:10.440 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-09-12T15:51:10.440 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-09-12T15:51:10.440 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-09-12T15:51:10.440 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-09-12T15:51:10.441 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-09-12T15:51:10.441 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-09-12T15:51:10.441 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-09-12T15:51:10.441 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-09-12T15:51:10.441 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-09-12T15:51:10.442 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-09-12T15:51:10.442 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-09-12T15:51:10.442 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-09-12T15:51:10.442 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-09-12T15:51:10.442 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-09-12T15:51:10.443 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-09-12T15:51:10.443 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-09-12T15:51:10.443 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-09-12T15:51:10.443 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-09-12T15:51:10.443 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-09-12T15:51:10.444 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-09-12T15:51:10.444 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-09-12T15:51:10.444 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-09-12T15:51:10.444 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-09-12T15:51:10.444 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-09-12T15:51:10.444 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-09-12T15:51:10.445 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-09-12T15:51:10.445 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-09-12T15:51:10.445 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-09-12T15:51:10.445 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-09-12T15:51:10.446 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-09-12T15:51:10.446 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-09-12T15:51:10.446 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-09-12T15:51:10.446 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-09-12T15:51:10.446 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-09-12T15:51:10.447 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-09-12T15:51:10.447 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-09-12T15:51:10.447 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-09-12T15:51:10.447 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-09-12T15:51:10.447 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-09-12T15:51:10.447 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-09-12T15:51:10.448 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-09-12T15:51:10.448 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-09-12T15:51:10.448 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-09-12T15:51:10.448 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-09-12T15:51:10.448 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-09-12T15:51:10.449 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-09-12T15:51:10.449 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-09-12T15:51:10.449 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-09-12T15:51:10.449 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-09-12T15:51:10.449 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-09-12T15:51:10.450 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-09-12T15:51:10.450 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-09-12T15:51:10.450 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-09-12T15:51:10.450 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-09-12T15:51:10.450 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-09-12T15:51:10.451 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-09-12T15:51:10.451 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-09-12T15:51:10.451 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-09-12T15:51:10.451 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-09-12T15:51:10.451 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-09-12T15:51:10.452 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-09-12T15:51:10.452 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-09-12T15:51:10.452 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-09-12T15:51:10.452 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-09-12T15:51:10.452 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-09-12T15:51:10.453 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-09-12T15:51:10.453 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-09-12T15:51:10.453 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-09-12T15:51:10.453 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-09-12T15:51:10.453 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-09-12T15:51:10.454 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-09-12T15:51:10.454 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-09-12T15:51:10.454 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-09-12T15:51:10.454 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-09-12T15:51:10.454 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-09-12T15:51:10.455 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-09-12T15:51:10.455 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-09-12T15:51:10.455 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-09-12T15:51:10.455 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-09-12T15:51:10.455 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-09-12T15:51:10.456 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-09-12T15:51:10.456 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-09-12T15:51:10.456 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-09-12T15:51:10.456 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-09-12T15:51:10.456 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-09-12T15:51:10.457 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-09-12T15:51:10.457 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-09-12T15:51:10.457 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-09-12T15:51:10.457 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-09-12T15:51:10.457 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-09-12T15:51:10.457 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-09-12T15:51:10.458 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-09-12T15:51:10.458 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-09-12T15:51:10.458 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-09-12T15:51:10.458 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-09-12T15:51:10.458 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-09-12T15:51:10.459 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-09-12T15:51:10.459 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-09-12T15:51:10.459 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-09-12T15:51:10.459 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-09-12T15:51:10.459 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-09-12T15:51:10.460 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-09-12T15:51:10.460 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-09-12T15:51:10.460 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-09-12T15:51:10.460 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-09-12T15:51:10.460 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-09-12T15:51:10.461 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-09-12T15:51:10.461 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-09-12T15:51:10.461 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-09-12T15:51:10.461 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-09-12T15:51:10.461 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-09-12T15:51:10.462 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-09-12T15:51:10.462 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-09-12T15:51:10.462 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-09-12T15:51:10.462 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-09-12T15:51:10.462 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-09-12T15:51:10.463 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-09-12T15:51:10.463 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-09-12T15:51:10.463 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-09-12T15:51:10.463 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-09-12T15:51:10.463 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-09-12T15:51:10.463 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-09-12T15:51:10.464 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-09-12T15:51:10.464 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-09-12T15:51:10.464 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-09-12T15:51:10.464 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-09-12T15:51:10.464 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-09-12T15:51:10.465 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-09-12T15:51:10.465 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-09-12T15:51:10.465 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-09-12T15:51:10.465 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-09-12T15:51:10.465 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-09-12T15:51:10.466 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-09-12T15:51:10.466 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-09-12T15:51:10.466 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-09-12T15:51:10.466 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-09-12T15:51:10.466 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-09-12T15:51:10.466 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-09-12T15:51:10.467 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-09-12T15:51:10.467 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-09-12T15:51:10.467 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-09-12T15:51:10.467 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-09-12T15:51:10.467 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-09-12T15:51:10.468 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-09-12T15:51:10.468 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-09-12T15:51:10.468 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-09-12T15:51:10.468 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-09-12T15:51:10.468 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-09-12T15:51:10.469 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-09-12T15:51:10.469 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-09-12T15:51:10.469 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-09-12T15:51:10.469 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-09-12T15:51:10.469 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-09-12T15:51:10.469 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-09-12T15:51:10.470 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-09-12T15:51:10.470 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-09-12T15:51:10.470 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-09-12T15:51:10.470 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-09-12T15:51:10.470 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-09-12T15:51:10.471 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-09-12T15:51:10.471 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-09-12T15:51:10.471 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-09-12T15:51:10.471 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-09-12T15:51:10.471 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-09-12T15:51:10.472 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-09-12T15:51:10.472 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-09-12T15:51:10.472 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-09-12T15:51:10.472 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-09-12T15:51:10.472 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-09-12T15:51:10.472 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-09-12T15:51:10.473 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-09-12T15:51:10.473 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-09-12T15:51:10.473 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-09-12T15:51:10.473 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-09-12T15:51:10.473 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-09-12T15:51:10.474 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-09-12T15:51:10.474 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-09-12T15:51:10.474 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-09-12T15:51:10.474 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-09-12T15:51:10.474 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-09-12T15:51:10.475 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-09-12T15:51:10.475 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-09-12T15:51:10.475 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-09-12T15:51:10.475 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-09-12T15:51:10.475 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-09-12T15:51:10.476 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-09-12T15:51:10.476 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-09-12T15:51:10.476 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-09-12T15:51:10.476 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-09-12T15:51:10.476 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-09-12T15:51:10.477 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-09-12T15:51:10.477 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-09-12T15:51:10.477 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-09-12T15:51:10.477 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-09-12T15:51:10.477 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-09-12T15:51:10.478 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-09-12T15:51:10.478 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-09-12T15:51:10.478 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-09-12T15:51:10.478 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-09-12T15:51:10.478 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-09-12T15:51:10.479 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-09-12T15:51:10.479 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-09-12T15:51:10.479 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-09-12T15:51:10.479 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-09-12T15:51:10.479 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-09-12T15:51:10.480 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-09-12T15:51:10.480 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-09-12T15:51:10.480 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-09-12T15:51:10.480 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-09-12T15:51:10.480 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-09-12T15:51:10.481 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-09-12T15:51:10.481 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-09-12T15:51:10.481 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-09-12T15:51:10.481 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-09-12T15:51:10.481 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-09-12T15:51:10.482 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-09-12T15:51:10.482 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-09-12T15:51:10.482 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-09-12T15:51:10.482 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-09-12T15:51:10.482 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-09-12T15:51:10.482 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-09-12T15:51:10.483 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-09-12T15:51:10.483 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-09-12T15:51:10.483 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-09-12T15:51:10.483 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-09-12T15:51:10.483 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-09-12T15:51:10.484 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-09-12T15:51:10.484 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-09-12T15:51:10.484 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-09-12T15:51:10.484 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-09-12T15:51:10.484 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-09-12T15:51:10.484 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-09-12T15:51:10.485 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-09-12T15:51:10.485 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-09-12T15:51:10.485 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-09-12T15:51:10.485 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-09-12T15:51:10.485 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-09-12T15:51:10.486 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-09-12T15:51:10.486 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-09-12T15:51:10.486 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-09-12T15:51:10.486 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-09-12T15:51:10.486 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-09-12T15:51:10.486 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-09-12T15:51:10.487 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-09-12T15:51:10.487 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-09-12T15:51:10.487 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-09-12T15:51:10.487 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-09-12T15:51:10.487 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-09-12T15:51:10.488 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-09-12T15:51:10.488 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-09-12T15:51:10.488 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-09-12T15:51:10.488 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-09-12T15:51:10.488 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-09-12T15:51:10.488 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-09-12T15:51:10.489 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-09-12T15:51:10.489 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-09-12T15:51:10.489 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-09-12T15:51:10.489 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-09-12T15:51:10.489 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-09-12T15:51:10.490 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-09-12T15:51:10.490 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-09-12T15:51:10.490 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-09-12T15:51:10.490 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-09-12T15:51:10.490 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-09-12T15:51:10.490 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-09-12T15:51:10.491 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-09-12T15:51:10.491 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-09-12T15:51:10.491 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-09-12T15:51:10.491 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-09-12T15:51:10.491 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-09-12T15:51:10.492 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-09-12T15:51:10.492 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-09-12T15:51:10.492 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-09-12T15:51:10.492 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-09-12T15:51:10.492 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-09-12T15:51:10.493 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-09-12T15:51:10.493 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-09-12T15:51:10.493 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-09-12T15:51:10.493 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-09-12T15:51:10.493 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-09-12T15:51:10.493 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-09-12T15:51:10.494 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-09-12T15:51:10.494 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-09-12T15:51:10.494 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-09-12T15:51:10.494 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-09-12T15:51:10.494 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-09-12T15:51:10.495 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-09-12T15:51:10.495 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-09-12T15:51:10.495 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-09-12T15:51:10.495 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-09-12T15:51:10.495 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-09-12T15:51:10.495 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-09-12T15:51:10.496 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-09-12T15:51:10.496 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-09-12T15:51:10.496 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-09-12T15:51:10.496 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-09-12T15:51:10.496 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-09-12T15:51:10.497 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-09-12T15:51:10.497 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-09-12T15:51:10.497 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-09-12T15:51:10.497 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-09-12T15:51:10.497 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-09-12T15:51:10.497 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-09-12T15:51:10.498 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-09-12T15:51:10.498 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-09-12T15:51:10.498 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-09-12T15:51:10.498 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-09-12T15:51:10.498 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-09-12T15:51:10.499 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-09-12T15:51:10.499 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-09-12T15:51:10.499 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-09-12T15:51:10.499 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-09-12T15:51:10.499 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-09-12T15:51:10.500 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-09-12T15:51:10.500 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-09-12T15:51:10.500 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-09-12T15:51:10.500 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-09-12T15:51:10.500 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-09-12T15:51:10.501 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-09-12T15:51:10.501 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-09-12T15:51:10.501 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-09-12T15:51:10.501 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-09-12T15:51:10.501 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-09-12T15:51:10.501 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-09-12T15:51:10.502 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-09-12T15:51:10.502 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-09-12T15:51:10.502 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-09-12T15:51:10.502 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-09-12T15:51:10.502 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-09-12T15:51:10.503 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-09-12T15:51:10.503 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-09-12T15:51:10.503 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-09-12T15:51:10.503 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-09-12T15:51:10.503 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-09-12T15:51:10.503 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-09-12T15:51:10.504 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-09-12T15:51:10.504 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-09-12T15:51:10.504 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-09-12T15:51:10.504 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-09-12T15:51:10.504 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-09-12T15:51:10.505 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-09-12T15:51:10.505 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-09-12T15:51:10.505 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-09-12T15:51:10.505 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-09-12T15:51:10.505 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-09-12T15:51:10.505 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-09-12T15:51:10.506 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-09-12T15:51:10.506 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-09-12T15:51:10.506 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-09-12T15:51:10.506 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-09-12T15:51:10.506 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-09-12T15:51:10.507 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-09-12T15:51:10.507 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-09-12T15:51:10.507 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-09-12T15:51:10.507 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-09-12T15:51:10.507 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-09-12T15:51:10.507 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-09-12T15:51:10.508 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-09-12T15:51:10.508 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-09-12T15:51:10.508 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-09-12T15:51:10.508 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-09-12T15:51:10.508 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-09-12T15:51:10.508 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-09-12T15:51:10.509 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-09-12T15:51:10.509 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-09-12T15:51:10.509 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-09-12T15:51:10.509 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-09-12T15:51:10.509 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-09-12T15:51:10.510 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-09-12T15:51:10.510 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-09-12T15:51:10.510 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-09-12T15:51:10.510 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-09-12T15:51:10.510 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-09-12T15:51:10.510 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-09-12T15:51:10.511 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-09-12T15:51:10.511 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-09-12T15:51:10.511 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-09-12T15:51:10.511 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-09-12T15:51:10.511 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-09-12T15:51:10.512 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-09-12T15:51:10.512 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-09-12T15:51:10.512 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-09-12T15:51:10.512 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-09-12T15:51:10.512 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-09-12T15:51:10.512 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-09-12T15:51:10.513 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-09-12T15:51:10.513 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-09-12T15:51:10.513 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-09-12T15:51:10.513 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-09-12T15:51:10.513 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-09-12T15:51:10.514 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-09-12T15:51:10.514 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-09-12T15:51:10.514 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-09-12T15:51:10.514 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-09-12T15:51:10.514 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-09-12T15:51:10.515 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-09-12T15:51:10.515 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-09-12T15:51:10.515 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-09-12T15:51:10.515 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-09-12T15:51:10.515 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-09-12T15:51:10.515 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-09-12T15:51:10.516 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-09-12T15:51:10.516 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-09-12T15:51:10.516 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-09-12T15:51:10.516 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-09-12T15:51:10.516 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-09-12T15:51:10.517 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-09-12T15:51:10.517 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-09-12T15:51:10.517 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-09-12T15:51:10.517 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-09-12T15:51:10.517 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-09-12T15:51:10.518 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-09-12T15:51:10.518 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-09-12T15:51:10.518 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-09-12T15:51:10.518 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-09-12T15:51:10.518 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-09-12T15:51:10.519 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-09-12T15:51:10.519 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-09-12T15:51:10.519 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-09-12T15:51:10.519 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-09-12T15:51:10.519 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-09-12T15:51:10.519 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-09-12T15:51:10.520 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-09-12T15:51:10.520 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-09-12T15:51:10.520 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-09-12T15:51:10.520 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-09-12T15:51:10.520 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-09-12T15:51:10.521 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-09-12T15:51:10.521 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-09-12T15:51:10.521 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-09-12T15:51:10.521 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-09-12T15:51:10.521 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-09-12T15:51:10.522 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-09-12T15:51:10.522 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-09-12T15:51:10.522 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-09-12T15:51:10.522 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-09-12T15:51:10.522 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-09-12T15:51:10.523 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-09-12T15:51:10.523 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-09-12T15:51:10.523 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-09-12T15:51:10.523 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-09-12T15:51:10.523 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-09-12T15:51:10.524 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-09-12T15:51:10.524 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-09-12T15:51:10.524 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-09-12T15:51:10.524 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-09-12T15:51:10.524 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-09-12T15:51:10.524 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-09-12T15:51:10.525 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-09-12T15:51:10.525 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-09-12T15:51:10.525 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-09-12T15:51:10.525 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-09-12T15:51:10.525 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-09-12T15:51:10.526 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-09-12T15:51:10.526 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-09-12T15:51:10.526 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-09-12T15:51:10.526 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-09-12T15:51:10.526 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-09-12T15:51:10.527 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-09-12T15:51:10.527 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-09-12T15:51:10.527 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-09-12T15:51:10.527 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-09-12T15:51:10.527 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-09-12T15:51:10.528 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-09-12T15:51:10.528 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-09-12T15:51:10.528 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-09-12T15:51:10.528 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-09-12T15:51:10.528 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-09-12T15:51:10.529 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-09-12T15:51:10.529 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-09-12T15:51:10.529 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-09-12T15:51:10.529 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-09-12T15:51:10.529 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-09-12T15:51:10.529 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-09-12T15:51:10.530 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-09-12T15:51:10.530 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-09-12T15:51:10.530 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-09-12T15:51:10.530 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-09-12T15:51:10.530 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-09-12T15:51:10.531 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-09-12T15:51:10.531 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-09-12T15:51:10.531 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-09-12T15:51:10.531 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-09-12T15:51:10.531 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-09-12T15:51:10.531 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-09-12T15:51:10.532 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-09-12T15:51:10.532 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-09-12T15:51:10.532 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-09-12T15:51:10.532 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-09-12T15:51:10.532 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-09-12T15:51:10.533 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-09-12T15:51:10.533 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-09-12T15:51:10.533 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-09-12T15:51:10.533 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-09-12T15:51:10.533 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-09-12T15:51:10.533 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-09-12T15:51:10.534 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-09-12T15:51:10.534 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-09-12T15:51:10.534 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-09-12T15:51:10.534 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-09-12T15:51:10.535 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-09-12T15:51:10.535 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-09-12T15:51:10.535 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-09-12T15:51:10.535 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-09-12T15:51:10.535 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-09-12T15:51:10.535 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-09-12T15:51:10.536 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-09-12T15:51:10.536 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-09-12T15:51:10.536 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-09-12T15:51:10.536 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-09-12T15:51:10.536 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-09-12T15:51:10.537 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-09-12T15:51:10.537 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-09-12T15:51:10.537 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-09-12T15:51:10.537 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-09-12T15:51:10.537 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-09-12T15:51:10.537 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-09-12T15:51:10.538 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-09-12T15:51:10.538 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-09-12T15:51:10.538 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-09-12T15:51:10.538 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-09-12T15:51:10.538 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-09-12T15:51:10.539 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-09-12T15:51:10.539 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-09-12T15:51:10.539 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-09-12T15:51:10.539 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-09-12T15:51:10.539 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-09-12T15:51:10.540 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-09-12T15:51:10.540 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-09-12T15:51:10.540 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-09-12T15:51:10.540 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-09-12T15:51:10.540 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-09-12T15:51:10.541 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-09-12T15:51:10.541 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-09-12T15:51:10.541 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-09-12T15:51:10.541 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-09-12T15:51:10.541 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-09-12T15:51:10.541 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-09-12T15:51:10.542 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-09-12T15:51:10.542 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-09-12T15:51:10.542 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-09-12T15:51:10.542 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-09-12T15:51:10.542 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-09-12T15:51:10.543 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-09-12T15:51:10.543 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-09-12T15:51:10.543 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-09-12T15:51:10.543 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-09-12T15:51:10.543 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-09-12T15:51:10.543 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-09-12T15:51:10.544 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-09-12T15:51:10.544 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-09-12T15:51:10.544 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-09-12T15:51:10.544 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-09-12T15:51:10.544 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-09-12T15:51:10.545 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-09-12T15:51:10.545 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-09-12T15:51:10.545 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-09-12T15:51:10.545 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-09-12T15:51:10.545 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-09-12T15:51:10.545 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-09-12T15:51:10.546 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-09-12T15:51:10.546 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-09-12T15:51:10.546 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-09-12T15:51:10.546 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-09-12T15:51:10.546 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-09-12T15:51:10.547 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-09-12T15:51:10.547 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-09-12T15:51:10.547 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-09-12T15:51:10.547 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-09-12T15:51:10.547 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-09-12T15:51:10.547 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-09-12T15:51:10.548 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-09-12T15:51:10.548 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-09-12T15:51:10.548 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-09-12T15:51:10.548 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-09-12T15:51:10.548 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-09-12T15:51:10.549 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-09-12T15:51:10.549 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-09-12T15:51:10.549 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-09-12T15:51:10.549 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-09-12T15:51:10.549 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-09-12T15:51:10.550 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-09-12T15:51:10.550 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-09-12T15:51:10.550 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-09-12T15:51:10.550 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-09-12T15:51:10.550 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-09-12T15:51:10.550 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-09-12T15:51:10.551 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-09-12T15:51:10.551 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-09-12T15:51:10.551 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-09-12T15:51:10.551 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-09-12T15:51:10.552 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-09-12T15:51:10.552 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-09-12T15:51:10.552 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-09-12T15:51:10.552 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-09-12T15:51:10.552 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-09-12T15:51:10.553 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-09-12T15:51:10.553 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-09-12T15:51:10.553 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-09-12T15:51:10.553 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-09-12T15:51:10.553 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-09-12T15:51:10.553 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-09-12T15:51:10.554 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-09-12T15:51:10.554 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-09-12T15:51:10.554 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-09-12T15:51:10.554 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-09-12T15:51:10.554 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-09-12T15:51:10.555 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-09-12T15:51:10.555 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-09-12T15:51:10.555 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-09-12T15:51:10.555 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-09-12T15:51:10.555 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-09-12T15:51:10.556 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-09-12T15:51:10.556 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-09-12T15:51:10.556 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-09-12T15:51:10.556 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-09-12T15:51:10.556 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-09-12T15:51:10.556 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-09-12T15:51:10.557 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-09-12T15:51:10.557 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-09-12T15:51:10.557 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-09-12T15:51:10.557 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-09-12T15:51:10.557 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-09-12T15:51:10.558 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-09-12T15:51:10.558 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-09-12T15:51:10.558 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-09-12T15:51:10.558 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-09-12T15:51:10.558 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-09-12T15:51:10.559 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-09-12T15:51:10.559 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-09-12T15:51:10.559 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-09-12T15:51:10.559 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-09-12T15:51:10.559 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-09-12T15:51:10.560 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-09-12T15:51:10.560 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-09-12T15:51:10.560 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-09-12T15:51:10.560 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-09-12T15:51:10.560 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-09-12T15:51:10.561 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-09-12T15:51:10.561 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-09-12T15:51:10.561 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-09-12T15:51:10.561 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-09-12T15:51:10.561 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-09-12T15:51:10.562 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-09-12T15:51:10.562 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-09-12T15:51:10.562 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-09-12T15:51:10.562 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-09-12T15:51:10.562 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-09-12T15:51:10.562 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-09-12T15:51:10.563 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-09-12T15:51:10.563 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-09-12T15:51:10.563 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-09-12T15:51:10.563 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-09-12T15:51:10.563 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-09-12T15:51:10.564 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-09-12T15:51:10.564 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-09-12T15:51:10.564 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-09-12T15:51:10.564 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-09-12T15:51:10.564 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-09-12T15:51:10.564 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-09-12T15:51:10.565 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-09-12T15:51:10.565 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-09-12T15:51:10.565 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-09-12T15:51:10.565 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-09-12T15:51:10.565 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-09-12T15:51:10.565 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-09-12T15:51:10.566 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-09-12T15:51:10.566 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-09-12T15:51:10.566 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-09-12T15:51:10.566 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-09-12T15:51:10.567 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-09-12T15:51:10.567 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-09-12T15:51:10.567 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-09-12T15:51:10.567 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-09-12T15:51:10.567 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-09-12T15:51:10.567 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-09-12T15:51:10.568 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-09-12T15:51:10.568 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-09-12T15:51:10.568 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-09-12T15:51:10.568 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-09-12T15:51:10.568 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-09-12T15:51:10.569 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-09-12T15:51:10.569 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-09-12T15:51:10.569 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-09-12T15:51:10.569 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-09-12T15:51:10.569 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-09-12T15:51:10.569 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-09-12T15:51:10.570 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-09-12T15:51:10.570 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-09-12T15:51:10.570 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-09-12T15:51:10.570 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-09-12T15:51:10.570 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-09-12T15:51:10.571 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-09-12T15:51:10.571 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-09-12T15:51:10.571 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-09-12T15:51:10.571 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-09-12T15:51:10.571 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-09-12T15:51:10.571 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-09-12T15:51:10.572 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-09-12T15:51:10.572 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-09-12T15:51:10.572 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-09-12T15:51:10.572 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-09-12T15:51:10.572 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-09-12T15:51:10.573 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-09-12T15:51:10.573 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-09-12T15:51:10.573 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-09-12T15:51:10.573 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-09-12T15:51:10.573 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-09-12T15:51:10.573 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-09-12T15:51:10.574 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-09-12T15:51:10.574 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-09-12T15:51:10.574 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-09-12T15:51:10.574 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-09-12T15:51:10.574 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-09-12T15:51:10.575 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-09-12T15:51:10.575 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-09-12T15:51:10.575 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-09-12T15:51:10.575 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-09-12T15:51:10.575 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-09-12T15:51:10.575 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-09-12T15:51:10.576 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-09-12T15:51:10.576 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-09-12T15:51:10.576 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-09-12T15:51:10.576 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-09-12T15:51:10.576 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-09-12T15:51:10.577 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-09-12T15:51:10.577 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-09-12T15:51:10.577 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-09-12T15:51:10.577 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-09-12T15:51:10.577 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-09-12T15:51:10.578 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-09-12T15:51:10.578 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-09-12T15:51:10.578 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-09-12T15:51:10.578 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-09-12T15:51:10.578 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-09-12T15:51:10.578 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-09-12T15:51:10.579 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-09-12T15:51:10.579 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-09-12T15:51:10.579 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-09-12T15:51:10.579 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-09-12T15:51:10.579 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-09-12T15:51:10.580 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-09-12T15:51:10.580 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-09-12T15:51:10.580 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-09-12T15:51:10.580 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-09-12T15:51:10.580 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-09-12T15:51:10.580 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-09-12T15:51:10.581 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-09-12T15:51:10.581 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-09-12T15:51:10.581 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-09-12T15:51:10.581 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-09-12T15:51:10.581 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-09-12T15:51:10.582 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-09-12T15:51:10.582 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-09-12T15:51:10.582 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-09-12T15:51:10.582 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-09-12T15:51:10.582 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-09-12T15:51:10.583 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-09-12T15:51:10.583 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-09-12T15:51:10.583 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-09-12T15:51:10.583 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-09-12T15:51:10.583 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-09-12T15:51:10.583 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-09-12T15:51:10.584 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-09-12T15:51:10.584 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-09-12T15:51:10.584 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-09-12T15:51:10.584 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-09-12T15:51:10.584 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-09-12T15:51:10.585 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-09-12T15:51:10.585 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-09-12T15:51:10.585 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-09-12T15:51:10.585 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-09-12T15:51:10.585 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-09-12T15:51:10.585 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-09-12T15:51:10.586 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-09-12T15:51:10.586 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-09-12T15:51:10.586 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-09-12T15:51:10.586 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-09-12T15:51:10.586 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-09-12T15:51:10.587 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-09-12T15:51:10.587 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-09-12T15:51:10.587 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-09-12T15:51:10.587 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-09-12T15:51:10.587 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-09-12T15:51:10.588 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-09-12T15:51:10.588 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-09-12T15:51:10.588 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-09-12T15:51:10.588 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-09-12T15:51:10.588 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-09-12T15:51:10.588 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-09-12T15:51:10.589 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-09-12T15:51:10.589 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-09-12T15:51:10.589 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-09-12T15:51:10.589 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-09-12T15:51:10.589 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-09-12T15:51:10.590 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-09-12T15:51:10.590 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-09-12T15:51:10.590 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-09-12T15:51:10.590 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-09-12T15:51:10.590 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-09-12T15:51:10.590 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-09-12T15:51:10.591 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-09-12T15:51:10.591 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-09-12T15:51:10.591 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-09-12T15:51:10.591 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-09-12T15:51:10.591 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-09-12T15:51:10.592 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-09-12T15:51:10.592 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-09-12T15:51:10.592 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-09-12T15:51:10.592 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-09-12T15:51:10.592 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-09-12T15:51:10.592 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-09-12T15:51:10.593 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-09-12T15:51:10.593 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-09-12T15:51:10.593 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-09-12T15:51:10.593 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-09-12T15:51:10.593 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-09-12T15:51:10.594 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-09-12T15:51:10.594 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-09-12T15:51:10.594 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-09-12T15:51:10.594 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-09-12T15:51:10.594 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-09-12T15:51:10.594 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-09-12T15:51:10.595 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-09-12T15:51:10.595 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-09-12T15:51:10.595 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-09-12T15:51:10.595 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-09-12T15:51:10.595 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-09-12T15:51:10.596 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-09-12T15:51:10.596 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-09-12T15:51:10.596 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-09-12T15:51:10.596 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-09-12T15:51:10.596 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-09-12T15:51:10.596 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-09-12T15:51:10.597 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-09-12T15:51:10.597 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-09-12T15:51:10.597 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-09-12T15:51:10.597 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-09-12T15:51:10.597 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-09-12T15:51:10.598 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-09-12T15:51:10.598 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-09-12T15:51:10.598 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-09-12T15:51:10.598 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-09-12T15:51:10.598 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-09-12T15:51:10.599 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-09-12T15:51:10.599 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-09-12T15:51:10.599 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-09-12T15:51:10.599 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-09-12T15:51:10.599 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-09-12T15:51:10.599 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-09-12T15:51:10.600 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-09-12T15:51:10.600 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-09-12T15:51:10.600 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-09-12T15:51:10.600 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-09-12T15:51:10.600 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-09-12T15:51:10.601 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-09-12T15:51:10.601 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-09-12T15:51:10.601 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-09-12T15:51:10.601 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-09-12T15:51:10.601 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-09-12T15:51:10.601 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-09-12T15:51:10.602 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-09-12T15:51:10.602 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-09-12T15:51:10.602 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-09-12T15:51:10.602 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-09-12T15:51:10.602 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-09-12T15:51:10.603 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-09-12T15:51:10.603 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-09-12T15:51:10.603 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-09-12T15:51:10.603 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-09-12T15:51:10.603 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-09-12T15:51:10.604 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-09-12T15:51:10.604 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-09-12T15:51:10.604 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-09-12T15:51:10.604 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-09-12T15:51:10.604 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-09-12T15:51:10.604 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-09-12T15:51:10.605 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-09-12T15:51:10.605 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-09-12T15:51:10.605 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-09-12T15:51:10.605 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-09-12T15:51:10.605 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-09-12T15:51:10.606 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-09-12T15:51:10.606 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-09-12T15:51:10.606 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-09-12T15:51:10.606 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-09-12T15:51:10.606 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-09-12T15:51:10.606 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-09-12T15:51:10.607 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-09-12T15:51:10.607 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-09-12T15:51:10.607 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-09-12T15:51:10.607 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-09-12T15:51:10.607 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-09-12T15:51:10.608 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-09-12T15:51:10.608 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-09-12T15:51:10.608 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-09-12T15:51:10.608 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-09-12T15:51:10.608 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-09-12T15:51:10.608 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-09-12T15:51:10.609 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-09-12T15:51:10.609 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-09-12T15:51:10.609 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-09-12T15:51:10.609 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-09-12T15:51:10.609 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-09-12T15:51:10.610 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-09-12T15:51:10.610 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-09-12T15:51:10.610 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-09-12T15:51:10.610 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-09-12T15:51:10.610 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-09-12T15:51:10.611 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-09-12T15:51:10.611 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-09-12T15:51:10.611 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-09-12T15:51:10.611 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-09-12T15:51:10.611 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-09-12T15:51:10.611 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-09-12T15:51:10.612 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-09-12T15:51:10.612 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-09-12T15:51:10.612 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-09-12T15:51:10.612 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-09-12T15:51:10.612 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-09-12T15:51:10.613 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-09-12T15:51:10.613 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-09-12T15:51:10.613 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-09-12T15:51:10.613 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-09-12T15:51:10.613 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-09-12T15:51:10.614 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-09-12T15:51:10.614 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-09-12T15:51:10.614 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-09-12T15:51:10.614 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-09-12T15:51:10.614 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-09-12T15:51:10.615 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-09-12T15:51:10.615 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-09-12T15:51:10.615 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-09-12T15:51:10.615 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-09-12T15:51:10.615 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-09-12T15:51:10.615 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-09-12T15:51:10.616 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-09-12T15:51:10.616 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-09-12T15:51:10.616 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-09-12T15:51:10.616 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-09-12T15:51:10.616 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-09-12T15:51:10.617 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-09-12T15:51:10.617 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-09-12T15:51:10.617 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-09-12T15:51:10.617 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-09-12T15:51:10.617 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-09-12T15:51:10.618 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-09-12T15:51:10.618 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-09-12T15:51:10.618 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-09-12T15:51:10.618 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-09-12T15:51:10.618 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-09-12T15:51:10.619 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-09-12T15:51:10.619 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-09-12T15:51:10.619 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-09-12T15:51:10.619 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-09-12T15:51:10.619 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-09-12T15:51:10.620 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-09-12T15:51:10.620 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-09-12T15:51:10.620 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-09-12T15:51:10.620 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-09-12T15:51:10.620 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-09-12T15:51:10.621 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-09-12T15:51:10.621 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-09-12T15:51:10.621 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-09-12T15:51:10.621 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-09-12T15:51:10.621 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-09-12T15:51:10.622 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-09-12T15:51:10.622 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-09-12T15:51:10.622 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-09-12T15:51:10.622 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-09-12T15:51:10.622 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-09-12T15:51:10.623 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-09-12T15:51:10.623 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-09-12T15:51:10.623 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-09-12T15:51:10.623 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-09-12T15:51:10.623 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-09-12T15:51:10.623 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-09-12T15:51:10.624 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-09-12T15:51:10.624 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-09-12T15:51:10.624 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-09-12T15:51:10.624 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-09-12T15:51:10.624 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-09-12T15:51:10.625 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-09-12T15:51:10.625 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-09-12T15:51:10.625 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-09-12T15:51:10.625 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-09-12T15:51:10.625 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-09-12T15:51:10.626 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-09-12T15:51:10.626 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-09-12T15:51:10.626 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-09-12T15:51:10.626 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-09-12T15:51:10.626 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-09-12T15:51:10.627 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-09-12T15:51:10.627 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-09-12T15:51:10.627 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-09-12T15:51:10.627 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-09-12T15:51:10.627 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-09-12T15:51:10.628 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-09-12T15:51:10.628 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-09-12T15:51:10.628 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-09-12T15:51:10.628 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-09-12T15:51:10.628 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-09-12T15:51:10.628 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-09-12T15:51:10.629 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-09-12T15:51:10.629 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-09-12T15:51:10.629 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-09-12T15:51:10.629 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-09-12T15:51:10.629 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-09-12T15:51:10.630 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-09-12T15:51:10.630 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-09-12T15:51:10.630 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-09-12T15:51:10.630 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-09-12T15:51:10.630 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-09-12T15:51:10.630 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-09-12T15:51:10.631 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-09-12T15:51:10.631 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-09-12T15:51:10.631 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-09-12T15:51:10.631 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-09-12T15:51:10.631 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-09-12T15:51:10.632 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-09-12T15:51:10.632 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-09-12T15:51:10.632 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-09-12T15:51:10.632 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-09-12T15:51:10.632 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-09-12T15:51:10.632 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-09-12T15:51:10.633 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-09-12T15:51:10.633 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-09-12T15:51:10.633 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-09-12T15:51:10.633 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-09-12T15:51:10.633 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-09-12T15:51:10.634 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-09-12T15:51:10.634 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-09-12T15:51:10.634 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-09-12T15:51:10.634 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-09-12T15:51:10.634 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-09-12T15:51:10.635 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-09-12T15:51:10.637 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-09-12T15:51:10.637 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-09-12T15:51:10.637 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-09-12T15:51:10.637 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-09-12T15:51:10.637 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-09-12T15:51:10.638 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-09-12T15:51:10.638 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-09-12T15:51:10.638 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-09-12T15:51:10.638 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-09-12T15:51:10.639 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-09-12T15:51:10.639 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-09-12T15:51:10.639 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-09-12T15:51:10.639 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-09-12T15:51:10.639 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-09-12T15:51:10.640 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-09-12T15:51:10.640 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-09-12T15:51:10.640 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-09-12T15:51:10.640 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-09-12T15:51:10.640 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-09-12T15:51:10.641 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-09-12T15:51:10.641 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-09-12T15:51:10.641 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-09-12T15:51:10.641 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-09-12T15:51:10.641 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-09-12T15:51:10.642 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-09-12T15:51:10.642 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-09-12T15:51:10.642 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-09-12T15:51:10.642 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-09-12T15:51:10.643 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-09-12T15:51:10.643 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-09-12T15:51:10.643 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-09-12T15:51:10.643 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-09-12T15:51:10.644 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-09-12T15:51:10.644 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-09-12T15:51:10.644 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-09-12T15:51:10.644 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-09-12T15:51:10.644 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-09-12T15:51:10.645 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-09-12T15:51:10.645 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-09-12T15:51:10.645 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-09-12T15:51:10.645 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-09-12T15:51:10.645 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-09-12T15:51:10.645 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-09-12T15:51:10.646 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-09-12T15:51:10.646 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-09-12T15:51:10.646 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-09-12T15:51:10.646 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-09-12T15:51:10.646 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-09-12T15:51:10.647 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-09-12T15:51:10.647 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-09-12T15:51:10.647 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-09-12T15:51:10.647 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-09-12T15:51:10.648 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-09-12T15:51:10.648 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-09-12T15:51:10.648 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-09-12T15:51:10.648 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-09-12T15:51:10.648 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-09-12T15:51:10.649 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-09-12T15:51:10.649 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-09-12T15:51:10.649 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-09-12T15:51:10.649 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-09-12T15:51:10.649 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-09-12T15:51:10.650 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-09-12T15:51:10.650 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-09-12T15:51:10.650 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-09-12T15:51:10.650 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-09-12T15:51:10.650 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-09-12T15:51:10.651 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-09-12T15:51:10.651 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-09-12T15:51:10.651 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-09-12T15:51:10.651 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-09-12T15:51:10.652 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-09-12T15:51:10.652 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-09-12T15:51:10.652 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-09-12T15:51:10.652 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-09-12T15:51:10.652 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-09-12T15:51:10.652 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-09-12T15:51:10.653 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-09-12T15:51:10.653 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-09-12T15:51:10.653 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-09-12T15:51:10.653 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-09-12T15:51:10.653 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-09-12T15:51:10.654 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-09-12T15:51:10.654 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-09-12T15:51:10.654 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-09-12T15:51:10.654 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-09-12T15:51:10.654 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-09-12T15:51:10.655 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-09-12T15:51:10.655 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-09-12T15:51:10.655 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-09-12T15:51:10.655 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-09-12T15:51:10.655 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-09-12T15:51:10.656 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-09-12T15:51:10.656 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-09-12T15:51:10.656 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-09-12T15:51:10.656 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-09-12T15:51:10.656 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-09-12T15:51:10.657 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-09-12T15:51:10.657 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-09-12T15:51:10.657 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-09-12T15:51:10.657 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-09-12T15:51:10.657 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-09-12T15:51:10.658 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-09-12T15:51:10.658 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-09-12T15:51:10.658 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-09-12T15:51:10.658 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-09-12T15:51:10.659 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-09-12T15:51:10.659 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-09-12T15:51:10.659 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-09-12T15:51:10.659 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-09-12T15:51:10.659 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-09-12T15:51:10.660 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-09-12T15:51:10.660 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-09-12T15:51:10.660 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-09-12T15:51:10.660 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-09-12T15:51:10.660 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-09-12T15:51:10.661 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-09-12T15:51:10.661 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-09-12T15:51:10.661 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-09-12T15:51:10.661 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-09-12T15:51:10.662 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-09-12T15:51:10.662 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-09-12T15:51:10.662 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-09-12T15:51:10.662 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-09-12T15:51:10.663 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-09-12T15:51:10.663 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-09-12T15:51:10.663 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-09-12T15:51:10.663 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-09-12T15:51:10.663 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-09-12T15:51:10.664 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-09-12T15:51:10.664 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-09-12T15:51:10.664 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-09-12T15:51:10.664 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-09-12T15:51:10.665 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-09-12T15:51:10.665 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-09-12T15:51:10.665 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-09-12T15:51:10.665 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-09-12T15:51:10.665 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-09-12T15:51:10.666 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-09-12T15:51:10.666 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-09-12T15:51:10.666 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-09-12T15:51:10.666 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-09-12T15:51:10.666 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-09-12T15:51:10.667 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-09-12T15:51:10.667 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-09-12T15:51:10.667 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-09-12T15:51:10.667 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-09-12T15:51:10.667 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-09-12T15:51:10.668 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-09-12T15:51:10.668 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-09-12T15:51:10.668 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-09-12T15:51:10.668 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-09-12T15:51:10.668 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-09-12T15:51:10.669 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-09-12T15:51:10.669 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-09-12T15:51:10.669 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-09-12T15:51:10.669 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-09-12T15:51:10.669 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-09-12T15:51:10.670 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-09-12T15:51:10.670 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-09-12T15:51:10.670 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-09-12T15:51:10.670 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-09-12T15:51:10.671 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-09-12T15:51:10.671 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-09-12T15:51:10.671 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-09-12T15:51:10.671 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-09-12T15:51:10.671 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-09-12T15:51:10.672 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-09-12T15:51:10.672 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-09-12T15:51:10.672 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-09-12T15:51:10.672 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-09-12T15:51:10.672 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-09-12T15:51:10.673 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-09-12T15:51:10.673 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-09-12T15:51:10.673 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-09-12T15:51:10.673 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-09-12T15:51:10.673 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-09-12T15:51:10.674 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-09-12T15:51:10.674 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-09-12T15:51:10.674 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-09-12T15:51:10.674 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-09-12T15:51:10.675 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-09-12T15:51:10.675 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-09-12T15:51:10.675 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-09-12T15:51:10.675 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-09-12T15:51:10.675 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-09-12T15:51:10.676 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-09-12T15:51:10.676 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-09-12T15:51:10.676 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-09-12T15:51:10.676 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-09-12T15:51:10.676 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-09-12T15:51:10.677 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-09-12T15:51:10.677 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-09-12T15:51:10.677 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-09-12T15:51:10.677 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-09-12T15:51:10.677 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-09-12T15:51:10.678 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-09-12T15:51:10.678 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-09-12T15:51:10.678 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-09-12T15:51:10.678 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-09-12T15:51:10.679 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-09-12T15:51:10.679 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-09-12T15:51:10.679 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-09-12T15:51:10.679 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-09-12T15:51:10.680 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-09-12T15:51:10.680 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-09-12T15:51:10.680 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-09-12T15:51:10.680 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-09-12T15:51:10.680 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-09-12T15:51:10.681 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-09-12T15:51:10.681 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-09-12T15:51:10.681 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-09-12T15:51:10.681 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-09-12T15:51:10.681 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-09-12T15:51:10.682 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-09-12T15:51:10.682 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-09-12T15:51:10.682 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-09-12T15:51:10.682 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-09-12T15:51:10.682 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-09-12T15:51:10.683 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-09-12T15:51:10.683 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-09-12T15:51:10.683 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-09-12T15:51:10.683 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-09-12T15:51:10.684 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-09-12T15:51:10.684 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-09-12T15:51:10.684 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-09-12T15:51:10.684 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-09-12T15:51:10.684 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-09-12T15:51:10.685 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-09-12T15:51:10.685 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-09-12T15:51:10.685 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-09-12T15:51:10.685 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-09-12T15:51:10.686 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-09-12T15:51:10.686 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-09-12T15:51:10.686 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-09-12T15:51:10.686 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-09-12T15:51:10.687 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-09-12T15:51:10.687 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-09-12T15:51:10.687 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-09-12T15:51:10.687 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-09-12T15:51:10.687 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-09-12T15:51:10.688 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-09-12T15:51:10.688 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-09-12T15:51:10.688 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-09-12T15:51:10.688 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-09-12T15:51:10.689 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-09-12T15:51:10.689 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-09-12T15:51:10.689 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-09-12T15:51:10.689 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-09-12T15:51:10.689 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-09-12T15:51:10.690 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-09-12T15:51:10.690 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-09-12T15:51:10.690 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-09-12T15:51:10.690 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-09-12T15:51:10.691 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-09-12T15:51:10.691 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-09-12T15:51:10.691 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-09-12T15:51:10.691 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-09-12T15:51:10.691 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-09-12T15:51:10.692 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-09-12T15:51:10.692 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-09-12T15:51:10.692 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-09-12T15:51:10.692 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-09-12T15:51:10.693 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-09-12T15:51:10.693 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-09-12T15:51:10.693 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-09-12T15:51:10.693 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-09-12T15:51:10.693 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-09-12T15:51:10.694 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-09-12T15:51:10.694 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-09-12T15:51:10.694 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-09-12T15:51:10.694 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-09-12T15:51:10.694 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-09-12T15:51:10.695 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-09-12T15:51:10.695 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-09-12T15:51:10.695 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-09-12T15:51:10.695 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-09-12T15:51:10.695 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-09-12T15:51:10.696 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-09-12T15:51:10.696 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-09-12T15:51:10.696 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-09-12T15:51:10.696 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-09-12T15:51:10.697 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-09-12T15:51:10.698 DEBUG:teuthology.orchestra.run.smithi144:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-09-12T15:51:10.726 INFO:teuthology.orchestra.run.smithi144.stdout:postinstall scriptlet (using /bin/sh): 2023-09-12T15:51:10.727 INFO:teuthology.orchestra.run.smithi144.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-09-12T15:51:10.727 INFO:teuthology.orchestra.run.smithi144.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-12T15:51:10.727 INFO:teuthology.orchestra.run.smithi144.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-12T15:51:10.727 INFO:teuthology.orchestra.run.smithi144.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-12T15:51:10.727 INFO:teuthology.orchestra.run.smithi144.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-12T15:51:10.728 INFO:teuthology.orchestra.run.smithi144.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-12T15:51:10.728 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2023-09-12T15:51:10.728 INFO:teuthology.orchestra.run.smithi144.stdout:preuninstall scriptlet (using /bin/sh): 2023-09-12T15:51:10.728 INFO:teuthology.orchestra.run.smithi144.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-09-12T15:51:10.728 INFO:teuthology.orchestra.run.smithi144.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-09-12T15:51:10.728 INFO:teuthology.orchestra.run.smithi144.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-09-12T15:51:10.729 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-09-12T15:51:10.729 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2023-09-12T15:51:10.729 INFO:teuthology.orchestra.run.smithi144.stdout:postuninstall scriptlet (using /bin/sh): 2023-09-12T15:51:10.729 INFO:teuthology.orchestra.run.smithi144.stdout:if [ -x /sbin/update-bootloader ]; then 2023-09-12T15:51:10.729 INFO:teuthology.orchestra.run.smithi144.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-09-12T15:51:10.730 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2023-09-12T15:51:10.731 DEBUG:teuthology.orchestra.run.smithi144:> sudo rpm -qi grub2-tools 2023-09-12T15:51:10.810 INFO:teuthology.orchestra.run.smithi144.stdout:Name : grub2-tools 2023-09-12T15:51:10.811 INFO:teuthology.orchestra.run.smithi144.stdout:Epoch : 1 2023-09-12T15:51:10.811 INFO:teuthology.orchestra.run.smithi144.stdout:Version : 2.02 2023-09-12T15:51:10.811 INFO:teuthology.orchestra.run.smithi144.stdout:Release : 129.el8 2023-09-12T15:51:10.811 INFO:teuthology.orchestra.run.smithi144.stdout:Architecture: x86_64 2023-09-12T15:51:10.812 INFO:teuthology.orchestra.run.smithi144.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-09-12T15:51:10.812 INFO:teuthology.orchestra.run.smithi144.stdout:Group : System Environment/Base 2023-09-12T15:51:10.812 INFO:teuthology.orchestra.run.smithi144.stdout:Size : 9265586 2023-09-12T15:51:10.812 INFO:teuthology.orchestra.run.smithi144.stdout:License : GPLv3+ 2023-09-12T15:51:10.812 INFO:teuthology.orchestra.run.smithi144.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-09-12T15:51:10.813 INFO:teuthology.orchestra.run.smithi144.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-09-12T15:51:10.813 INFO:teuthology.orchestra.run.smithi144.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-09-12T15:51:10.813 INFO:teuthology.orchestra.run.smithi144.stdout:Build Host : kbuilder.bsys.centos.org 2023-09-12T15:51:10.813 INFO:teuthology.orchestra.run.smithi144.stdout:Relocations : (not relocatable) 2023-09-12T15:51:10.813 INFO:teuthology.orchestra.run.smithi144.stdout:Packager : CentOS BuildSystem 2023-09-12T15:51:10.814 INFO:teuthology.orchestra.run.smithi144.stdout:Vendor : CentOS 2023-09-12T15:51:10.814 INFO:teuthology.orchestra.run.smithi144.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-12T15:51:10.814 INFO:teuthology.orchestra.run.smithi144.stdout:Summary : Support tools for GRUB. 2023-09-12T15:51:10.814 INFO:teuthology.orchestra.run.smithi144.stdout:Description : 2023-09-12T15:51:10.814 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T15:51:10.815 INFO:teuthology.orchestra.run.smithi144.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-12T15:51:10.815 INFO:teuthology.orchestra.run.smithi144.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-12T15:51:10.815 INFO:teuthology.orchestra.run.smithi144.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-12T15:51:10.815 INFO:teuthology.orchestra.run.smithi144.stdout:hardware devices. 2023-09-12T15:51:10.815 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T15:51:10.815 INFO:teuthology.orchestra.run.smithi144.stdout:This subpackage provides tools for support of all platforms. 2023-09-12T15:51:10.816 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-12T15:51:10.817 INFO:teuthology.task.kernel:Updating grub on smithi144 to boot 6.5.0-rc7-gfef64f93da2b 2023-09-12T15:51:10.817 DEBUG:teuthology.orchestra.run.smithi144:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-12T15:51:13.158 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi112.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-09-12T15:51:13.159 DEBUG:teuthology.orchestra.run.smithi112:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-09-12T15:51:13.214 INFO:teuthology.orchestra.run.smithi112.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-12T15:51:13.214 INFO:teuthology.orchestra.run.smithi112.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-09-12T15:51:13.214 INFO:teuthology.orchestra.run.smithi112.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-09-12T15:51:13.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-09-12T15:51:13.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-09-12T15:51:13.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-09-12T15:51:13.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-09-12T15:51:13.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-09-12T15:51:13.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-09-12T15:51:13.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-09-12T15:51:13.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-09-12T15:51:13.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-09-12T15:51:13.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-09-12T15:51:13.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-09-12T15:51:13.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-09-12T15:51:13.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-09-12T15:51:13.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-09-12T15:51:13.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-09-12T15:51:13.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-09-12T15:51:13.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-09-12T15:51:13.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-09-12T15:51:13.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-09-12T15:51:13.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-09-12T15:51:13.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-09-12T15:51:13.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-09-12T15:51:13.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-09-12T15:51:13.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-09-12T15:51:13.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-09-12T15:51:13.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-09-12T15:51:13.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-09-12T15:51:13.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-09-12T15:51:13.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-09-12T15:51:13.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-09-12T15:51:13.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-09-12T15:51:13.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-09-12T15:51:13.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-09-12T15:51:13.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-09-12T15:51:13.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-09-12T15:51:13.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-09-12T15:51:13.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-09-12T15:51:13.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-09-12T15:51:13.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-09-12T15:51:13.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-09-12T15:51:13.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-09-12T15:51:13.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-09-12T15:51:13.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-09-12T15:51:13.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-09-12T15:51:13.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-09-12T15:51:13.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-09-12T15:51:13.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-09-12T15:51:13.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-09-12T15:51:13.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-09-12T15:51:13.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-09-12T15:51:13.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-09-12T15:51:13.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-09-12T15:51:13.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-09-12T15:51:13.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-09-12T15:51:13.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-09-12T15:51:13.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-09-12T15:51:13.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-09-12T15:51:13.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-09-12T15:51:13.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-09-12T15:51:13.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-09-12T15:51:13.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-09-12T15:51:13.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-09-12T15:51:13.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-09-12T15:51:13.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-09-12T15:51:13.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-09-12T15:51:13.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-09-12T15:51:13.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-09-12T15:51:13.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-09-12T15:51:13.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-09-12T15:51:13.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-09-12T15:51:13.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-09-12T15:51:13.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-09-12T15:51:13.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-09-12T15:51:13.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-09-12T15:51:13.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-09-12T15:51:13.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-09-12T15:51:13.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-09-12T15:51:13.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-09-12T15:51:13.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-09-12T15:51:13.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-09-12T15:51:13.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-09-12T15:51:13.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-09-12T15:51:13.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-09-12T15:51:13.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-09-12T15:51:13.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-09-12T15:51:13.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-09-12T15:51:13.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-09-12T15:51:13.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-09-12T15:51:13.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-09-12T15:51:13.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-09-12T15:51:13.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-09-12T15:51:13.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-09-12T15:51:13.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-09-12T15:51:13.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-09-12T15:51:13.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-09-12T15:51:13.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-09-12T15:51:13.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-09-12T15:51:13.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-09-12T15:51:13.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-09-12T15:51:13.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-09-12T15:51:13.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-09-12T15:51:13.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-09-12T15:51:13.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-09-12T15:51:13.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-09-12T15:51:13.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-09-12T15:51:13.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-09-12T15:51:13.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-09-12T15:51:13.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-09-12T15:51:13.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-09-12T15:51:13.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-09-12T15:51:13.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-09-12T15:51:13.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-09-12T15:51:13.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-09-12T15:51:13.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-09-12T15:51:13.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-09-12T15:51:13.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-09-12T15:51:13.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-09-12T15:51:13.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-09-12T15:51:13.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-09-12T15:51:13.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-09-12T15:51:13.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-09-12T15:51:13.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-09-12T15:51:13.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-09-12T15:51:13.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-09-12T15:51:13.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-09-12T15:51:13.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-09-12T15:51:13.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-09-12T15:51:13.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-09-12T15:51:13.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-09-12T15:51:13.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-09-12T15:51:13.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-09-12T15:51:13.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-09-12T15:51:13.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-09-12T15:51:13.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-09-12T15:51:13.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-09-12T15:51:13.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-09-12T15:51:13.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-09-12T15:51:13.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-09-12T15:51:13.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-09-12T15:51:13.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-09-12T15:51:13.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-09-12T15:51:13.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-09-12T15:51:13.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-09-12T15:51:13.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-09-12T15:51:13.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-09-12T15:51:13.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-09-12T15:51:13.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-09-12T15:51:13.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-09-12T15:51:13.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-09-12T15:51:13.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-09-12T15:51:13.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-09-12T15:51:13.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-09-12T15:51:13.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-09-12T15:51:13.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-09-12T15:51:13.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-09-12T15:51:13.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-09-12T15:51:13.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-09-12T15:51:13.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-09-12T15:51:13.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-09-12T15:51:13.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-09-12T15:51:13.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-09-12T15:51:13.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-09-12T15:51:13.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-09-12T15:51:13.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-09-12T15:51:13.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-09-12T15:51:13.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-09-12T15:51:13.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-09-12T15:51:13.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-09-12T15:51:13.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-09-12T15:51:13.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-09-12T15:51:13.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-09-12T15:51:13.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-09-12T15:51:13.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-09-12T15:51:13.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-09-12T15:51:13.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-09-12T15:51:13.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-09-12T15:51:13.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-09-12T15:51:13.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-09-12T15:51:13.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-09-12T15:51:13.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-09-12T15:51:13.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-09-12T15:51:13.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-09-12T15:51:13.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-09-12T15:51:13.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-09-12T15:51:13.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-09-12T15:51:13.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-09-12T15:51:13.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-09-12T15:51:13.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-09-12T15:51:13.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-09-12T15:51:13.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-09-12T15:51:13.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-09-12T15:51:13.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-09-12T15:51:13.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-09-12T15:51:13.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-09-12T15:51:13.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-09-12T15:51:13.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-09-12T15:51:13.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-09-12T15:51:13.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-09-12T15:51:13.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-09-12T15:51:13.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-09-12T15:51:13.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-09-12T15:51:13.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-09-12T15:51:13.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-09-12T15:51:13.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-09-12T15:51:13.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-09-12T15:51:13.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-09-12T15:51:13.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-09-12T15:51:13.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-09-12T15:51:13.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-09-12T15:51:13.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-09-12T15:51:13.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-09-12T15:51:13.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-09-12T15:51:13.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-09-12T15:51:13.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-09-12T15:51:13.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-09-12T15:51:13.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-09-12T15:51:13.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-09-12T15:51:13.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-09-12T15:51:13.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-09-12T15:51:13.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-09-12T15:51:13.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-09-12T15:51:13.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-09-12T15:51:13.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-09-12T15:51:13.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-09-12T15:51:13.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-09-12T15:51:13.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-09-12T15:51:13.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-09-12T15:51:13.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-09-12T15:51:13.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-09-12T15:51:13.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-09-12T15:51:13.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-09-12T15:51:13.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-09-12T15:51:13.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-09-12T15:51:13.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-09-12T15:51:13.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-09-12T15:51:13.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-09-12T15:51:13.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-09-12T15:51:13.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-09-12T15:51:13.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-09-12T15:51:13.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-09-12T15:51:13.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-09-12T15:51:13.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-09-12T15:51:13.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-09-12T15:51:13.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-09-12T15:51:13.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-09-12T15:51:13.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-09-12T15:51:13.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-09-12T15:51:13.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-09-12T15:51:13.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-09-12T15:51:13.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-09-12T15:51:13.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-09-12T15:51:13.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-09-12T15:51:13.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-09-12T15:51:13.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-09-12T15:51:13.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-09-12T15:51:13.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-09-12T15:51:13.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-09-12T15:51:13.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-09-12T15:51:13.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-09-12T15:51:13.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-09-12T15:51:13.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-09-12T15:51:13.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-09-12T15:51:13.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-09-12T15:51:13.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-09-12T15:51:13.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-09-12T15:51:13.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-09-12T15:51:13.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-09-12T15:51:13.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-09-12T15:51:13.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-09-12T15:51:13.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-09-12T15:51:13.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-09-12T15:51:13.266 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-09-12T15:51:13.266 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-09-12T15:51:13.266 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-09-12T15:51:13.266 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-09-12T15:51:13.266 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-09-12T15:51:13.267 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-09-12T15:51:13.267 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-09-12T15:51:13.267 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-09-12T15:51:13.267 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-09-12T15:51:13.267 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-09-12T15:51:13.267 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-09-12T15:51:13.268 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-09-12T15:51:13.268 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-09-12T15:51:13.268 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-09-12T15:51:13.268 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-09-12T15:51:13.268 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-09-12T15:51:13.269 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-09-12T15:51:13.269 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-09-12T15:51:13.269 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-09-12T15:51:13.269 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-09-12T15:51:13.269 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-09-12T15:51:13.269 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-09-12T15:51:13.270 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-09-12T15:51:13.270 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-09-12T15:51:13.270 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-09-12T15:51:13.270 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-09-12T15:51:13.270 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-09-12T15:51:13.271 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-09-12T15:51:13.271 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-09-12T15:51:13.271 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-09-12T15:51:13.271 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-09-12T15:51:13.271 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-09-12T15:51:13.272 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-09-12T15:51:13.272 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-09-12T15:51:13.272 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-09-12T15:51:13.272 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-09-12T15:51:13.272 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-09-12T15:51:13.272 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-09-12T15:51:13.273 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-09-12T15:51:13.273 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-09-12T15:51:13.273 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-09-12T15:51:13.273 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-09-12T15:51:13.273 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-09-12T15:51:13.274 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-09-12T15:51:13.274 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-09-12T15:51:13.274 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-09-12T15:51:13.274 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-09-12T15:51:13.274 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-09-12T15:51:13.274 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-09-12T15:51:13.275 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-09-12T15:51:13.275 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-09-12T15:51:13.275 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-09-12T15:51:13.275 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-09-12T15:51:13.275 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-09-12T15:51:13.276 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-09-12T15:51:13.276 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-09-12T15:51:13.276 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-09-12T15:51:13.276 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-09-12T15:51:13.276 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-09-12T15:51:13.276 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-09-12T15:51:13.277 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-09-12T15:51:13.277 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-09-12T15:51:13.277 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-09-12T15:51:13.277 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-09-12T15:51:13.277 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-09-12T15:51:13.278 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-09-12T15:51:13.278 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-09-12T15:51:13.278 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-09-12T15:51:13.278 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-09-12T15:51:13.278 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-09-12T15:51:13.278 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-09-12T15:51:13.279 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-09-12T15:51:13.279 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-09-12T15:51:13.279 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-09-12T15:51:13.279 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-09-12T15:51:13.279 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-09-12T15:51:13.280 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-09-12T15:51:13.280 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-09-12T15:51:13.280 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-09-12T15:51:13.280 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-09-12T15:51:13.280 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-09-12T15:51:13.280 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-09-12T15:51:13.281 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-09-12T15:51:13.281 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-09-12T15:51:13.281 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-09-12T15:51:13.281 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-09-12T15:51:13.281 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-09-12T15:51:13.282 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-09-12T15:51:13.282 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-09-12T15:51:13.282 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-09-12T15:51:13.282 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-09-12T15:51:13.282 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-09-12T15:51:13.283 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-09-12T15:51:13.283 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-09-12T15:51:13.283 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-09-12T15:51:13.283 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-09-12T15:51:13.283 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-09-12T15:51:13.283 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-09-12T15:51:13.284 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-09-12T15:51:13.284 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-09-12T15:51:13.284 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-09-12T15:51:13.284 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-09-12T15:51:13.284 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-09-12T15:51:13.285 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-09-12T15:51:13.285 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-09-12T15:51:13.285 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-09-12T15:51:13.285 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-09-12T15:51:13.285 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-09-12T15:51:13.285 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-09-12T15:51:13.286 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-09-12T15:51:13.286 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-09-12T15:51:13.286 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-09-12T15:51:13.286 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-09-12T15:51:13.286 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-09-12T15:51:13.287 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-09-12T15:51:13.287 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-09-12T15:51:13.287 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-09-12T15:51:13.287 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-09-12T15:51:13.287 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-09-12T15:51:13.287 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-09-12T15:51:13.288 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-09-12T15:51:13.288 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-09-12T15:51:13.288 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-09-12T15:51:13.288 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-09-12T15:51:13.288 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-09-12T15:51:13.289 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-09-12T15:51:13.289 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-09-12T15:51:13.289 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-09-12T15:51:13.289 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-09-12T15:51:13.289 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-09-12T15:51:13.290 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-09-12T15:51:13.290 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-09-12T15:51:13.290 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-09-12T15:51:13.290 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-09-12T15:51:13.290 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-09-12T15:51:13.291 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-09-12T15:51:13.291 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-09-12T15:51:13.291 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-09-12T15:51:13.291 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-09-12T15:51:13.291 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-09-12T15:51:13.292 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-09-12T15:51:13.292 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-09-12T15:51:13.292 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-09-12T15:51:13.292 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-09-12T15:51:13.292 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-09-12T15:51:13.293 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-09-12T15:51:13.293 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-09-12T15:51:13.293 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-09-12T15:51:13.293 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-09-12T15:51:13.293 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-09-12T15:51:13.293 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-09-12T15:51:13.294 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-09-12T15:51:13.294 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-09-12T15:51:13.294 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-09-12T15:51:13.294 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-09-12T15:51:13.294 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-09-12T15:51:13.295 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-09-12T15:51:13.295 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-09-12T15:51:13.295 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-09-12T15:51:13.295 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-09-12T15:51:13.295 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-09-12T15:51:13.296 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-09-12T15:51:13.296 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-09-12T15:51:13.296 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-09-12T15:51:13.296 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-09-12T15:51:13.296 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-09-12T15:51:13.296 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-09-12T15:51:13.297 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-09-12T15:51:13.297 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-09-12T15:51:13.297 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-09-12T15:51:13.297 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-09-12T15:51:13.297 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-09-12T15:51:13.298 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-09-12T15:51:13.298 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-09-12T15:51:13.298 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-09-12T15:51:13.298 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-09-12T15:51:13.298 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-09-12T15:51:13.299 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-09-12T15:51:13.299 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-09-12T15:51:13.299 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-09-12T15:51:13.299 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-09-12T15:51:13.299 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-09-12T15:51:13.299 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-09-12T15:51:13.300 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-09-12T15:51:13.300 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-09-12T15:51:13.300 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-09-12T15:51:13.300 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-09-12T15:51:13.300 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-09-12T15:51:13.301 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-09-12T15:51:13.301 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-09-12T15:51:13.301 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-09-12T15:51:13.301 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-09-12T15:51:13.301 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-09-12T15:51:13.302 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-09-12T15:51:13.302 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-09-12T15:51:13.302 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-09-12T15:51:13.302 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-09-12T15:51:13.302 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-09-12T15:51:13.302 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-09-12T15:51:13.303 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-09-12T15:51:13.303 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-09-12T15:51:13.305 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-09-12T15:51:13.306 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-09-12T15:51:13.306 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-09-12T15:51:13.306 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-09-12T15:51:13.306 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-09-12T15:51:13.306 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-09-12T15:51:13.307 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-09-12T15:51:13.307 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-09-12T15:51:13.307 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-09-12T15:51:13.307 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-09-12T15:51:13.307 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-09-12T15:51:13.307 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-09-12T15:51:13.308 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-09-12T15:51:13.308 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-09-12T15:51:13.308 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-09-12T15:51:13.308 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-09-12T15:51:13.308 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-09-12T15:51:13.309 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-09-12T15:51:13.309 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-09-12T15:51:13.309 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-09-12T15:51:13.309 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-09-12T15:51:13.309 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-09-12T15:51:13.310 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-09-12T15:51:13.310 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-09-12T15:51:13.310 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-09-12T15:51:13.310 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-09-12T15:51:13.310 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-09-12T15:51:13.311 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-09-12T15:51:13.311 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-09-12T15:51:13.311 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-09-12T15:51:13.311 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-09-12T15:51:13.311 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-09-12T15:51:13.312 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-09-12T15:51:13.312 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-09-12T15:51:13.312 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-09-12T15:51:13.312 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-09-12T15:51:13.312 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-09-12T15:51:13.312 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-09-12T15:51:13.313 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-09-12T15:51:13.313 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-09-12T15:51:13.313 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-09-12T15:51:13.313 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-09-12T15:51:13.313 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-09-12T15:51:13.314 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-09-12T15:51:13.314 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-09-12T15:51:13.314 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-09-12T15:51:13.314 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-09-12T15:51:13.314 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-09-12T15:51:13.315 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-09-12T15:51:13.315 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-09-12T15:51:13.315 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-09-12T15:51:13.315 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-09-12T15:51:13.315 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-09-12T15:51:13.316 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-09-12T15:51:13.316 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-09-12T15:51:13.316 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-09-12T15:51:13.316 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-09-12T15:51:13.316 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-09-12T15:51:13.316 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-09-12T15:51:13.317 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-09-12T15:51:13.317 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-09-12T15:51:13.317 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-09-12T15:51:13.317 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-09-12T15:51:13.317 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-09-12T15:51:13.318 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-09-12T15:51:13.318 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-09-12T15:51:13.318 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-09-12T15:51:13.318 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-09-12T15:51:13.318 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-09-12T15:51:13.319 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-09-12T15:51:13.319 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-09-12T15:51:13.319 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-09-12T15:51:13.319 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-09-12T15:51:13.319 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-09-12T15:51:13.320 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-09-12T15:51:13.320 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-09-12T15:51:13.320 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-09-12T15:51:13.320 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-09-12T15:51:13.320 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-09-12T15:51:13.321 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-09-12T15:51:13.321 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-09-12T15:51:13.321 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-09-12T15:51:13.321 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-09-12T15:51:13.321 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-09-12T15:51:13.322 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-09-12T15:51:13.322 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-09-12T15:51:13.322 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-09-12T15:51:13.322 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-09-12T15:51:13.322 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-09-12T15:51:13.322 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-09-12T15:51:13.323 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-09-12T15:51:13.323 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-09-12T15:51:13.323 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-09-12T15:51:13.323 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-09-12T15:51:13.323 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-09-12T15:51:13.324 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-09-12T15:51:13.324 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-09-12T15:51:13.324 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-09-12T15:51:13.324 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-09-12T15:51:13.324 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-09-12T15:51:13.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-09-12T15:51:13.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-09-12T15:51:13.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-09-12T15:51:13.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-09-12T15:51:13.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-09-12T15:51:13.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-09-12T15:51:13.326 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-09-12T15:51:13.326 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-09-12T15:51:13.326 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-09-12T15:51:13.326 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-09-12T15:51:13.326 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-09-12T15:51:13.327 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-09-12T15:51:13.327 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-09-12T15:51:13.327 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-09-12T15:51:13.327 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-09-12T15:51:13.327 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-09-12T15:51:13.328 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-09-12T15:51:13.328 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-09-12T15:51:13.328 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-09-12T15:51:13.328 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-09-12T15:51:13.328 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-09-12T15:51:13.329 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-09-12T15:51:13.329 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-09-12T15:51:13.329 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-09-12T15:51:13.329 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-09-12T15:51:13.329 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-09-12T15:51:13.329 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-09-12T15:51:13.330 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-09-12T15:51:13.330 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-09-12T15:51:13.330 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-09-12T15:51:13.330 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-09-12T15:51:13.330 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-09-12T15:51:13.331 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-09-12T15:51:13.331 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-09-12T15:51:13.331 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-09-12T15:51:13.331 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-09-12T15:51:13.331 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-09-12T15:51:13.332 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-09-12T15:51:13.332 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-09-12T15:51:13.332 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-09-12T15:51:13.332 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-09-12T15:51:13.332 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-09-12T15:51:13.333 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-09-12T15:51:13.333 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-09-12T15:51:13.333 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-09-12T15:51:13.333 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-09-12T15:51:13.333 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-09-12T15:51:13.333 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-09-12T15:51:13.334 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-09-12T15:51:13.334 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-09-12T15:51:13.334 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-09-12T15:51:13.334 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-09-12T15:51:13.334 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-09-12T15:51:13.335 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-09-12T15:51:13.335 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-09-12T15:51:13.335 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-09-12T15:51:13.335 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-09-12T15:51:13.335 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-09-12T15:51:13.336 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-09-12T15:51:13.336 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-09-12T15:51:13.336 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-09-12T15:51:13.336 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-09-12T15:51:13.336 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-09-12T15:51:13.337 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-09-12T15:51:13.337 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-09-12T15:51:13.337 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-09-12T15:51:13.337 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-09-12T15:51:13.337 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-09-12T15:51:13.338 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-09-12T15:51:13.338 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-09-12T15:51:13.338 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-09-12T15:51:13.338 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-09-12T15:51:13.338 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-09-12T15:51:13.339 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-09-12T15:51:13.339 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-09-12T15:51:13.339 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-09-12T15:51:13.339 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-09-12T15:51:13.339 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-09-12T15:51:13.339 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-09-12T15:51:13.340 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-09-12T15:51:13.340 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-09-12T15:51:13.340 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-09-12T15:51:13.340 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-09-12T15:51:13.340 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-09-12T15:51:13.341 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-09-12T15:51:13.341 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-09-12T15:51:13.341 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-09-12T15:51:13.341 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-09-12T15:51:13.341 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-09-12T15:51:13.342 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-09-12T15:51:13.342 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-09-12T15:51:13.342 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-09-12T15:51:13.342 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-09-12T15:51:13.342 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-09-12T15:51:13.343 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-09-12T15:51:13.343 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-09-12T15:51:13.343 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-09-12T15:51:13.343 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-09-12T15:51:13.343 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-09-12T15:51:13.344 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-09-12T15:51:13.344 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-09-12T15:51:13.344 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-09-12T15:51:13.344 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-09-12T15:51:13.344 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-09-12T15:51:13.345 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-09-12T15:51:13.345 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-09-12T15:51:13.345 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-09-12T15:51:13.345 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-09-12T15:51:13.345 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-09-12T15:51:13.346 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-09-12T15:51:13.346 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-09-12T15:51:13.346 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-09-12T15:51:13.346 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-09-12T15:51:13.346 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-09-12T15:51:13.347 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-09-12T15:51:13.347 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-09-12T15:51:13.347 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-09-12T15:51:13.347 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-09-12T15:51:13.347 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-09-12T15:51:13.348 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-09-12T15:51:13.348 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-09-12T15:51:13.348 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-09-12T15:51:13.348 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-09-12T15:51:13.348 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-09-12T15:51:13.349 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-09-12T15:51:13.349 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-09-12T15:51:13.349 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-09-12T15:51:13.349 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-09-12T15:51:13.349 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-09-12T15:51:13.350 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-09-12T15:51:13.350 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-09-12T15:51:13.350 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-09-12T15:51:13.350 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-09-12T15:51:13.351 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-09-12T15:51:13.351 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-09-12T15:51:13.351 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-09-12T15:51:13.351 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-09-12T15:51:13.351 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-09-12T15:51:13.351 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-09-12T15:51:13.352 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-09-12T15:51:13.352 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-09-12T15:51:13.352 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-09-12T15:51:13.352 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-09-12T15:51:13.352 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-09-12T15:51:13.353 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-09-12T15:51:13.353 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-09-12T15:51:13.353 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-09-12T15:51:13.353 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-09-12T15:51:13.353 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-09-12T15:51:13.354 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-09-12T15:51:13.354 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-09-12T15:51:13.354 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-09-12T15:51:13.354 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-09-12T15:51:13.354 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-09-12T15:51:13.355 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-09-12T15:51:13.355 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-09-12T15:51:13.355 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-09-12T15:51:13.355 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-09-12T15:51:13.355 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-09-12T15:51:13.356 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-09-12T15:51:13.356 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-09-12T15:51:13.356 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-09-12T15:51:13.356 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-09-12T15:51:13.356 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-09-12T15:51:13.356 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-09-12T15:51:13.357 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-09-12T15:51:13.357 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-09-12T15:51:13.357 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-09-12T15:51:13.357 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-09-12T15:51:13.357 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-09-12T15:51:13.358 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-09-12T15:51:13.358 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-09-12T15:51:13.358 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-09-12T15:51:13.358 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-09-12T15:51:13.358 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-09-12T15:51:13.359 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-09-12T15:51:13.359 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-09-12T15:51:13.359 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-09-12T15:51:13.359 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-09-12T15:51:13.359 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-09-12T15:51:13.360 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-09-12T15:51:13.360 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-09-12T15:51:13.360 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-09-12T15:51:13.360 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-09-12T15:51:13.360 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-09-12T15:51:13.361 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-09-12T15:51:13.361 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-09-12T15:51:13.361 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-09-12T15:51:13.361 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-09-12T15:51:13.361 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-09-12T15:51:13.362 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-09-12T15:51:13.362 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-09-12T15:51:13.362 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-09-12T15:51:13.362 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-09-12T15:51:13.362 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-09-12T15:51:13.362 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-09-12T15:51:13.363 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-09-12T15:51:13.363 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-09-12T15:51:13.363 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-09-12T15:51:13.363 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-09-12T15:51:13.363 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-09-12T15:51:13.364 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-09-12T15:51:13.364 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-09-12T15:51:13.364 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-09-12T15:51:13.364 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-09-12T15:51:13.364 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-09-12T15:51:13.365 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-09-12T15:51:13.365 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-09-12T15:51:13.365 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-09-12T15:51:13.365 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-09-12T15:51:13.365 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-09-12T15:51:13.366 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-09-12T15:51:13.366 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-09-12T15:51:13.366 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-09-12T15:51:13.366 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-09-12T15:51:13.366 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-09-12T15:51:13.366 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-09-12T15:51:13.367 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-09-12T15:51:13.367 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-09-12T15:51:13.367 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-09-12T15:51:13.367 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-09-12T15:51:13.367 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-09-12T15:51:13.368 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-09-12T15:51:13.368 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-09-12T15:51:13.368 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-09-12T15:51:13.368 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-09-12T15:51:13.368 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-09-12T15:51:13.369 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-09-12T15:51:13.369 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-09-12T15:51:13.369 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-09-12T15:51:13.369 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-09-12T15:51:13.369 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-09-12T15:51:13.370 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-09-12T15:51:13.370 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-09-12T15:51:13.370 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-09-12T15:51:13.370 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-09-12T15:51:13.370 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-09-12T15:51:13.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-09-12T15:51:13.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-09-12T15:51:13.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-09-12T15:51:13.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-09-12T15:51:13.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-09-12T15:51:13.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-09-12T15:51:13.372 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-09-12T15:51:13.372 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-09-12T15:51:13.372 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-09-12T15:51:13.372 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-09-12T15:51:13.372 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-09-12T15:51:13.373 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-09-12T15:51:13.373 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-09-12T15:51:13.373 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-09-12T15:51:13.373 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-09-12T15:51:13.373 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-09-12T15:51:13.374 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-09-12T15:51:13.374 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-09-12T15:51:13.374 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-09-12T15:51:13.374 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-09-12T15:51:13.374 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-09-12T15:51:13.375 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-09-12T15:51:13.375 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-09-12T15:51:13.375 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-09-12T15:51:13.375 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-09-12T15:51:13.375 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-09-12T15:51:13.375 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-09-12T15:51:13.376 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-09-12T15:51:13.376 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-09-12T15:51:13.376 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-09-12T15:51:13.376 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-09-12T15:51:13.376 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-09-12T15:51:13.377 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-09-12T15:51:13.377 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-09-12T15:51:13.377 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-09-12T15:51:13.377 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-09-12T15:51:13.377 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-09-12T15:51:13.378 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-09-12T15:51:13.378 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-09-12T15:51:13.378 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-09-12T15:51:13.378 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-09-12T15:51:13.378 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-09-12T15:51:13.379 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-09-12T15:51:13.379 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-09-12T15:51:13.379 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-09-12T15:51:13.379 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-09-12T15:51:13.379 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-09-12T15:51:13.379 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-09-12T15:51:13.380 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-09-12T15:51:13.380 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-09-12T15:51:13.380 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-09-12T15:51:13.380 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-09-12T15:51:13.380 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-09-12T15:51:13.381 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-09-12T15:51:13.381 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-09-12T15:51:13.381 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-09-12T15:51:13.381 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-09-12T15:51:13.381 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-09-12T15:51:13.382 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-09-12T15:51:13.382 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-09-12T15:51:13.382 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-09-12T15:51:13.382 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-09-12T15:51:13.382 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-09-12T15:51:13.383 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-09-12T15:51:13.383 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-09-12T15:51:13.383 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-09-12T15:51:13.383 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-09-12T15:51:13.383 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-09-12T15:51:13.384 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-09-12T15:51:13.384 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-09-12T15:51:13.384 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-09-12T15:51:13.384 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-09-12T15:51:13.384 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-09-12T15:51:13.384 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-09-12T15:51:13.385 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-09-12T15:51:13.385 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-09-12T15:51:13.385 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-09-12T15:51:13.385 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-09-12T15:51:13.385 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-09-12T15:51:13.386 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-09-12T15:51:13.386 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-09-12T15:51:13.386 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-09-12T15:51:13.386 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-09-12T15:51:13.386 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-09-12T15:51:13.387 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-09-12T15:51:13.387 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-09-12T15:51:13.387 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-09-12T15:51:13.387 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-09-12T15:51:13.387 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-09-12T15:51:13.388 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-09-12T15:51:13.388 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-09-12T15:51:13.388 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-09-12T15:51:13.388 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-09-12T15:51:13.388 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-09-12T15:51:13.389 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-09-12T15:51:13.389 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-09-12T15:51:13.389 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-09-12T15:51:13.389 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-09-12T15:51:13.389 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-09-12T15:51:13.390 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-09-12T15:51:13.390 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-09-12T15:51:13.390 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-09-12T15:51:13.390 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-09-12T15:51:13.390 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-09-12T15:51:13.390 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-09-12T15:51:13.391 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-09-12T15:51:13.391 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-09-12T15:51:13.391 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-09-12T15:51:13.391 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-09-12T15:51:13.391 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-09-12T15:51:13.392 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-09-12T15:51:13.392 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-09-12T15:51:13.392 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-09-12T15:51:13.392 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-09-12T15:51:13.392 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-09-12T15:51:13.393 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-09-12T15:51:13.393 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-09-12T15:51:13.393 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-09-12T15:51:13.393 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-09-12T15:51:13.393 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-09-12T15:51:13.394 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-09-12T15:51:13.394 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-09-12T15:51:13.394 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-09-12T15:51:13.394 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-09-12T15:51:13.394 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-09-12T15:51:13.395 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-09-12T15:51:13.395 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-09-12T15:51:13.395 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-09-12T15:51:13.395 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-09-12T15:51:13.395 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-09-12T15:51:13.396 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-09-12T15:51:13.396 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-09-12T15:51:13.396 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-09-12T15:51:13.396 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-09-12T15:51:13.396 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-09-12T15:51:13.396 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-09-12T15:51:13.397 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-09-12T15:51:13.397 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-09-12T15:51:13.397 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-09-12T15:51:13.397 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-09-12T15:51:13.397 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-09-12T15:51:13.398 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-09-12T15:51:13.398 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-09-12T15:51:13.398 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-09-12T15:51:13.398 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-09-12T15:51:13.398 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-09-12T15:51:13.399 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-09-12T15:51:13.399 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-09-12T15:51:13.399 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-09-12T15:51:13.399 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-09-12T15:51:13.399 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-09-12T15:51:13.400 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-09-12T15:51:13.400 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-09-12T15:51:13.400 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-09-12T15:51:13.400 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-09-12T15:51:13.400 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-09-12T15:51:13.400 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-09-12T15:51:13.401 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-09-12T15:51:13.401 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-09-12T15:51:13.401 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-09-12T15:51:13.401 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-09-12T15:51:13.401 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-09-12T15:51:13.402 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-09-12T15:51:13.402 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-09-12T15:51:13.402 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-09-12T15:51:13.402 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-09-12T15:51:13.402 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-09-12T15:51:13.403 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-09-12T15:51:13.403 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-09-12T15:51:13.403 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-09-12T15:51:13.403 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-09-12T15:51:13.403 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-09-12T15:51:13.404 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-09-12T15:51:13.404 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-09-12T15:51:13.404 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-09-12T15:51:13.404 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-09-12T15:51:13.404 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-09-12T15:51:13.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-09-12T15:51:13.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-09-12T15:51:13.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-09-12T15:51:13.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-09-12T15:51:13.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-09-12T15:51:13.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-09-12T15:51:13.406 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-09-12T15:51:13.406 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-09-12T15:51:13.406 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-09-12T15:51:13.406 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-09-12T15:51:13.406 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-09-12T15:51:13.407 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-09-12T15:51:13.407 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-09-12T15:51:13.407 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-09-12T15:51:13.407 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-09-12T15:51:13.407 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-09-12T15:51:13.408 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-09-12T15:51:13.408 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-09-12T15:51:13.408 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-09-12T15:51:13.408 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-09-12T15:51:13.408 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-09-12T15:51:13.409 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-09-12T15:51:13.409 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-09-12T15:51:13.409 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-09-12T15:51:13.409 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-09-12T15:51:13.409 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-09-12T15:51:13.409 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-09-12T15:51:13.410 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-09-12T15:51:13.410 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-09-12T15:51:13.410 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-09-12T15:51:13.410 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-09-12T15:51:13.410 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-09-12T15:51:13.411 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-09-12T15:51:13.411 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-09-12T15:51:13.411 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-09-12T15:51:13.411 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-09-12T15:51:13.412 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-09-12T15:51:13.412 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-09-12T15:51:13.412 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-09-12T15:51:13.412 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-09-12T15:51:13.412 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-09-12T15:51:13.412 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-09-12T15:51:13.413 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-09-12T15:51:13.413 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-09-12T15:51:13.413 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-09-12T15:51:13.413 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-09-12T15:51:13.413 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-09-12T15:51:13.414 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-09-12T15:51:13.414 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-09-12T15:51:13.414 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-09-12T15:51:13.414 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-09-12T15:51:13.414 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-09-12T15:51:13.415 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-09-12T15:51:13.415 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-09-12T15:51:13.415 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-09-12T15:51:13.415 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-09-12T15:51:13.415 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-09-12T15:51:13.416 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-09-12T15:51:13.416 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-09-12T15:51:13.416 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-09-12T15:51:13.416 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-09-12T15:51:13.416 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-09-12T15:51:13.416 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-09-12T15:51:13.417 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-09-12T15:51:13.417 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-09-12T15:51:13.417 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-09-12T15:51:13.417 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-09-12T15:51:13.417 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-09-12T15:51:13.418 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-09-12T15:51:13.418 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-09-12T15:51:13.418 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-09-12T15:51:13.418 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-09-12T15:51:13.418 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-09-12T15:51:13.419 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-09-12T15:51:13.419 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-09-12T15:51:13.419 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-09-12T15:51:13.419 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-09-12T15:51:13.419 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-09-12T15:51:13.420 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-09-12T15:51:13.420 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-09-12T15:51:13.420 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-09-12T15:51:13.420 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-09-12T15:51:13.420 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-09-12T15:51:13.421 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-09-12T15:51:13.421 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-09-12T15:51:13.421 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-09-12T15:51:13.421 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-09-12T15:51:13.421 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-09-12T15:51:13.421 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-09-12T15:51:13.422 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-09-12T15:51:13.422 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-09-12T15:51:13.422 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-09-12T15:51:13.422 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-09-12T15:51:13.422 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-09-12T15:51:13.423 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-09-12T15:51:13.423 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-09-12T15:51:13.423 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-09-12T15:51:13.423 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-09-12T15:51:13.423 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-09-12T15:51:13.424 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-09-12T15:51:13.424 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-09-12T15:51:13.424 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-09-12T15:51:13.424 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-09-12T15:51:13.424 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-09-12T15:51:13.425 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-09-12T15:51:13.425 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-09-12T15:51:13.425 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-09-12T15:51:13.425 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-09-12T15:51:13.425 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-09-12T15:51:13.425 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-09-12T15:51:13.426 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-09-12T15:51:13.426 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-09-12T15:51:13.426 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-09-12T15:51:13.426 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-09-12T15:51:13.426 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-09-12T15:51:13.427 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-09-12T15:51:13.427 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-09-12T15:51:13.427 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-09-12T15:51:13.427 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-09-12T15:51:13.427 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-09-12T15:51:13.428 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-09-12T15:51:13.428 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-09-12T15:51:13.428 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-09-12T15:51:13.428 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-09-12T15:51:13.428 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-09-12T15:51:13.428 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-09-12T15:51:13.429 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-09-12T15:51:13.429 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-09-12T15:51:13.429 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-09-12T15:51:13.429 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-09-12T15:51:13.429 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-09-12T15:51:13.430 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-09-12T15:51:13.430 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-09-12T15:51:13.430 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-09-12T15:51:13.430 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-09-12T15:51:13.430 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-09-12T15:51:13.431 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-09-12T15:51:13.431 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-09-12T15:51:13.431 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-09-12T15:51:13.431 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-09-12T15:51:13.431 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-09-12T15:51:13.432 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-09-12T15:51:13.432 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-09-12T15:51:13.432 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-09-12T15:51:13.432 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-09-12T15:51:13.432 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-09-12T15:51:13.433 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-09-12T15:51:13.433 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-09-12T15:51:13.433 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-09-12T15:51:13.433 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-09-12T15:51:13.433 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-09-12T15:51:13.433 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-09-12T15:51:13.434 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-09-12T15:51:13.434 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-09-12T15:51:13.434 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-09-12T15:51:13.434 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-09-12T15:51:13.434 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-09-12T15:51:13.435 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-09-12T15:51:13.435 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-09-12T15:51:13.435 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-09-12T15:51:13.435 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-09-12T15:51:13.435 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-09-12T15:51:13.436 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-09-12T15:51:13.436 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-09-12T15:51:13.436 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-09-12T15:51:13.436 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-09-12T15:51:13.436 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-09-12T15:51:13.437 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-09-12T15:51:13.437 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-09-12T15:51:13.437 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-09-12T15:51:13.437 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-09-12T15:51:13.437 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-09-12T15:51:13.438 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-09-12T15:51:13.438 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-09-12T15:51:13.438 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-09-12T15:51:13.438 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-09-12T15:51:13.438 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-09-12T15:51:13.438 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-09-12T15:51:13.439 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-09-12T15:51:13.439 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-09-12T15:51:13.439 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-09-12T15:51:13.439 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-09-12T15:51:13.439 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-09-12T15:51:13.440 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-09-12T15:51:13.440 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-09-12T15:51:13.440 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-09-12T15:51:13.440 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-09-12T15:51:13.440 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-09-12T15:51:13.441 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-09-12T15:51:13.441 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-09-12T15:51:13.441 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-09-12T15:51:13.441 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-09-12T15:51:13.441 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-09-12T15:51:13.442 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-09-12T15:51:13.442 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-09-12T15:51:13.442 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-09-12T15:51:13.442 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-09-12T15:51:13.442 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-09-12T15:51:13.443 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-09-12T15:51:13.443 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-09-12T15:51:13.443 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-09-12T15:51:13.443 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-09-12T15:51:13.443 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-09-12T15:51:13.443 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-09-12T15:51:13.444 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-09-12T15:51:13.444 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-09-12T15:51:13.444 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-09-12T15:51:13.444 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-09-12T15:51:13.444 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-09-12T15:51:13.445 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-09-12T15:51:13.445 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-09-12T15:51:13.445 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-09-12T15:51:13.445 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-09-12T15:51:13.445 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-09-12T15:51:13.446 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-09-12T15:51:13.446 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-09-12T15:51:13.446 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-09-12T15:51:13.446 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-09-12T15:51:13.446 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-09-12T15:51:13.446 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-09-12T15:51:13.447 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-09-12T15:51:13.447 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-09-12T15:51:13.447 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-09-12T15:51:13.447 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-09-12T15:51:13.447 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-09-12T15:51:13.448 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-09-12T15:51:13.448 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-09-12T15:51:13.448 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-09-12T15:51:13.448 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-09-12T15:51:13.448 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-09-12T15:51:13.448 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-09-12T15:51:13.449 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-09-12T15:51:13.449 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-09-12T15:51:13.449 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-09-12T15:51:13.449 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-09-12T15:51:13.450 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-09-12T15:51:13.450 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-09-12T15:51:13.450 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-09-12T15:51:13.450 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-09-12T15:51:13.450 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-09-12T15:51:13.450 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-09-12T15:51:13.451 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-09-12T15:51:13.451 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-09-12T15:51:13.451 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-09-12T15:51:13.451 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-09-12T15:51:13.451 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-09-12T15:51:13.452 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-09-12T15:51:13.452 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-09-12T15:51:13.452 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-09-12T15:51:13.452 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-09-12T15:51:13.452 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-09-12T15:51:13.453 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-09-12T15:51:13.453 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-09-12T15:51:13.453 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-09-12T15:51:13.453 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-09-12T15:51:13.453 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-09-12T15:51:13.454 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-09-12T15:51:13.454 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-09-12T15:51:13.454 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-09-12T15:51:13.454 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-09-12T15:51:13.454 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-09-12T15:51:13.455 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-09-12T15:51:13.455 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-09-12T15:51:13.455 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-09-12T15:51:13.455 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-09-12T15:51:13.455 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-09-12T15:51:13.456 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-09-12T15:51:13.456 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-09-12T15:51:13.456 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-09-12T15:51:13.456 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-09-12T15:51:13.456 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-09-12T15:51:13.457 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-09-12T15:51:13.457 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-09-12T15:51:13.457 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-09-12T15:51:13.457 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-09-12T15:51:13.457 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-09-12T15:51:13.458 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-09-12T15:51:13.458 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-09-12T15:51:13.458 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-09-12T15:51:13.458 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-09-12T15:51:13.458 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-09-12T15:51:13.459 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-09-12T15:51:13.459 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-09-12T15:51:13.459 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-09-12T15:51:13.459 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-09-12T15:51:13.459 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-09-12T15:51:13.459 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-09-12T15:51:13.460 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-09-12T15:51:13.460 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-09-12T15:51:13.460 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-09-12T15:51:13.460 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-09-12T15:51:13.460 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-09-12T15:51:13.461 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-09-12T15:51:13.461 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-09-12T15:51:13.461 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-09-12T15:51:13.461 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-09-12T15:51:13.461 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-09-12T15:51:13.462 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-09-12T15:51:13.462 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-09-12T15:51:13.462 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-09-12T15:51:13.462 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-09-12T15:51:13.462 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-09-12T15:51:13.463 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-09-12T15:51:13.463 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-09-12T15:51:13.463 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-09-12T15:51:13.463 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-09-12T15:51:13.463 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-09-12T15:51:13.463 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-09-12T15:51:13.464 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-09-12T15:51:13.464 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-09-12T15:51:13.464 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-09-12T15:51:13.464 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-09-12T15:51:13.464 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-09-12T15:51:13.465 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-09-12T15:51:13.465 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-09-12T15:51:13.465 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-09-12T15:51:13.465 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-09-12T15:51:13.465 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-09-12T15:51:13.465 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-09-12T15:51:13.466 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-09-12T15:51:13.466 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-09-12T15:51:13.466 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-09-12T15:51:13.466 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-09-12T15:51:13.466 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-09-12T15:51:13.467 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-09-12T15:51:13.467 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-09-12T15:51:13.467 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-09-12T15:51:13.467 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-09-12T15:51:13.467 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-09-12T15:51:13.468 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-09-12T15:51:13.468 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-09-12T15:51:13.468 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-09-12T15:51:13.468 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-09-12T15:51:13.468 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-09-12T15:51:13.468 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-09-12T15:51:13.469 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-09-12T15:51:13.469 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-09-12T15:51:13.469 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-09-12T15:51:13.469 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-09-12T15:51:13.469 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-09-12T15:51:13.470 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-09-12T15:51:13.470 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-09-12T15:51:13.470 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-09-12T15:51:13.470 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-09-12T15:51:13.470 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-09-12T15:51:13.471 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-09-12T15:51:13.471 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-09-12T15:51:13.471 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-09-12T15:51:13.471 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-09-12T15:51:13.471 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-09-12T15:51:13.472 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-09-12T15:51:13.472 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-09-12T15:51:13.472 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-09-12T15:51:13.472 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-09-12T15:51:13.472 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-09-12T15:51:13.472 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-09-12T15:51:13.473 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-09-12T15:51:13.473 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-09-12T15:51:13.473 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-09-12T15:51:13.473 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-09-12T15:51:13.473 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-09-12T15:51:13.474 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-09-12T15:51:13.474 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-09-12T15:51:13.474 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-09-12T15:51:13.474 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-09-12T15:51:13.474 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-09-12T15:51:13.475 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-09-12T15:51:13.475 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-09-12T15:51:13.475 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-09-12T15:51:13.475 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-09-12T15:51:13.475 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-09-12T15:51:13.475 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-09-12T15:51:13.476 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-09-12T15:51:13.476 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-09-12T15:51:13.476 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-09-12T15:51:13.476 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-09-12T15:51:13.476 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-09-12T15:51:13.477 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-09-12T15:51:13.477 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-09-12T15:51:13.477 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-09-12T15:51:13.477 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-09-12T15:51:13.477 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-09-12T15:51:13.478 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-09-12T15:51:13.478 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-09-12T15:51:13.478 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-09-12T15:51:13.478 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-09-12T15:51:13.478 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-09-12T15:51:13.478 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-09-12T15:51:13.479 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-09-12T15:51:13.479 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-09-12T15:51:13.479 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-09-12T15:51:13.479 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-09-12T15:51:13.479 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-09-12T15:51:13.480 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-09-12T15:51:13.480 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-09-12T15:51:13.480 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-09-12T15:51:13.480 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-09-12T15:51:13.480 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-09-12T15:51:13.481 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-09-12T15:51:13.481 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-09-12T15:51:13.481 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-09-12T15:51:13.481 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-09-12T15:51:13.481 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-09-12T15:51:13.482 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-09-12T15:51:13.482 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-09-12T15:51:13.482 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-09-12T15:51:13.482 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-09-12T15:51:13.482 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-09-12T15:51:13.483 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-09-12T15:51:13.483 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-09-12T15:51:13.483 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-09-12T15:51:13.483 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-09-12T15:51:13.483 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-09-12T15:51:13.483 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-09-12T15:51:13.484 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-09-12T15:51:13.484 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-09-12T15:51:13.484 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-09-12T15:51:13.484 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-09-12T15:51:13.484 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-09-12T15:51:13.485 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-09-12T15:51:13.485 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-09-12T15:51:13.485 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-09-12T15:51:13.485 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-09-12T15:51:13.485 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-09-12T15:51:13.486 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-09-12T15:51:13.486 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-09-12T15:51:13.486 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-09-12T15:51:13.486 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-09-12T15:51:13.486 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-09-12T15:51:13.487 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-09-12T15:51:13.487 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-09-12T15:51:13.487 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-09-12T15:51:13.487 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-09-12T15:51:13.487 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-09-12T15:51:13.487 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-09-12T15:51:13.488 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-09-12T15:51:13.488 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-09-12T15:51:13.488 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-09-12T15:51:13.488 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-09-12T15:51:13.488 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-09-12T15:51:13.489 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-09-12T15:51:13.489 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-09-12T15:51:13.489 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-09-12T15:51:13.489 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-09-12T15:51:13.489 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-09-12T15:51:13.490 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-09-12T15:51:13.490 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-09-12T15:51:13.490 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-09-12T15:51:13.490 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-09-12T15:51:13.490 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-09-12T15:51:13.490 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-09-12T15:51:13.491 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-09-12T15:51:13.491 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-09-12T15:51:13.491 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-09-12T15:51:13.491 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-09-12T15:51:13.491 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-09-12T15:51:13.492 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-09-12T15:51:13.492 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-09-12T15:51:13.492 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-09-12T15:51:13.492 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-09-12T15:51:13.492 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-09-12T15:51:13.493 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-09-12T15:51:13.493 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-09-12T15:51:13.493 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-09-12T15:51:13.493 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-09-12T15:51:13.493 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-09-12T15:51:13.493 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-09-12T15:51:13.494 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-09-12T15:51:13.494 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-09-12T15:51:13.494 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-09-12T15:51:13.494 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-09-12T15:51:13.494 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-09-12T15:51:13.495 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-09-12T15:51:13.495 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-09-12T15:51:13.495 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-09-12T15:51:13.495 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-09-12T15:51:13.495 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-09-12T15:51:13.496 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-09-12T15:51:13.496 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-09-12T15:51:13.496 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-09-12T15:51:13.496 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-09-12T15:51:13.496 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-09-12T15:51:13.496 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-09-12T15:51:13.497 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-09-12T15:51:13.497 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-09-12T15:51:13.497 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-09-12T15:51:13.497 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-09-12T15:51:13.497 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-09-12T15:51:13.498 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-09-12T15:51:13.498 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-09-12T15:51:13.498 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-09-12T15:51:13.498 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-09-12T15:51:13.498 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-09-12T15:51:13.498 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-09-12T15:51:13.499 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-09-12T15:51:13.499 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-09-12T15:51:13.499 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-09-12T15:51:13.499 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-09-12T15:51:13.499 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-09-12T15:51:13.500 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-09-12T15:51:13.500 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-09-12T15:51:13.500 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-09-12T15:51:13.500 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-09-12T15:51:13.500 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-09-12T15:51:13.501 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-09-12T15:51:13.501 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-09-12T15:51:13.501 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-09-12T15:51:13.501 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-09-12T15:51:13.501 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-09-12T15:51:13.502 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-09-12T15:51:13.502 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-09-12T15:51:13.502 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-09-12T15:51:13.502 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-09-12T15:51:13.502 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-09-12T15:51:13.502 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-09-12T15:51:13.503 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-09-12T15:51:13.503 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-09-12T15:51:13.503 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-09-12T15:51:13.503 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-09-12T15:51:13.503 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-09-12T15:51:13.504 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-09-12T15:51:13.504 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-09-12T15:51:13.504 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-09-12T15:51:13.504 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-09-12T15:51:13.504 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-09-12T15:51:13.504 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-09-12T15:51:13.505 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-09-12T15:51:13.505 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-09-12T15:51:13.505 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-09-12T15:51:13.505 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-09-12T15:51:13.505 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-09-12T15:51:13.506 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-09-12T15:51:13.506 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-09-12T15:51:13.506 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-09-12T15:51:13.506 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-09-12T15:51:13.506 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-09-12T15:51:13.507 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-09-12T15:51:13.507 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-09-12T15:51:13.507 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-09-12T15:51:13.507 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-09-12T15:51:13.507 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-09-12T15:51:13.508 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-09-12T15:51:13.508 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-09-12T15:51:13.508 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-09-12T15:51:13.508 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-09-12T15:51:13.508 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-09-12T15:51:13.509 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-09-12T15:51:13.509 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-09-12T15:51:13.509 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-09-12T15:51:13.509 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-09-12T15:51:13.509 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-09-12T15:51:13.510 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-09-12T15:51:13.510 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-09-12T15:51:13.510 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-09-12T15:51:13.510 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-09-12T15:51:13.510 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-09-12T15:51:13.511 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-09-12T15:51:13.511 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-09-12T15:51:13.511 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-09-12T15:51:13.511 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-09-12T15:51:13.511 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-09-12T15:51:13.512 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-09-12T15:51:13.512 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-09-12T15:51:13.512 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-09-12T15:51:13.512 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-09-12T15:51:13.512 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-09-12T15:51:13.512 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-09-12T15:51:13.513 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-09-12T15:51:13.513 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-09-12T15:51:13.513 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-09-12T15:51:13.513 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-09-12T15:51:13.513 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-09-12T15:51:13.514 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-09-12T15:51:13.514 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-09-12T15:51:13.514 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-09-12T15:51:13.514 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-09-12T15:51:13.514 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-09-12T15:51:13.515 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-09-12T15:51:13.515 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-09-12T15:51:13.515 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-09-12T15:51:13.515 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-09-12T15:51:13.515 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-09-12T15:51:13.516 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-09-12T15:51:13.516 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-09-12T15:51:13.516 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-09-12T15:51:13.516 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-09-12T15:51:13.516 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-09-12T15:51:13.516 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-09-12T15:51:13.517 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-09-12T15:51:13.517 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-09-12T15:51:13.517 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-09-12T15:51:13.517 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-09-12T15:51:13.517 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-09-12T15:51:13.518 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-09-12T15:51:13.518 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-09-12T15:51:13.518 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-09-12T15:51:13.518 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-09-12T15:51:13.518 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-09-12T15:51:13.519 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-09-12T15:51:13.519 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-09-12T15:51:13.519 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-09-12T15:51:13.519 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-09-12T15:51:13.519 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-09-12T15:51:13.520 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-09-12T15:51:13.520 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-09-12T15:51:13.520 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-09-12T15:51:13.520 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-09-12T15:51:13.520 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-09-12T15:51:13.521 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-09-12T15:51:13.521 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-09-12T15:51:13.521 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-09-12T15:51:13.521 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-09-12T15:51:13.521 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-09-12T15:51:13.521 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-09-12T15:51:13.522 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-09-12T15:51:13.522 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-09-12T15:51:13.522 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-09-12T15:51:13.522 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-09-12T15:51:13.522 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-09-12T15:51:13.523 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-09-12T15:51:13.523 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-09-12T15:51:13.523 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-09-12T15:51:13.523 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-09-12T15:51:13.523 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-09-12T15:51:13.524 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-09-12T15:51:13.524 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-09-12T15:51:13.524 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-09-12T15:51:13.524 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-09-12T15:51:13.524 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-09-12T15:51:13.525 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-09-12T15:51:13.525 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-09-12T15:51:13.525 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-09-12T15:51:13.525 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-09-12T15:51:13.525 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-09-12T15:51:13.525 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-09-12T15:51:13.526 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-09-12T15:51:13.526 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-09-12T15:51:13.526 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-09-12T15:51:13.526 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-09-12T15:51:13.526 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-09-12T15:51:13.527 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-09-12T15:51:13.527 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-09-12T15:51:13.527 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-09-12T15:51:13.527 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-09-12T15:51:13.527 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-09-12T15:51:13.528 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-09-12T15:51:13.528 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-09-12T15:51:13.528 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-09-12T15:51:13.528 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-09-12T15:51:13.528 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-09-12T15:51:13.529 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-09-12T15:51:13.529 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-09-12T15:51:13.529 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-09-12T15:51:13.529 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-09-12T15:51:13.529 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-09-12T15:51:13.530 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-09-12T15:51:13.530 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-09-12T15:51:13.530 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-09-12T15:51:13.530 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-09-12T15:51:13.530 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-09-12T15:51:13.531 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-09-12T15:51:13.531 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-09-12T15:51:13.531 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-09-12T15:51:13.531 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-09-12T15:51:13.531 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-09-12T15:51:13.531 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-09-12T15:51:13.532 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-09-12T15:51:13.532 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-09-12T15:51:13.532 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-09-12T15:51:13.532 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-09-12T15:51:13.532 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-09-12T15:51:13.533 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-09-12T15:51:13.533 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-09-12T15:51:13.533 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-09-12T15:51:13.533 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-09-12T15:51:13.533 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-09-12T15:51:13.534 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-09-12T15:51:13.534 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-09-12T15:51:13.534 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-09-12T15:51:13.534 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-09-12T15:51:13.534 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-09-12T15:51:13.534 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-09-12T15:51:13.535 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-09-12T15:51:13.535 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-09-12T15:51:13.535 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-09-12T15:51:13.535 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-09-12T15:51:13.535 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-09-12T15:51:13.536 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-09-12T15:51:13.536 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-09-12T15:51:13.536 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-09-12T15:51:13.536 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-09-12T15:51:13.536 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-09-12T15:51:13.537 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-09-12T15:51:13.537 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-09-12T15:51:13.537 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-09-12T15:51:13.537 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-09-12T15:51:13.537 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-09-12T15:51:13.538 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-09-12T15:51:13.538 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-09-12T15:51:13.538 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-09-12T15:51:13.538 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-09-12T15:51:13.538 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-09-12T15:51:13.539 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-09-12T15:51:13.539 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-09-12T15:51:13.539 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-09-12T15:51:13.539 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-09-12T15:51:13.539 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-09-12T15:51:13.540 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-09-12T15:51:13.540 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-09-12T15:51:13.540 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-09-12T15:51:13.540 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-09-12T15:51:13.540 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-09-12T15:51:13.541 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-09-12T15:51:13.541 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-09-12T15:51:13.541 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-09-12T15:51:13.541 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-09-12T15:51:13.541 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-09-12T15:51:13.541 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-09-12T15:51:13.542 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-09-12T15:51:13.542 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-09-12T15:51:13.542 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-09-12T15:51:13.542 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-09-12T15:51:13.542 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-09-12T15:51:13.543 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-09-12T15:51:13.543 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-09-12T15:51:13.543 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-09-12T15:51:13.543 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-09-12T15:51:13.543 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-09-12T15:51:13.544 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-09-12T15:51:13.544 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-09-12T15:51:13.544 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-09-12T15:51:13.544 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-09-12T15:51:13.544 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-09-12T15:51:13.545 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-09-12T15:51:13.545 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-09-12T15:51:13.545 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-09-12T15:51:13.545 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-09-12T15:51:13.545 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-09-12T15:51:13.546 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-09-12T15:51:13.546 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-09-12T15:51:13.546 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-09-12T15:51:13.546 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-09-12T15:51:13.546 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-09-12T15:51:13.546 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-09-12T15:51:13.547 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-09-12T15:51:13.547 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-09-12T15:51:13.547 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-09-12T15:51:13.547 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-09-12T15:51:13.547 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-09-12T15:51:13.548 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-09-12T15:51:13.548 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-09-12T15:51:13.548 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-09-12T15:51:13.548 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-09-12T15:51:13.548 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-09-12T15:51:13.549 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-09-12T15:51:13.549 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-09-12T15:51:13.549 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-09-12T15:51:13.549 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-09-12T15:51:13.549 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-09-12T15:51:13.550 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-09-12T15:51:13.550 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-09-12T15:51:13.550 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-09-12T15:51:13.550 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-09-12T15:51:13.550 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-09-12T15:51:13.551 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-09-12T15:51:13.551 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-09-12T15:51:13.551 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-09-12T15:51:13.551 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-09-12T15:51:13.551 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-09-12T15:51:13.552 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-09-12T15:51:13.552 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-09-12T15:51:13.552 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-09-12T15:51:13.552 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-09-12T15:51:13.552 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-09-12T15:51:13.553 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-09-12T15:51:13.553 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-09-12T15:51:13.553 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-09-12T15:51:13.553 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-09-12T15:51:13.553 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-09-12T15:51:13.554 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-09-12T15:51:13.554 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-09-12T15:51:13.554 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-09-12T15:51:13.554 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-09-12T15:51:13.554 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-09-12T15:51:13.555 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-09-12T15:51:13.555 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-09-12T15:51:13.555 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-09-12T15:51:13.555 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-09-12T15:51:13.555 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-09-12T15:51:13.555 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-09-12T15:51:13.556 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-09-12T15:51:13.556 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-09-12T15:51:13.556 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-09-12T15:51:13.556 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-09-12T15:51:13.556 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-09-12T15:51:13.557 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-09-12T15:51:13.557 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-09-12T15:51:13.557 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-09-12T15:51:13.557 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-09-12T15:51:13.557 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-09-12T15:51:13.557 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-09-12T15:51:13.558 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-09-12T15:51:13.558 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-09-12T15:51:13.558 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-09-12T15:51:13.558 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-09-12T15:51:13.558 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-09-12T15:51:13.559 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-09-12T15:51:13.559 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-09-12T15:51:13.559 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-09-12T15:51:13.559 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-09-12T15:51:13.559 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-09-12T15:51:13.560 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-09-12T15:51:13.560 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-09-12T15:51:13.560 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-09-12T15:51:13.560 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-09-12T15:51:13.560 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-09-12T15:51:13.561 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-09-12T15:51:13.561 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-09-12T15:51:13.561 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-09-12T15:51:13.561 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-09-12T15:51:13.561 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-09-12T15:51:13.562 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-09-12T15:51:13.562 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-09-12T15:51:13.562 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-09-12T15:51:13.562 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-09-12T15:51:13.562 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-09-12T15:51:13.563 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-09-12T15:51:13.563 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-09-12T15:51:13.563 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-09-12T15:51:13.563 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-09-12T15:51:13.563 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-09-12T15:51:13.563 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-09-12T15:51:13.564 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-09-12T15:51:13.564 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-09-12T15:51:13.564 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-09-12T15:51:13.564 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-09-12T15:51:13.564 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-09-12T15:51:13.565 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-09-12T15:51:13.565 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-09-12T15:51:13.565 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-09-12T15:51:13.565 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-09-12T15:51:13.565 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-09-12T15:51:13.566 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-09-12T15:51:13.566 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-09-12T15:51:13.566 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-09-12T15:51:13.566 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-09-12T15:51:13.566 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-09-12T15:51:13.567 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-09-12T15:51:13.567 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-09-12T15:51:13.567 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-09-12T15:51:13.567 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-09-12T15:51:13.567 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-09-12T15:51:13.567 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-09-12T15:51:13.568 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-09-12T15:51:13.568 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-09-12T15:51:13.568 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-09-12T15:51:13.568 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-09-12T15:51:13.568 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-09-12T15:51:13.569 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-09-12T15:51:13.569 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-09-12T15:51:13.569 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-09-12T15:51:13.569 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-09-12T15:51:13.569 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-09-12T15:51:13.570 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-09-12T15:51:13.570 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-09-12T15:51:13.570 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-09-12T15:51:13.570 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-09-12T15:51:13.570 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-09-12T15:51:13.571 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-09-12T15:51:13.571 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-09-12T15:51:13.571 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-09-12T15:51:13.571 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-09-12T15:51:13.571 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-09-12T15:51:13.572 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-09-12T15:51:13.572 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-09-12T15:51:13.572 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-09-12T15:51:13.572 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-09-12T15:51:13.572 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-09-12T15:51:13.573 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-09-12T15:51:13.573 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-09-12T15:51:13.573 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-09-12T15:51:13.573 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-09-12T15:51:13.573 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-09-12T15:51:13.574 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-09-12T15:51:13.574 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-09-12T15:51:13.574 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-09-12T15:51:13.574 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-09-12T15:51:13.574 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-09-12T15:51:13.575 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-09-12T15:51:13.575 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-09-12T15:51:13.575 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-09-12T15:51:13.575 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-09-12T15:51:13.575 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-09-12T15:51:13.576 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-09-12T15:51:13.576 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-09-12T15:51:13.576 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-09-12T15:51:13.576 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-09-12T15:51:13.576 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-09-12T15:51:13.576 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-09-12T15:51:13.577 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-09-12T15:51:13.577 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-09-12T15:51:13.577 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-09-12T15:51:13.577 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-09-12T15:51:13.577 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-09-12T15:51:13.578 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-09-12T15:51:13.578 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-09-12T15:51:13.578 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-09-12T15:51:13.578 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-09-12T15:51:13.578 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-09-12T15:51:13.579 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-09-12T15:51:13.579 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-09-12T15:51:13.579 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-09-12T15:51:13.579 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-09-12T15:51:13.579 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-09-12T15:51:13.580 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-09-12T15:51:13.580 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-09-12T15:51:13.580 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-09-12T15:51:13.580 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-09-12T15:51:13.580 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-09-12T15:51:13.581 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-09-12T15:51:13.581 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-09-12T15:51:13.581 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-09-12T15:51:13.581 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-09-12T15:51:13.581 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-09-12T15:51:13.581 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-09-12T15:51:13.582 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-09-12T15:51:13.582 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-09-12T15:51:13.582 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-09-12T15:51:13.582 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-09-12T15:51:13.582 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-09-12T15:51:13.583 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-09-12T15:51:13.583 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-09-12T15:51:13.583 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-09-12T15:51:13.583 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-09-12T15:51:13.583 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-09-12T15:51:13.584 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-09-12T15:51:13.584 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-09-12T15:51:13.584 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-09-12T15:51:13.584 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-09-12T15:51:13.584 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-09-12T15:51:13.585 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-09-12T15:51:13.585 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-09-12T15:51:13.585 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-09-12T15:51:13.585 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-09-12T15:51:13.585 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-09-12T15:51:13.586 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-09-12T15:51:13.586 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-09-12T15:51:13.586 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-09-12T15:51:13.586 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-09-12T15:51:13.586 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-09-12T15:51:13.587 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-09-12T15:51:13.587 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-09-12T15:51:13.587 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-09-12T15:51:13.587 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-09-12T15:51:13.587 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-09-12T15:51:13.588 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-09-12T15:51:13.588 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-09-12T15:51:13.588 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-09-12T15:51:13.588 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-09-12T15:51:13.588 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-09-12T15:51:13.589 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-09-12T15:51:13.589 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-09-12T15:51:13.589 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-09-12T15:51:13.590 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-09-12T15:51:13.590 DEBUG:teuthology.orchestra.run.smithi112:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-09-12T15:51:13.619 INFO:teuthology.orchestra.run.smithi112.stdout:postinstall scriptlet (using /bin/sh): 2023-09-12T15:51:13.619 INFO:teuthology.orchestra.run.smithi112.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-09-12T15:51:13.620 INFO:teuthology.orchestra.run.smithi112.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-12T15:51:13.620 INFO:teuthology.orchestra.run.smithi112.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-12T15:51:13.620 INFO:teuthology.orchestra.run.smithi112.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-12T15:51:13.620 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-12T15:51:13.620 INFO:teuthology.orchestra.run.smithi112.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-12T15:51:13.621 INFO:teuthology.orchestra.run.smithi112.stdout:fi 2023-09-12T15:51:13.621 INFO:teuthology.orchestra.run.smithi112.stdout:preuninstall scriptlet (using /bin/sh): 2023-09-12T15:51:13.621 INFO:teuthology.orchestra.run.smithi112.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-09-12T15:51:13.621 INFO:teuthology.orchestra.run.smithi112.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-09-12T15:51:13.622 INFO:teuthology.orchestra.run.smithi112.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-09-12T15:51:13.622 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-09-12T15:51:13.622 INFO:teuthology.orchestra.run.smithi112.stdout:fi 2023-09-12T15:51:13.622 INFO:teuthology.orchestra.run.smithi112.stdout:postuninstall scriptlet (using /bin/sh): 2023-09-12T15:51:13.622 INFO:teuthology.orchestra.run.smithi112.stdout:if [ -x /sbin/update-bootloader ]; then 2023-09-12T15:51:13.622 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-09-12T15:51:13.623 INFO:teuthology.orchestra.run.smithi112.stdout:fi 2023-09-12T15:51:13.624 DEBUG:teuthology.orchestra.run.smithi112:> sudo rpm -qi grub2-tools 2023-09-12T15:51:13.702 INFO:teuthology.orchestra.run.smithi112.stdout:Name : grub2-tools 2023-09-12T15:51:13.702 INFO:teuthology.orchestra.run.smithi112.stdout:Epoch : 1 2023-09-12T15:51:13.703 INFO:teuthology.orchestra.run.smithi112.stdout:Version : 2.02 2023-09-12T15:51:13.703 INFO:teuthology.orchestra.run.smithi112.stdout:Release : 129.el8 2023-09-12T15:51:13.703 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: x86_64 2023-09-12T15:51:13.703 INFO:teuthology.orchestra.run.smithi112.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-09-12T15:51:13.703 INFO:teuthology.orchestra.run.smithi112.stdout:Group : System Environment/Base 2023-09-12T15:51:13.704 INFO:teuthology.orchestra.run.smithi112.stdout:Size : 9265586 2023-09-12T15:51:13.704 INFO:teuthology.orchestra.run.smithi112.stdout:License : GPLv3+ 2023-09-12T15:51:13.704 INFO:teuthology.orchestra.run.smithi112.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-09-12T15:51:13.704 INFO:teuthology.orchestra.run.smithi112.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-09-12T15:51:13.704 INFO:teuthology.orchestra.run.smithi112.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-09-12T15:51:13.705 INFO:teuthology.orchestra.run.smithi112.stdout:Build Host : kbuilder.bsys.centos.org 2023-09-12T15:51:13.705 INFO:teuthology.orchestra.run.smithi112.stdout:Relocations : (not relocatable) 2023-09-12T15:51:13.705 INFO:teuthology.orchestra.run.smithi112.stdout:Packager : CentOS BuildSystem 2023-09-12T15:51:13.705 INFO:teuthology.orchestra.run.smithi112.stdout:Vendor : CentOS 2023-09-12T15:51:13.705 INFO:teuthology.orchestra.run.smithi112.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-12T15:51:13.706 INFO:teuthology.orchestra.run.smithi112.stdout:Summary : Support tools for GRUB. 2023-09-12T15:51:13.706 INFO:teuthology.orchestra.run.smithi112.stdout:Description : 2023-09-12T15:51:13.706 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T15:51:13.706 INFO:teuthology.orchestra.run.smithi112.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-12T15:51:13.706 INFO:teuthology.orchestra.run.smithi112.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-12T15:51:13.707 INFO:teuthology.orchestra.run.smithi112.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-12T15:51:13.707 INFO:teuthology.orchestra.run.smithi112.stdout:hardware devices. 2023-09-12T15:51:13.707 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T15:51:13.709 INFO:teuthology.orchestra.run.smithi112.stdout:This subpackage provides tools for support of all platforms. 2023-09-12T15:51:13.710 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-12T15:51:13.711 INFO:teuthology.task.kernel:Updating grub on smithi112 to boot 6.5.0-rc7-gfef64f93da2b 2023-09-12T15:51:13.711 DEBUG:teuthology.orchestra.run.smithi112:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-12T15:51:14.955 INFO:teuthology.orchestra.run.smithi144.stderr:Generating grub configuration file ... 2023-09-12T15:51:16.203 INFO:teuthology.orchestra.run.smithi112.stderr:Generating grub configuration file ... 2023-09-12T15:51:17.237 INFO:teuthology.orchestra.run.smithi144.stderr:done 2023-09-12T15:51:17.238 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2023-09-12T15:51:17.263 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.4JROYCA14o 2023-09-12T15:51:17.263 DEBUG:teuthology.orchestra.run.smithi144:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4JROYCA14o 2023-09-12T15:51:17.337 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.4JROYCA14o 2023-09-12T15:51:17.505 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.4JROYCA14o is 6KB 2023-09-12T15:51:17.554 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.4JROYCA14o 2023-09-12T15:51:17.571 DEBUG:teuthology.orchestra.run.smithi144:> sudo /bin/ls /boot/loader/entries || true 2023-09-12T15:51:17.638 INFO:teuthology.orchestra.run.smithi144.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-09-12T15:51:17.638 INFO:teuthology.orchestra.run.smithi144.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-09-12T15:51:17.639 INFO:teuthology.orchestra.run.smithi144.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-09-12T15:51:17.639 INFO:teuthology.orchestra.run.smithi144.stdout:a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-gfef64f93da2b.conf 2023-09-12T15:51:17.640 DEBUG:teuthology.orchestra.run.smithi144:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-gfef64f93da2b 2023-09-12T15:51:17.786 DEBUG:teuthology.orchestra.run.smithi144:> sudo shutdown -r now 2023-09-12T15:51:18.300 INFO:teuthology.orchestra.run.smithi112.stderr:done 2023-09-12T15:51:18.302 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2023-09-12T15:51:18.325 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.6h09gzTQ0z 2023-09-12T15:51:18.325 DEBUG:teuthology.orchestra.run.smithi112:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.6h09gzTQ0z 2023-09-12T15:51:18.399 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.6h09gzTQ0z 2023-09-12T15:51:18.562 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.6h09gzTQ0z is 6KB 2023-09-12T15:51:18.610 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.6h09gzTQ0z 2023-09-12T15:51:18.628 DEBUG:teuthology.orchestra.run.smithi112:> sudo /bin/ls /boot/loader/entries || true 2023-09-12T15:51:18.693 INFO:teuthology.orchestra.run.smithi112.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-09-12T15:51:18.693 INFO:teuthology.orchestra.run.smithi112.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-09-12T15:51:18.693 INFO:teuthology.orchestra.run.smithi112.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-09-12T15:51:18.694 INFO:teuthology.orchestra.run.smithi112.stdout:a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-gfef64f93da2b.conf 2023-09-12T15:51:18.695 DEBUG:teuthology.orchestra.run.smithi112:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-gfef64f93da2b 2023-09-12T15:51:18.903 DEBUG:teuthology.orchestra.run.smithi112:> sudo shutdown -r now 2023-09-12T15:51:47.818 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-09-12T15:51:47.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-09-12T15:51:47.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-12T15:51:48.907 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-09-12T15:51:48.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-09-12T15:51:48.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-12T15:52:22.426 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-12T15:52:23.450 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-09-12T15:52:31.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-09-12T15:52:31.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-12T15:52:32.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-09-12T15:52:32.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-12T15:52:49.818 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-12T15:52:50.842 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-09-12T15:53:01.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-09-12T15:53:01.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-12T15:53:02.182 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-09-12T15:53:02.611 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-09-12T15:53:02.612 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc7-gfef64f93da2b"... 2023-09-12T15:53:02.612 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2023-09-12T15:53:02.656 INFO:teuthology.orchestra.run.smithi144.stdout:6.5.0-rc7-gfef64f93da2b 2023-09-12T15:53:02.657 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-09-12T15:53:02.657 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-12T15:53:02.657 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-09-12T15:53:02.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-09-12T15:53:02.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-12T15:53:03.221 DEBUG:teuthology.orchestra.run.smithi112:> true 2023-09-12T15:53:03.659 DEBUG:teuthology.parallel:result is None 2023-09-12T15:53:03.713 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-09-12T15:53:03.713 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc7-gfef64f93da2b"... 2023-09-12T15:53:03.714 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2023-09-12T15:53:03.759 INFO:teuthology.orchestra.run.smithi112.stdout:6.5.0-rc7-gfef64f93da2b 2023-09-12T15:53:03.760 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-09-12T15:53:03.760 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-12T15:53:03.760 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-09-12T15:53:04.762 DEBUG:teuthology.parallel:result is None 2023-09-12T15:53:04.762 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-12T15:53:04.770 INFO:teuthology.task.internal:Creating test directory... 2023-09-12T15:53:04.770 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-12T15:53:04.778 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-12T15:53:04.830 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-12T15:53:04.839 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-12T15:53:04.865 INFO:teuthology.task.internal:Creating archive directory... 2023-09-12T15:53:04.865 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-12T15:53:04.871 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-12T15:53:04.938 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-12T15:53:04.945 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-12T15:53:04.946 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-12T15:53:04.951 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-12T15:53:05.077 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-12T15:53:05.089 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-12T15:53:05.126 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-12T15:53:05.135 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-12T15:53:05.138 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-12T15:53:05.146 INFO:teuthology.task.internal:Configuring sudo... 2023-09-12T15:53:05.146 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-12T15:53:05.152 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-12T15:53:05.222 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-12T15:53:05.233 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-12T15:53:05.234 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-12T15:53:05.238 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-12T15:53:05.283 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-12T15:53:05.394 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-12T15:53:05.465 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-12T15:53:05.539 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-12T15:53:05.607 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T15:53:05.608 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-12T15:53:05.676 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-12T15:53:05.754 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-12T15:53:05.825 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-12T15:53:05.899 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-12T15:53:05.968 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T15:53:05.968 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-12T15:53:06.037 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2023-09-12T15:53:06.042 DEBUG:teuthology.orchestra.run.smithi144:> sudo service rsyslog restart 2023-09-12T15:53:06.161 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-12T15:53:06.200 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-12T15:53:06.630 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-12T15:53:06.638 INFO:teuthology.task.internal:Starting timer... 2023-09-12T15:53:06.639 INFO:teuthology.run_tasks:Running task pcp... 2023-09-12T15:53:06.685 INFO:teuthology.run_tasks:Running task selinux... 2023-09-12T15:53:06.726 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-09-12T15:53:06.726 DEBUG:teuthology.orchestra.run.smithi112:> sudo service auditd rotate 2023-09-12T15:53:06.885 INFO:teuthology.orchestra.run.smithi112.stdout:Rotating logs: 2023-09-12T15:53:06.888 DEBUG:teuthology.orchestra.run.smithi144:> sudo service auditd rotate 2023-09-12T15:53:07.026 INFO:teuthology.orchestra.run.smithi144.stdout:Rotating logs: 2023-09-12T15:53:07.029 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-12T15:53:07.029 DEBUG:teuthology.orchestra.run.smithi112:> /usr/sbin/getenforce 2023-09-12T15:53:07.075 INFO:teuthology.orchestra.run.smithi112.stdout:Permissive 2023-09-12T15:53:07.076 DEBUG:teuthology.orchestra.run.smithi144:> /usr/sbin/getenforce 2023-09-12T15:53:07.123 INFO:teuthology.orchestra.run.smithi144.stdout:Permissive 2023-09-12T15:53:07.124 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi112.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi144.front.sepia.ceph.com': 'permissive'} 2023-09-12T15:53:07.124 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-12T15:53:07.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-12T15:53:07.194 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-12T15:53:07.264 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-12T15:53:07.265 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-12T15:53:07.265 DEBUG:teuthology.orchestra.run.smithi112:> sudo /usr/sbin/setenforce permissive 2023-09-12T15:53:07.334 DEBUG:teuthology.orchestra.run.smithi144:> sudo /usr/sbin/setenforce permissive 2023-09-12T15:53:07.410 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-12T15:53:07.420 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-09-12T15:53:07.420 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-12T15:53:07.441 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-12T15:53:07.442 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi112.front.sepia.ceph.com,smithi144.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-12T16:03:18.951 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi112.front.sepia.ceph.com'), Remote(name='ubuntu@smithi144.front.sepia.ceph.com')] 2023-09-12T16:03:18.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-09-12T16:03:18.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-12T16:03:19.041 DEBUG:teuthology.orchestra.run.smithi112:> true 2023-09-12T16:03:19.150 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-09-12T16:03:19.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-09-12T16:03:19.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-12T16:03:19.240 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-09-12T16:03:19.351 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-09-12T16:03:19.352 INFO:teuthology.run_tasks:Running task clock... 2023-09-12T16:03:19.363 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-12T16:03:19.363 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-12T16:03:19.364 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-12T16:03:19.368 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-12T16:03:19.369 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-12T16:03:19.439 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-12T16:03:19.465 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-12T16:03:19.471 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-12T16:03:19.498 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-12T16:03:19.558 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: ntpd: command not found 2023-09-12T16:03:19.585 INFO:teuthology.orchestra.run.smithi112.stdout:506 Cannot talk to daemon 2023-09-12T16:03:19.586 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: ntpd: command not found 2023-09-12T16:03:19.613 INFO:teuthology.orchestra.run.smithi144.stdout:506 Cannot talk to daemon 2023-09-12T16:03:19.617 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-12T16:03:19.646 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-12T16:03:19.649 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-12T16:03:19.679 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-12T16:03:19.737 INFO:teuthology.orchestra.run.smithi112.stderr:bash: ntpq: command not found 2023-09-12T16:03:19.745 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-12T16:03:19.745 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2023-09-12T16:03:19.745 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-12T16:03:19.746 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-12T16:03:19.746 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-12T16:03:19.746 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-12T16:03:19.770 INFO:teuthology.orchestra.run.smithi144.stderr:bash: ntpq: command not found 2023-09-12T16:03:19.777 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-12T16:03:19.778 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2023-09-12T16:03:19.778 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-12T16:03:19.778 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-12T16:03:19.778 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-12T16:03:19.778 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-12T16:03:19.779 INFO:teuthology.run_tasks:Running task install... 2023-09-12T16:03:19.788 DEBUG:teuthology.task.install:project ceph 2023-09-12T16:03:19.788 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2110e00747b31a0d73768c9e5229da18b26b8aa0'}} 2023-09-12T16:03:19.788 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2110e00747b31a0d73768c9e5229da18b26b8aa0'} 2023-09-12T16:03:19.789 INFO:teuthology.task.install:Using flavor: default 2023-09-12T16:03:19.795 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-12T16:03:19.795 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-09-12T16:03:19.796 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2110e00747b31a0d73768c9e5229da18b26b8aa0', 'tag': None, 'wait_for_package': False} 2023-09-12T16:03:19.796 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2110e00747b31a0d73768c9e5229da18b26b8aa0 2023-09-12T16:03:19.801 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2110e00747b31a0d73768c9e5229da18b26b8aa0', 'tag': None, 'wait_for_package': False} 2023-09-12T16:03:19.802 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2110e00747b31a0d73768c9e5229da18b26b8aa0 2023-09-12T16:03:19.943 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20230912.122437/2110e00747b31a0d73768c9e5229da18b26b8aa0/centos/8/flavors/default/ 2023-09-12T16:03:19.943 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6088.g2110e007 2023-09-12T16:03:20.015 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20230912.122437/2110e00747b31a0d73768c9e5229da18b26b8aa0/centos/8/flavors/default/ 2023-09-12T16:03:20.015 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6088.g2110e007 2023-09-12T16:03:20.111 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20230912.122437/2110e00747b31a0d73768c9e5229da18b26b8aa0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20230912.122437/2110e00747b31a0d73768c9e5229da18b26b8aa0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20230912.122437/2110e00747b31a0d73768c9e5229da18b26b8aa0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-12T16:03:20.112 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:03:20.112 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-12T16:03:20.180 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20230912.122437/2110e00747b31a0d73768c9e5229da18b26b8aa0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20230912.122437/2110e00747b31a0d73768c9e5229da18b26b8aa0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20230912.122437/2110e00747b31a0d73768c9e5229da18b26b8aa0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-12T16:03:20.181 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:03:20.181 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-12T16:03:20.183 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-09-12T16:03:20.184 DEBUG:teuthology.orchestra.run.smithi112:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2110e00747b31a0d73768c9e5229da18b26b8aa0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-12T16:03:20.251 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-09-12T16:03:20.252 DEBUG:teuthology.orchestra.run.smithi144:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2110e00747b31a0d73768c9e5229da18b26b8aa0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-12T16:03:20.295 DEBUG:teuthology.orchestra.run.smithi112:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-12T16:03:20.362 DEBUG:teuthology.orchestra.run.smithi144:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-12T16:03:20.391 DEBUG:teuthology.orchestra.run.smithi112:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-12T16:03:20.457 DEBUG:teuthology.orchestra.run.smithi144:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-12T16:03:20.460 INFO:teuthology.orchestra.run.smithi112.stdout:check_obsoletes = 1 2023-09-12T16:03:20.463 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum clean all 2023-09-12T16:03:20.526 INFO:teuthology.orchestra.run.smithi144.stdout:check_obsoletes = 1 2023-09-12T16:03:20.529 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum clean all 2023-09-12T16:03:20.881 INFO:teuthology.orchestra.run.smithi144.stdout:76 files removed 2023-09-12T16:03:20.882 INFO:teuthology.orchestra.run.smithi112.stdout:76 files removed 2023-09-12T16:03:20.916 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-09-12T16:03:20.918 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-09-12T16:03:21.795 INFO:teuthology.orchestra.run.smithi112.stdout:ceph packages for x86_64 239 kB/s | 81 kB 00:00 2023-09-12T16:03:21.827 INFO:teuthology.orchestra.run.smithi144.stdout:ceph packages for x86_64 221 kB/s | 81 kB 00:00 2023-09-12T16:03:22.120 INFO:teuthology.orchestra.run.smithi144.stdout:ceph noarch packages 37 kB/s | 9.4 kB 00:00 2023-09-12T16:03:22.153 INFO:teuthology.orchestra.run.smithi112.stdout:ceph noarch packages 29 kB/s | 9.4 kB 00:00 2023-09-12T16:03:22.370 INFO:teuthology.orchestra.run.smithi144.stdout:ceph source packages 6.6 kB/s | 1.5 kB 00:00 2023-09-12T16:03:22.495 INFO:teuthology.orchestra.run.smithi112.stdout:ceph source packages 4.7 kB/s | 1.5 kB 00:00 2023-09-12T16:03:23.187 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 8 - AppStream 42 MB/s | 33 MB 00:00 2023-09-12T16:03:23.271 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 8 - AppStream 44 MB/s | 33 MB 00:00 2023-09-12T16:03:31.187 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 8 - BaseOS 31 MB/s | 47 MB 00:01 2023-09-12T16:03:32.755 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 8 - BaseOS 18 MB/s | 47 MB 00:02 2023-09-12T16:03:38.780 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 8 - Extras 32 kB/s | 18 kB 00:00 2023-09-12T16:03:39.264 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 8 - Extras common packages 23 kB/s | 6.9 kB 00:00 2023-09-12T16:03:40.280 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 8 - Extras 46 kB/s | 18 kB 00:00 2023-09-12T16:03:40.490 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 8 - PowerTools 6.0 MB/s | 6.5 MB 00:01 2023-09-12T16:03:40.764 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 8 - Extras common packages 23 kB/s | 6.9 kB 00:00 2023-09-12T16:03:41.999 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 8 - PowerTools 6.0 MB/s | 6.5 MB 00:01 2023-09-12T16:03:42.008 INFO:teuthology.orchestra.run.smithi144.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-09-12T16:03:43.192 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-09-12T16:03:43.508 INFO:teuthology.orchestra.run.smithi112.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-09-12T16:03:46.468 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 5.7 MB/s | 16 MB 00:02 2023-09-12T16:03:47.692 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 354 kB/s | 24 kB 00:00 2023-09-12T16:03:50.984 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 547 kB/s | 24 kB 00:00 2023-09-12T16:03:52.043 INFO:teuthology.orchestra.run.smithi144.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-12T16:03:52.044 INFO:teuthology.orchestra.run.smithi144.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-12T16:03:52.057 INFO:teuthology.orchestra.run.smithi144.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-09-12T16:03:52.058 INFO:teuthology.orchestra.run.smithi144.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-09-12T16:03:52.058 INFO:teuthology.orchestra.run.smithi144.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-09-12T16:03:52.059 INFO:teuthology.orchestra.run.smithi144.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-09-12T16:03:52.060 INFO:teuthology.orchestra.run.smithi144.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-12T16:03:52.062 INFO:teuthology.orchestra.run.smithi144.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-12T16:03:52.065 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-09-12T16:03:52.066 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-12T16:03:52.278 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2023-09-12T16:03:52.292 INFO:teuthology.orchestra.run.smithi144.stdout:==================================================================================================== 2023-09-12T16:03:52.292 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2023-09-12T16:03:52.292 INFO:teuthology.orchestra.run.smithi144.stdout:==================================================================================================== 2023-09-12T16:03:52.293 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2023-09-12T16:03:52.293 INFO:teuthology.orchestra.run.smithi144.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-09-12T16:03:52.293 INFO:teuthology.orchestra.run.smithi144.stdout: ceph x86_64 2:18.0.0-6088.g2110e007.el8 ceph 6.4 k 2023-09-12T16:03:52.293 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base x86_64 2:18.0.0-6088.g2110e007.el8 ceph 5.4 M 2023-09-12T16:03:52.293 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse x86_64 2:18.0.0-6088.g2110e007.el8 ceph 907 k 2023-09-12T16:03:52.294 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6088.g2110e007.el8 ceph 167 k 2023-09-12T16:03:52.294 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr x86_64 2:18.0.0-6088.g2110e007.el8 ceph 1.6 M 2023-09-12T16:03:52.294 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6088.g2110e007.el8 ceph-noarch 132 k 2023-09-12T16:03:52.294 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6088.g2110e007.el8 ceph-noarch 1.7 M 2023-09-12T16:03:52.294 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6088.g2110e007.el8 ceph-noarch 7.4 M 2023-09-12T16:03:52.295 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook noarch 2:18.0.0-6088.g2110e007.el8 ceph-noarch 47 k 2023-09-12T16:03:52.295 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw x86_64 2:18.0.0-6088.g2110e007.el8 ceph 14 M 2023-09-12T16:03:52.295 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test x86_64 2:18.0.0-6088.g2110e007.el8 ceph 49 M 2023-09-12T16:03:52.295 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume noarch 2:18.0.0-6088.g2110e007.el8 ceph-noarch 261 k 2023-09-12T16:03:52.295 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm noarch 2:18.0.0-6088.g2110e007.el8 ceph-noarch 177 k 2023-09-12T16:03:52.296 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror x86_64 2:18.0.0-6088.g2110e007.el8 ceph 261 k 2023-09-12T16:03:52.296 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top noarch 2:18.0.0-6088.g2110e007.el8 ceph-noarch 18 k 2023-09-12T16:03:52.296 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-09-12T16:03:52.296 INFO:teuthology.orchestra.run.smithi144.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-09-12T16:03:52.296 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-09-12T16:03:52.297 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel x86_64 2:18.0.0-6088.g2110e007.el8 ceph 31 k 2023-09-12T16:03:52.297 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2 x86_64 2:18.0.0-6088.g2110e007.el8 ceph 827 k 2023-09-12T16:03:52.297 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel x86_64 2:18.0.0-6088.g2110e007.el8 ceph 139 k 2023-09-12T16:03:52.297 INFO:teuthology.orchestra.run.smithi144.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-09-12T16:03:52.297 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel x86_64 2.32.1-43.el8 baseos 100 k 2023-09-12T16:03:52.298 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-09-12T16:03:52.298 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql x86_64 10.23-2.module_el8+572+929c87ac appstream 1.6 M 2023-09-12T16:03:52.298 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib x86_64 10.23-2.module_el8+572+929c87ac appstream 901 k 2023-09-12T16:03:52.298 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server x86_64 10.23-2.module_el8+572+929c87ac appstream 5.1 M 2023-09-12T16:03:52.298 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs x86_64 2:18.0.0-6088.g2110e007.el8 ceph 197 k 2023-09-12T16:03:52.298 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados x86_64 2:18.0.0-6088.g2110e007.el8 ceph 371 k 2023-09-12T16:03:52.299 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd x86_64 2:18.0.0-6088.g2110e007.el8 ceph 364 k 2023-09-12T16:03:52.299 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw x86_64 2:18.0.0-6088.g2110e007.el8 ceph 106 k 2023-09-12T16:03:52.299 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse x86_64 2:18.0.0-6088.g2110e007.el8 ceph 94 k 2023-09-12T16:03:52.299 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror x86_64 2:18.0.0-6088.g2110e007.el8 ceph 3.6 M 2023-09-12T16:03:52.299 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd x86_64 2:18.0.0-6088.g2110e007.el8 ceph 179 k 2023-09-12T16:03:52.300 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-09-12T16:03:52.300 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrading: 2023-09-12T16:03:52.300 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-09-12T16:03:52.300 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-09-12T16:03:52.300 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-09-12T16:03:52.301 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-09-12T16:03:52.301 INFO:teuthology.orchestra.run.smithi144.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-09-12T16:03:52.301 INFO:teuthology.orchestra.run.smithi144.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-09-12T16:03:52.301 INFO:teuthology.orchestra.run.smithi144.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-09-12T16:03:52.301 INFO:teuthology.orchestra.run.smithi144.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-09-12T16:03:52.302 INFO:teuthology.orchestra.run.smithi144.stdout: librados2 x86_64 2:18.0.0-6088.g2110e007.el8 ceph 3.7 M 2023-09-12T16:03:52.302 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1 x86_64 2:18.0.0-6088.g2110e007.el8 ceph 3.7 M 2023-09-12T16:03:52.302 INFO:teuthology.orchestra.run.smithi144.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-09-12T16:03:52.302 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-09-12T16:03:52.302 INFO:teuthology.orchestra.run.smithi144.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-09-12T16:03:52.303 INFO:teuthology.orchestra.run.smithi144.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-09-12T16:03:52.303 INFO:teuthology.orchestra.run.smithi144.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-09-12T16:03:52.303 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-09-12T16:03:52.303 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2023-09-12T16:03:52.303 INFO:teuthology.orchestra.run.smithi144.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2023-09-12T16:03:52.304 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common x86_64 2:18.0.0-6088.g2110e007.el8 ceph 22 M 2023-09-12T16:03:52.304 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6088.g2110e007.el8 ceph-noarch 23 k 2023-09-12T16:03:52.304 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds x86_64 2:18.0.0-6088.g2110e007.el8 ceph 2.3 M 2023-09-12T16:03:52.304 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6088.g2110e007.el8 ceph-noarch 242 k 2023-09-12T16:03:52.304 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon x86_64 2:18.0.0-6088.g2110e007.el8 ceph 4.6 M 2023-09-12T16:03:52.305 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd x86_64 2:18.0.0-6088.g2110e007.el8 ceph 18 M 2023-09-12T16:03:52.305 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6088.g2110e007.el8 ceph-noarch 15 k 2023-09-12T16:03:52.305 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux x86_64 2:18.0.0-6088.g2110e007.el8 ceph 24 k 2023-09-12T16:03:52.305 INFO:teuthology.orchestra.run.smithi144.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-09-12T16:03:52.305 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-12T16:03:52.306 INFO:teuthology.orchestra.run.smithi144.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-09-12T16:03:52.306 INFO:teuthology.orchestra.run.smithi144.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-09-12T16:03:52.306 INFO:teuthology.orchestra.run.smithi144.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-09-12T16:03:52.306 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite x86_64 2:18.0.0-6088.g2110e007.el8 ceph 184 k 2023-09-12T16:03:52.306 INFO:teuthology.orchestra.run.smithi144.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-09-12T16:03:52.307 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-09-12T16:03:52.307 INFO:teuthology.orchestra.run.smithi144.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-12T16:03:52.307 INFO:teuthology.orchestra.run.smithi144.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-09-12T16:03:52.309 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-09-12T16:03:52.309 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-09-12T16:03:52.310 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1 x86_64 2:18.0.0-6088.g2110e007.el8 ceph 519 k 2023-09-12T16:03:52.310 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-09-12T16:03:52.311 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2 x86_64 2:18.0.0-6088.g2110e007.el8 ceph 6.8 M 2023-09-12T16:03:52.311 INFO:teuthology.orchestra.run.smithi144.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-09-12T16:03:52.311 INFO:teuthology.orchestra.run.smithi144.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-09-12T16:03:52.311 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-12T16:03:52.311 INFO:teuthology.orchestra.run.smithi144.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-09-12T16:03:52.312 INFO:teuthology.orchestra.run.smithi144.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-09-12T16:03:52.312 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-09-12T16:03:52.312 INFO:teuthology.orchestra.run.smithi144.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-09-12T16:03:52.312 INFO:teuthology.orchestra.run.smithi144.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-09-12T16:03:52.313 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-09-12T16:03:52.313 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-09-12T16:03:52.313 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-09-12T16:03:52.313 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-09-12T16:03:52.313 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-12T16:03:52.313 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-09-12T16:03:52.314 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-12T16:03:52.314 INFO:teuthology.orchestra.run.smithi144.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-12T16:03:52.314 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-12T16:03:52.314 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse x86_64 2:18.0.0-6088.g2110e007.el8 ceph 45 k 2023-09-12T16:03:52.315 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common x86_64 2:18.0.0-6088.g2110e007.el8 ceph 125 k 2023-09-12T16:03:52.315 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-12T16:03:52.315 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-09-12T16:03:52.315 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-12T16:03:52.315 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-12T16:03:52.316 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-09-12T16:03:52.316 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-12T16:03:52.316 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-12T16:03:52.316 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-12T16:03:52.317 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-09-12T16:03:52.317 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-09-12T16:03:52.317 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-09-12T16:03:52.317 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-09-12T16:03:52.317 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-12T16:03:52.318 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-12T16:03:52.318 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-09-12T16:03:52.318 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-09-12T16:03:52.318 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-12T16:03:52.319 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-12T16:03:52.319 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-09-12T16:03:52.319 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-09-12T16:03:52.319 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-09-12T16:03:52.320 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-12T16:03:52.320 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-12T16:03:52.320 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-09-12T16:03:52.320 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-09-12T16:03:52.321 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-09-12T16:03:52.321 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-09-12T16:03:52.321 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-09-12T16:03:52.322 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-09-12T16:03:52.322 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-12T16:03:52.322 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-09-12T16:03:52.322 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-12T16:03:52.323 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-12T16:03:52.323 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-09-12T16:03:52.323 INFO:teuthology.orchestra.run.smithi144.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-12T16:03:52.323 INFO:teuthology.orchestra.run.smithi144.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-12T16:03:52.323 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-12T16:03:52.324 INFO:teuthology.orchestra.run.smithi144.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-12T16:03:52.324 INFO:teuthology.orchestra.run.smithi144.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-12T16:03:52.324 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-12T16:03:52.324 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-12T16:03:52.325 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-12T16:03:52.325 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-09-12T16:03:52.325 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-12T16:03:52.325 INFO:teuthology.orchestra.run.smithi144.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-09-12T16:03:52.326 INFO:teuthology.orchestra.run.smithi144.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-12T16:03:52.326 INFO:teuthology.orchestra.run.smithi144.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-09-12T16:03:52.326 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-09-12T16:03:52.326 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-09-12T16:03:52.327 INFO:teuthology.orchestra.run.smithi144.stdout:Enabling module streams: 2023-09-12T16:03:52.327 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql 10 2023-09-12T16:03:52.327 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:03:52.327 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2023-09-12T16:03:52.328 INFO:teuthology.orchestra.run.smithi144.stdout:==================================================================================================== 2023-09-12T16:03:52.328 INFO:teuthology.orchestra.run.smithi144.stdout:Install 128 Packages 2023-09-12T16:03:52.328 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrade 16 Packages 2023-09-12T16:03:52.328 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:03:52.329 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 214 M 2023-09-12T16:03:52.329 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2023-09-12T16:03:52.644 INFO:teuthology.orchestra.run.smithi144.stdout:(1/144): ceph-18.0.0-6088.g2110e007.el8.x86_64. 35 kB/s | 6.4 kB 00:00 2023-09-12T16:03:52.935 INFO:teuthology.orchestra.run.smithi144.stdout:(2/144): ceph-fuse-18.0.0-6088.g2110e007.el8.x8 3.0 MB/s | 907 kB 00:00 2023-09-12T16:03:52.994 INFO:teuthology.orchestra.run.smithi144.stdout:(3/144): ceph-immutable-object-cache-18.0.0-608 2.8 MB/s | 167 kB 00:00 2023-09-12T16:03:53.345 INFO:teuthology.orchestra.run.smithi144.stdout:(4/144): ceph-mds-18.0.0-6088.g2110e007.el8.x86 6.7 MB/s | 2.3 MB 00:00 2023-09-12T16:03:53.421 INFO:teuthology.orchestra.run.smithi144.stdout:(5/144): ceph-base-18.0.0-6088.g2110e007.el8.x8 5.6 MB/s | 5.4 MB 00:00 2023-09-12T16:03:53.595 INFO:teuthology.orchestra.run.smithi144.stdout:(6/144): ceph-mgr-18.0.0-6088.g2110e007.el8.x86 6.5 MB/s | 1.6 MB 00:00 2023-09-12T16:03:54.029 INFO:teuthology.orchestra.run.smithi144.stdout:(7/144): ceph-mon-18.0.0-6088.g2110e007.el8.x86 7.6 MB/s | 4.6 MB 00:00 2023-09-12T16:03:54.963 INFO:teuthology.orchestra.run.smithi144.stdout:(8/144): ceph-common-18.0.0-6088.g2110e007.el8. 9.0 MB/s | 22 MB 00:02 2023-09-12T16:03:55.046 INFO:teuthology.orchestra.run.smithi144.stdout:(9/144): ceph-selinux-18.0.0-6088.g2110e007.el8 292 kB/s | 24 kB 00:00 2023-09-12T16:03:55.302 INFO:teuthology.orchestra.run.smithi112.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-12T16:03:55.303 INFO:teuthology.orchestra.run.smithi112.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-12T16:03:55.317 INFO:teuthology.orchestra.run.smithi112.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-09-12T16:03:55.317 INFO:teuthology.orchestra.run.smithi112.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-09-12T16:03:55.317 INFO:teuthology.orchestra.run.smithi112.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-09-12T16:03:55.319 INFO:teuthology.orchestra.run.smithi112.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-09-12T16:03:55.320 INFO:teuthology.orchestra.run.smithi112.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-12T16:03:55.322 INFO:teuthology.orchestra.run.smithi112.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-12T16:03:55.325 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-09-12T16:03:55.326 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-12T16:03:55.541 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2023-09-12T16:03:55.555 INFO:teuthology.orchestra.run.smithi112.stdout:==================================================================================================== 2023-09-12T16:03:55.555 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2023-09-12T16:03:55.555 INFO:teuthology.orchestra.run.smithi112.stdout:==================================================================================================== 2023-09-12T16:03:55.555 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2023-09-12T16:03:55.556 INFO:teuthology.orchestra.run.smithi112.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-09-12T16:03:55.556 INFO:teuthology.orchestra.run.smithi112.stdout: ceph x86_64 2:18.0.0-6088.g2110e007.el8 ceph 6.4 k 2023-09-12T16:03:55.556 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base x86_64 2:18.0.0-6088.g2110e007.el8 ceph 5.4 M 2023-09-12T16:03:55.556 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse x86_64 2:18.0.0-6088.g2110e007.el8 ceph 907 k 2023-09-12T16:03:55.556 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6088.g2110e007.el8 ceph 167 k 2023-09-12T16:03:55.557 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr x86_64 2:18.0.0-6088.g2110e007.el8 ceph 1.6 M 2023-09-12T16:03:55.557 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6088.g2110e007.el8 ceph-noarch 132 k 2023-09-12T16:03:55.557 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6088.g2110e007.el8 ceph-noarch 1.7 M 2023-09-12T16:03:55.557 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6088.g2110e007.el8 ceph-noarch 7.4 M 2023-09-12T16:03:55.558 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook noarch 2:18.0.0-6088.g2110e007.el8 ceph-noarch 47 k 2023-09-12T16:03:55.558 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw x86_64 2:18.0.0-6088.g2110e007.el8 ceph 14 M 2023-09-12T16:03:55.558 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test x86_64 2:18.0.0-6088.g2110e007.el8 ceph 49 M 2023-09-12T16:03:55.558 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume noarch 2:18.0.0-6088.g2110e007.el8 ceph-noarch 261 k 2023-09-12T16:03:55.558 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm noarch 2:18.0.0-6088.g2110e007.el8 ceph-noarch 177 k 2023-09-12T16:03:55.559 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror x86_64 2:18.0.0-6088.g2110e007.el8 ceph 261 k 2023-09-12T16:03:55.559 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top noarch 2:18.0.0-6088.g2110e007.el8 ceph-noarch 18 k 2023-09-12T16:03:55.559 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-09-12T16:03:55.559 INFO:teuthology.orchestra.run.smithi112.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-09-12T16:03:55.560 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-09-12T16:03:55.560 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel x86_64 2:18.0.0-6088.g2110e007.el8 ceph 31 k 2023-09-12T16:03:55.560 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2 x86_64 2:18.0.0-6088.g2110e007.el8 ceph 827 k 2023-09-12T16:03:55.561 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel x86_64 2:18.0.0-6088.g2110e007.el8 ceph 139 k 2023-09-12T16:03:55.561 INFO:teuthology.orchestra.run.smithi112.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-09-12T16:03:55.561 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel x86_64 2.32.1-43.el8 baseos 100 k 2023-09-12T16:03:55.562 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-09-12T16:03:55.562 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql x86_64 10.23-2.module_el8+572+929c87ac appstream 1.6 M 2023-09-12T16:03:55.562 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-contrib x86_64 10.23-2.module_el8+572+929c87ac appstream 901 k 2023-09-12T16:03:55.562 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-server x86_64 10.23-2.module_el8+572+929c87ac appstream 5.1 M 2023-09-12T16:03:55.563 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs x86_64 2:18.0.0-6088.g2110e007.el8 ceph 197 k 2023-09-12T16:03:55.563 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados x86_64 2:18.0.0-6088.g2110e007.el8 ceph 371 k 2023-09-12T16:03:55.563 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd x86_64 2:18.0.0-6088.g2110e007.el8 ceph 364 k 2023-09-12T16:03:55.563 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw x86_64 2:18.0.0-6088.g2110e007.el8 ceph 106 k 2023-09-12T16:03:55.563 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse x86_64 2:18.0.0-6088.g2110e007.el8 ceph 94 k 2023-09-12T16:03:55.564 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror x86_64 2:18.0.0-6088.g2110e007.el8 ceph 3.6 M 2023-09-12T16:03:55.564 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd x86_64 2:18.0.0-6088.g2110e007.el8 ceph 179 k 2023-09-12T16:03:55.564 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-09-12T16:03:55.564 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrading: 2023-09-12T16:03:55.564 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-09-12T16:03:55.565 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-09-12T16:03:55.565 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-09-12T16:03:55.565 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-09-12T16:03:55.565 INFO:teuthology.orchestra.run.smithi112.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-09-12T16:03:55.565 INFO:teuthology.orchestra.run.smithi112.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-09-12T16:03:55.566 INFO:teuthology.orchestra.run.smithi112.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-09-12T16:03:55.566 INFO:teuthology.orchestra.run.smithi112.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-09-12T16:03:55.566 INFO:teuthology.orchestra.run.smithi112.stdout: librados2 x86_64 2:18.0.0-6088.g2110e007.el8 ceph 3.7 M 2023-09-12T16:03:55.566 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1 x86_64 2:18.0.0-6088.g2110e007.el8 ceph 3.7 M 2023-09-12T16:03:55.567 INFO:teuthology.orchestra.run.smithi112.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-09-12T16:03:55.567 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-09-12T16:03:55.567 INFO:teuthology.orchestra.run.smithi112.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-09-12T16:03:55.567 INFO:teuthology.orchestra.run.smithi112.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-09-12T16:03:55.567 INFO:teuthology.orchestra.run.smithi112.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-09-12T16:03:55.568 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-09-12T16:03:55.568 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2023-09-12T16:03:55.568 INFO:teuthology.orchestra.run.smithi112.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2023-09-12T16:03:55.568 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common x86_64 2:18.0.0-6088.g2110e007.el8 ceph 22 M 2023-09-12T16:03:55.568 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6088.g2110e007.el8 ceph-noarch 23 k 2023-09-12T16:03:55.569 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds x86_64 2:18.0.0-6088.g2110e007.el8 ceph 2.3 M 2023-09-12T16:03:55.569 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6088.g2110e007.el8 ceph-noarch 242 k 2023-09-12T16:03:55.569 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon x86_64 2:18.0.0-6088.g2110e007.el8 ceph 4.6 M 2023-09-12T16:03:55.569 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd x86_64 2:18.0.0-6088.g2110e007.el8 ceph 18 M 2023-09-12T16:03:55.569 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6088.g2110e007.el8 ceph-noarch 15 k 2023-09-12T16:03:55.569 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux x86_64 2:18.0.0-6088.g2110e007.el8 ceph 24 k 2023-09-12T16:03:55.570 INFO:teuthology.orchestra.run.smithi112.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-09-12T16:03:55.570 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-12T16:03:55.570 INFO:teuthology.orchestra.run.smithi112.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-09-12T16:03:55.570 INFO:teuthology.orchestra.run.smithi112.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-09-12T16:03:55.571 INFO:teuthology.orchestra.run.smithi112.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-09-12T16:03:55.571 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite x86_64 2:18.0.0-6088.g2110e007.el8 ceph 184 k 2023-09-12T16:03:55.571 INFO:teuthology.orchestra.run.smithi112.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-09-12T16:03:55.571 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-09-12T16:03:55.571 INFO:teuthology.orchestra.run.smithi112.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-12T16:03:55.572 INFO:teuthology.orchestra.run.smithi112.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-09-12T16:03:55.572 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-09-12T16:03:55.572 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-09-12T16:03:55.572 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 x86_64 2:18.0.0-6088.g2110e007.el8 ceph 519 k 2023-09-12T16:03:55.572 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-09-12T16:03:55.573 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2 x86_64 2:18.0.0-6088.g2110e007.el8 ceph 6.8 M 2023-09-12T16:03:55.573 INFO:teuthology.orchestra.run.smithi112.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-09-12T16:03:55.573 INFO:teuthology.orchestra.run.smithi112.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-09-12T16:03:55.573 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-12T16:03:55.573 INFO:teuthology.orchestra.run.smithi112.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-09-12T16:03:55.574 INFO:teuthology.orchestra.run.smithi112.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-09-12T16:03:55.574 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-09-12T16:03:55.574 INFO:teuthology.orchestra.run.smithi112.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-09-12T16:03:55.574 INFO:teuthology.orchestra.run.smithi112.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-09-12T16:03:55.575 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-09-12T16:03:55.575 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-09-12T16:03:55.575 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-09-12T16:03:55.575 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-09-12T16:03:55.575 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-12T16:03:55.576 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-09-12T16:03:55.576 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-12T16:03:55.576 INFO:teuthology.orchestra.run.smithi112.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-12T16:03:55.576 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-12T16:03:55.576 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse x86_64 2:18.0.0-6088.g2110e007.el8 ceph 45 k 2023-09-12T16:03:55.577 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common x86_64 2:18.0.0-6088.g2110e007.el8 ceph 125 k 2023-09-12T16:03:55.577 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-12T16:03:55.577 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-09-12T16:03:55.577 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-12T16:03:55.577 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-12T16:03:55.578 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-09-12T16:03:55.578 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-12T16:03:55.578 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-12T16:03:55.578 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-12T16:03:55.578 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-09-12T16:03:55.579 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-09-12T16:03:55.579 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-09-12T16:03:55.579 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-09-12T16:03:55.579 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-12T16:03:55.580 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-12T16:03:55.580 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-09-12T16:03:55.580 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-09-12T16:03:55.581 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-12T16:03:55.581 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-12T16:03:55.581 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-09-12T16:03:55.581 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-09-12T16:03:55.581 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-09-12T16:03:55.582 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-12T16:03:55.582 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-12T16:03:55.582 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-09-12T16:03:55.582 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-09-12T16:03:55.583 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-09-12T16:03:55.583 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-09-12T16:03:55.583 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-09-12T16:03:55.583 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-09-12T16:03:55.583 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-12T16:03:55.584 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-09-12T16:03:55.584 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-12T16:03:55.584 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-12T16:03:55.584 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-09-12T16:03:55.584 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-12T16:03:55.585 INFO:teuthology.orchestra.run.smithi112.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-12T16:03:55.585 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-12T16:03:55.585 INFO:teuthology.orchestra.run.smithi112.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-12T16:03:55.585 INFO:teuthology.orchestra.run.smithi112.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-12T16:03:55.585 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-12T16:03:55.586 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-12T16:03:55.586 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-12T16:03:55.586 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-09-12T16:03:55.586 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-12T16:03:55.586 INFO:teuthology.orchestra.run.smithi112.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-09-12T16:03:55.587 INFO:teuthology.orchestra.run.smithi112.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-12T16:03:55.587 INFO:teuthology.orchestra.run.smithi112.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-09-12T16:03:55.587 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-09-12T16:03:55.587 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-09-12T16:03:55.587 INFO:teuthology.orchestra.run.smithi112.stdout:Enabling module streams: 2023-09-12T16:03:55.588 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql 10 2023-09-12T16:03:55.588 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:03:55.588 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2023-09-12T16:03:55.588 INFO:teuthology.orchestra.run.smithi112.stdout:==================================================================================================== 2023-09-12T16:03:55.588 INFO:teuthology.orchestra.run.smithi112.stdout:Install 128 Packages 2023-09-12T16:03:55.589 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrade 16 Packages 2023-09-12T16:03:55.589 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:03:55.590 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 214 M 2023-09-12T16:03:55.590 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2023-09-12T16:03:55.613 INFO:teuthology.orchestra.run.smithi144.stdout:(10/144): ceph-radosgw-18.0.0-6088.g2110e007.el 8.6 MB/s | 14 MB 00:01 2023-09-12T16:03:55.805 INFO:teuthology.orchestra.run.smithi144.stdout:(11/144): ceph-osd-18.0.0-6088.g2110e007.el8.x8 8.1 MB/s | 18 MB 00:02 2023-09-12T16:03:55.830 INFO:teuthology.orchestra.run.smithi144.stdout:(12/144): cephfs-mirror-18.0.0-6088.g2110e007.e 1.2 MB/s | 261 kB 00:00 2023-09-12T16:03:55.864 INFO:teuthology.orchestra.run.smithi144.stdout:(13/144): libcephfs-devel-18.0.0-6088.g2110e007 533 kB/s | 31 kB 00:00 2023-09-12T16:03:55.948 INFO:teuthology.orchestra.run.smithi144.stdout:(14/144): libcephsqlite-18.0.0-6088.g2110e007.e 2.2 MB/s | 184 kB 00:00 2023-09-12T16:03:55.989 INFO:teuthology.orchestra.run.smithi144.stdout:(15/144): libcephfs2-18.0.0-6088.g2110e007.el8. 5.1 MB/s | 827 kB 00:00 2023-09-12T16:03:56.031 INFO:teuthology.orchestra.run.smithi144.stdout:(16/144): librados-devel-18.0.0-6088.g2110e007. 1.6 MB/s | 139 kB 00:00 2023-09-12T16:03:56.053 INFO:teuthology.orchestra.run.smithi112.stdout:(1/144): ceph-18.0.0-6088.g2110e007.el8.x86_64. 42 kB/s | 6.4 kB 00:00 2023-09-12T16:03:56.090 INFO:teuthology.orchestra.run.smithi144.stdout:(17/144): libradosstriper1-18.0.0-6088.g2110e00 5.1 MB/s | 519 kB 00:00 2023-09-12T16:03:56.182 INFO:teuthology.orchestra.run.smithi144.stdout:(18/144): python3-ceph-argparse-18.0.0-6088.g21 489 kB/s | 45 kB 00:00 2023-09-12T16:03:56.282 INFO:teuthology.orchestra.run.smithi144.stdout:(19/144): python3-ceph-common-18.0.0-6088.g2110 1.2 MB/s | 125 kB 00:00 2023-09-12T16:03:56.383 INFO:teuthology.orchestra.run.smithi144.stdout:(20/144): python3-cephfs-18.0.0-6088.g2110e007. 1.9 MB/s | 197 kB 00:00 2023-09-12T16:03:56.499 INFO:teuthology.orchestra.run.smithi144.stdout:(21/144): python3-rados-18.0.0-6088.g2110e007.e 3.1 MB/s | 371 kB 00:00 2023-09-12T16:03:56.625 INFO:teuthology.orchestra.run.smithi144.stdout:(22/144): python3-rbd-18.0.0-6088.g2110e007.el8 2.9 MB/s | 364 kB 00:00 2023-09-12T16:03:56.725 INFO:teuthology.orchestra.run.smithi144.stdout:(23/144): python3-rgw-18.0.0-6088.g2110e007.el8 1.0 MB/s | 106 kB 00:00 2023-09-12T16:03:56.842 INFO:teuthology.orchestra.run.smithi144.stdout:(24/144): rbd-fuse-18.0.0-6088.g2110e007.el8.x8 804 kB/s | 94 kB 00:00 2023-09-12T16:03:56.878 INFO:teuthology.orchestra.run.smithi112.stdout:(2/144): ceph-fuse-18.0.0-6088.g2110e007.el8.x8 1.1 MB/s | 907 kB 00:00 2023-09-12T16:03:56.926 INFO:teuthology.orchestra.run.smithi144.stdout:(25/144): librgw2-18.0.0-6088.g2110e007.el8.x86 7.6 MB/s | 6.8 MB 00:00 2023-09-12T16:03:56.978 INFO:teuthology.orchestra.run.smithi112.stdout:(3/144): ceph-immutable-object-cache-18.0.0-608 1.6 MB/s | 167 kB 00:00 2023-09-12T16:03:57.042 INFO:teuthology.orchestra.run.smithi144.stdout:(26/144): rbd-nbd-18.0.0-6088.g2110e007.el8.x86 1.5 MB/s | 179 kB 00:00 2023-09-12T16:03:57.151 INFO:teuthology.orchestra.run.smithi144.stdout:(27/144): ceph-grafana-dashboards-18.0.0-6088.g 213 kB/s | 23 kB 00:00 2023-09-12T16:03:57.268 INFO:teuthology.orchestra.run.smithi144.stdout:(28/144): ceph-mgr-cephadm-18.0.0-6088.g2110e00 1.1 MB/s | 132 kB 00:00 2023-09-12T16:03:57.335 INFO:teuthology.orchestra.run.smithi144.stdout:(29/144): rbd-mirror-18.0.0-6088.g2110e007.el8. 7.3 MB/s | 3.6 MB 00:00 2023-09-12T16:03:57.611 INFO:teuthology.orchestra.run.smithi144.stdout:(30/144): ceph-mgr-dashboard-18.0.0-6088.g2110e 5.1 MB/s | 1.7 MB 00:00 2023-09-12T16:03:57.712 INFO:teuthology.orchestra.run.smithi144.stdout:(31/144): ceph-mgr-modules-core-18.0.0-6088.g21 2.4 MB/s | 242 kB 00:00 2023-09-12T16:03:57.803 INFO:teuthology.orchestra.run.smithi144.stdout:(32/144): ceph-mgr-rook-18.0.0-6088.g2110e007.e 517 kB/s | 47 kB 00:00 2023-09-12T16:03:57.887 INFO:teuthology.orchestra.run.smithi144.stdout:(33/144): ceph-prometheus-alerts-18.0.0-6088.g2 174 kB/s | 15 kB 00:00 2023-09-12T16:03:57.995 INFO:teuthology.orchestra.run.smithi144.stdout:(34/144): ceph-volume-18.0.0-6088.g2110e007.el8 2.4 MB/s | 261 kB 00:00 2023-09-12T16:03:58.104 INFO:teuthology.orchestra.run.smithi144.stdout:(35/144): cephadm-18.0.0-6088.g2110e007.el8.noa 1.6 MB/s | 177 kB 00:00 2023-09-12T16:03:58.204 INFO:teuthology.orchestra.run.smithi144.stdout:(36/144): cephfs-top-18.0.0-6088.g2110e007.el8. 180 kB/s | 18 kB 00:00 2023-09-12T16:03:58.321 INFO:teuthology.orchestra.run.smithi144.stdout:(37/144): automake-1.16.1-8.el8.noarch.rpm 6.2 MB/s | 740 kB 00:00 2023-09-12T16:03:58.387 INFO:teuthology.orchestra.run.smithi112.stdout:(4/144): ceph-mds-18.0.0-6088.g2110e007.el8.x86 1.7 MB/s | 2.3 MB 00:01 2023-09-12T16:03:58.422 INFO:teuthology.orchestra.run.smithi144.stdout:(38/144): bison-3.0.4-10.el8.x86_64.rpm 6.7 MB/s | 688 kB 00:00 2023-09-12T16:03:58.514 INFO:teuthology.orchestra.run.smithi144.stdout:(39/144): ceph-mgr-diskprediction-local-18.0.0- 6.3 MB/s | 7.4 MB 00:01 2023-09-12T16:03:58.564 INFO:teuthology.orchestra.run.smithi144.stdout:(40/144): flex-2.6.1-9.el8.x86_64.rpm 2.2 MB/s | 320 kB 00:00 2023-09-12T16:03:58.614 INFO:teuthology.orchestra.run.smithi144.stdout:(41/144): libpq-13.5-1.el8.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2023-09-12T16:03:58.648 INFO:teuthology.orchestra.run.smithi144.stdout:(42/144): librdkafka-0.11.4-3.el8.x86_64.rpm 10 MB/s | 354 kB 00:00 2023-09-12T16:03:58.665 INFO:teuthology.orchestra.run.smithi144.stdout:(43/144): jq-1.6-7.el8.x86_64.rpm 1.3 MB/s | 202 kB 00:00 2023-09-12T16:03:58.862 INFO:teuthology.orchestra.run.smithi112.stdout:(5/144): ceph-base-18.0.0-6088.g2110e007.el8.x8 1.8 MB/s | 5.4 MB 00:02 2023-09-12T16:03:58.965 INFO:teuthology.orchestra.run.smithi112.stdout:(6/144): ceph-mgr-18.0.0-6088.g2110e007.el8.x86 2.8 MB/s | 1.6 MB 00:00 2023-09-12T16:03:59.240 INFO:teuthology.orchestra.run.smithi144.stdout:(44/144): ceph-test-18.0.0-6088.g2110e007.el8.x 12 MB/s | 49 MB 00:04 2023-09-12T16:03:59.266 INFO:teuthology.orchestra.run.smithi144.stdout:(45/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 432 kB/s | 259 kB 00:00 2023-09-12T16:03:59.299 INFO:teuthology.orchestra.run.smithi144.stdout:(46/144): libtool-2.4.6-25.el8.x86_64.rpm 1.1 MB/s | 709 kB 00:00 2023-09-12T16:03:59.350 INFO:teuthology.orchestra.run.smithi144.stdout:(47/144): oniguruma-6.8.2-2.el8.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2023-09-12T16:03:59.412 INFO:teuthology.orchestra.run.smithi112.stdout:(7/144): ceph-mon-18.0.0-6088.g2110e007.el8.x86 8.4 MB/s | 4.6 MB 00:00 2023-09-12T16:03:59.450 INFO:teuthology.orchestra.run.smithi144.stdout:(48/144): openblas-0.3.15-4.el8.x86_64.rpm 26 MB/s | 4.7 MB 00:00 2023-09-12T16:03:59.500 INFO:teuthology.orchestra.run.smithi144.stdout:(49/144): postgresql-10.23-2.module_el8+572+929 10 MB/s | 1.6 MB 00:00 2023-09-12T16:03:59.559 INFO:teuthology.orchestra.run.smithi144.stdout:(50/144): openblas-threads-0.3.15-4.el8.x86_64. 19 MB/s | 4.9 MB 00:00 2023-09-12T16:03:59.609 INFO:teuthology.orchestra.run.smithi144.stdout:(51/144): postgresql-contrib-10.23-2.module_el8 5.5 MB/s | 901 kB 00:00 2023-09-12T16:03:59.651 INFO:teuthology.orchestra.run.smithi144.stdout:(52/144): python3-jinja2-2.10.1-3.el8.noarch.rp 13 MB/s | 538 kB 00:00 2023-09-12T16:03:59.717 INFO:teuthology.orchestra.run.smithi144.stdout:(53/144): python3-jsonpatch-1.21-2.el8.noarch.r 405 kB/s | 27 kB 00:00 2023-09-12T16:03:59.752 INFO:teuthology.orchestra.run.smithi144.stdout:(54/144): python3-jsonpointer-1.10-11.el8.noarc 585 kB/s | 20 kB 00:00 2023-09-12T16:03:59.827 INFO:teuthology.orchestra.run.smithi144.stdout:(55/144): postgresql-server-10.23-2.module_el8+ 16 MB/s | 5.1 MB 00:00 2023-09-12T16:03:59.852 INFO:teuthology.orchestra.run.smithi144.stdout:(56/144): python3-mako-1.0.6-14.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2023-09-12T16:03:59.877 INFO:teuthology.orchestra.run.smithi144.stdout:(57/144): python3-markupsafe-0.23-19.el8.x86_64 777 kB/s | 39 kB 00:00 2023-09-12T16:03:59.961 INFO:teuthology.orchestra.run.smithi144.stdout:(58/144): python3-babel-2.5.1-7.el8.noarch.rpm 12 MB/s | 4.8 MB 00:00 2023-09-12T16:03:59.986 INFO:teuthology.orchestra.run.smithi144.stdout:(59/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.0 MB/s | 225 kB 00:00 2023-09-12T16:04:00.012 INFO:teuthology.orchestra.run.smithi144.stdout:(60/144): python3-prettytable-0.7.2-14.el8.noar 877 kB/s | 44 kB 00:00 2023-09-12T16:04:00.037 INFO:teuthology.orchestra.run.smithi144.stdout:(61/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-09-12T16:04:00.071 INFO:teuthology.orchestra.run.smithi144.stdout:(62/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2023-09-12T16:04:00.096 INFO:teuthology.orchestra.run.smithi112.stdout:(8/144): ceph-common-18.0.0-6088.g2110e007.el8. 5.3 MB/s | 22 MB 00:04 2023-09-12T16:04:00.097 INFO:teuthology.orchestra.run.smithi144.stdout:(63/144): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-09-12T16:04:00.121 INFO:teuthology.orchestra.run.smithi144.stdout:(64/144): python3-pytz-2017.2-11.el8.noarch.rpm 1.1 MB/s | 57 kB 00:00 2023-09-12T16:04:00.146 INFO:teuthology.orchestra.run.smithi112.stdout:(9/144): ceph-selinux-18.0.0-6088.g2110e007.el8 491 kB/s | 24 kB 00:00 2023-09-12T16:04:00.164 INFO:teuthology.orchestra.run.smithi144.stdout:(65/144): python3-werkzeug-0.12.2-4.el8.noarch. 11 MB/s | 457 kB 00:00 2023-09-12T16:04:00.239 INFO:teuthology.orchestra.run.smithi144.stdout:(66/144): python3-numpy-1.14.3-10.el8.x86_64.rp 9.7 MB/s | 3.7 MB 00:00 2023-09-12T16:04:00.264 INFO:teuthology.orchestra.run.smithi144.stdout:(67/144): socat-1.7.4.1-1.el8.x86_64.rpm 3.1 MB/s | 323 kB 00:00 2023-09-12T16:04:00.289 INFO:teuthology.orchestra.run.smithi144.stdout:(68/144): uuid-1.6.2-43.el8.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2023-09-12T16:04:00.323 INFO:teuthology.orchestra.run.smithi144.stdout:(69/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2023-09-12T16:04:00.505 INFO:teuthology.orchestra.run.smithi112.stdout:(10/144): ceph-radosgw-18.0.0-6088.g2110e007.el 13 MB/s | 14 MB 00:01 2023-09-12T16:04:00.532 INFO:teuthology.orchestra.run.smithi144.stdout:(70/144): python3-scipy-1.0.0-21.module_el8.5.0 31 MB/s | 14 MB 00:00 2023-09-12T16:04:00.557 INFO:teuthology.orchestra.run.smithi144.stdout:(71/144): elfutils-libelf-devel-0.189-3.el8.x86 231 kB/s | 62 kB 00:00 2023-09-12T16:04:00.571 INFO:teuthology.orchestra.run.smithi112.stdout:(11/144): cephfs-mirror-18.0.0-6088.g2110e007.e 3.8 MB/s | 261 kB 00:00 2023-09-12T16:04:00.582 INFO:teuthology.orchestra.run.smithi144.stdout:(72/144): fuse-2.9.7-17.el8.x86_64.rpm 321 kB/s | 83 kB 00:00 2023-09-12T16:04:00.638 INFO:teuthology.orchestra.run.smithi112.stdout:(12/144): libcephfs-devel-18.0.0-6088.g2110e007 467 kB/s | 31 kB 00:00 2023-09-12T16:04:00.641 INFO:teuthology.orchestra.run.smithi144.stdout:(73/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 320 kB/s | 19 kB 00:00 2023-09-12T16:04:00.691 INFO:teuthology.orchestra.run.smithi144.stdout:(74/144): libcom_err-devel-1.45.6-5.el8.x86_64. 776 kB/s | 39 kB 00:00 2023-09-12T16:04:00.716 INFO:teuthology.orchestra.run.smithi144.stdout:(75/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 261 kB/s | 48 kB 00:00 2023-09-12T16:04:00.742 INFO:teuthology.orchestra.run.smithi144.stdout:(76/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 3.0 MB/s | 561 kB 00:00 2023-09-12T16:04:00.747 INFO:teuthology.orchestra.run.smithi112.stdout:(13/144): libcephfs2-18.0.0-6088.g2110e007.el8. 7.5 MB/s | 827 kB 00:00 2023-09-12T16:04:00.792 INFO:teuthology.orchestra.run.smithi144.stdout:(77/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 940 kB/s | 47 kB 00:00 2023-09-12T16:04:00.817 INFO:teuthology.orchestra.run.smithi144.stdout:(78/144): libquadmath-8.5.0-20.el8.x86_64.rpm 1.7 MB/s | 172 kB 00:00 2023-09-12T16:04:00.822 INFO:teuthology.orchestra.run.smithi112.stdout:(14/144): libcephsqlite-18.0.0-6088.g2110e007.e 2.4 MB/s | 184 kB 00:00 2023-09-12T16:04:00.876 INFO:teuthology.orchestra.run.smithi144.stdout:(79/144): libgfortran-8.5.0-20.el8.x86_64.rpm 3.4 MB/s | 645 kB 00:00 2023-09-12T16:04:00.889 INFO:teuthology.orchestra.run.smithi112.stdout:(15/144): librados-devel-18.0.0-6088.g2110e007. 2.0 MB/s | 139 kB 00:00 2023-09-12T16:04:00.893 INFO:teuthology.orchestra.run.smithi144.stdout:(80/144): libsepol-devel-2.9-3.el8.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2023-09-12T16:04:00.918 INFO:teuthology.orchestra.run.smithi144.stdout:(81/144): libselinux-devel-2.9-8.el8.x86_64.rpm 1.6 MB/s | 200 kB 00:00 2023-09-12T16:04:00.943 INFO:teuthology.orchestra.run.smithi144.stdout:(82/144): libuuid-devel-2.32.1-43.el8.x86_64.rp 1.5 MB/s | 100 kB 00:00 2023-09-12T16:04:00.960 INFO:teuthology.orchestra.run.smithi144.stdout:(83/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 269 kB/s | 18 kB 00:00 2023-09-12T16:04:00.973 INFO:teuthology.orchestra.run.smithi112.stdout:(16/144): libradosstriper1-18.0.0-6088.g2110e00 6.1 MB/s | 519 kB 00:00 2023-09-12T16:04:00.977 INFO:teuthology.orchestra.run.smithi144.stdout:(84/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 749 kB/s | 44 kB 00:00 2023-09-12T16:04:01.044 INFO:teuthology.orchestra.run.smithi144.stdout:(85/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.4 MB/s | 229 kB 00:00 2023-09-12T16:04:01.078 INFO:teuthology.orchestra.run.smithi144.stdout:(86/144): pcre2-devel-10.32-3.el8.x86_64.rpm 5.1 MB/s | 605 kB 00:00 2023-09-12T16:04:01.145 INFO:teuthology.orchestra.run.smithi144.stdout:(87/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 16 MB/s | 3.2 MB 00:00 2023-09-12T16:04:01.170 INFO:teuthology.orchestra.run.smithi144.stdout:(88/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2023-09-12T16:04:01.195 INFO:teuthology.orchestra.run.smithi144.stdout:(89/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.1 MB/s | 249 kB 00:00 2023-09-12T16:04:01.237 INFO:teuthology.orchestra.run.smithi144.stdout:(90/144): python3-cryptography-3.2.1-6.el8.x86_ 6.8 MB/s | 641 kB 00:00 2023-09-12T16:04:01.263 INFO:teuthology.orchestra.run.smithi144.stdout:(91/144): python3-jwt-1.6.1-2.el8.noarch.rpm 461 kB/s | 43 kB 00:00 2023-09-12T16:04:01.288 INFO:teuthology.orchestra.run.smithi144.stdout:(92/144): python3-oauthlib-2.1.0-1.el8.noarch.r 1.6 MB/s | 155 kB 00:00 2023-09-12T16:04:01.313 INFO:teuthology.orchestra.run.smithi144.stdout:(93/144): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2023-09-12T16:04:01.338 INFO:teuthology.orchestra.run.smithi144.stdout:(94/144): python3-requests-oauthlib-1.0.0-1.el8 565 kB/s | 43 kB 00:00 2023-09-12T16:04:01.364 INFO:teuthology.orchestra.run.smithi144.stdout:(95/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 990 kB/s | 74 kB 00:00 2023-09-12T16:04:01.389 INFO:teuthology.orchestra.run.smithi144.stdout:(96/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 768 kB/s | 58 kB 00:00 2023-09-12T16:04:01.440 INFO:teuthology.orchestra.run.smithi112.stdout:(17/144): librgw2-18.0.0-6088.g2110e007.el8.x86 15 MB/s | 6.8 MB 00:00 2023-09-12T16:04:01.507 INFO:teuthology.orchestra.run.smithi112.stdout:(18/144): python3-ceph-argparse-18.0.0-6088.g21 673 kB/s | 45 kB 00:00 2023-09-12T16:04:01.566 INFO:teuthology.orchestra.run.smithi112.stdout:(19/144): python3-ceph-common-18.0.0-6088.g2110 2.1 MB/s | 125 kB 00:00 2023-09-12T16:04:01.616 INFO:teuthology.orchestra.run.smithi112.stdout:(20/144): python3-cephfs-18.0.0-6088.g2110e007. 3.8 MB/s | 197 kB 00:00 2023-09-12T16:04:01.683 INFO:teuthology.orchestra.run.smithi112.stdout:(21/144): python3-rados-18.0.0-6088.g2110e007.e 5.4 MB/s | 371 kB 00:00 2023-09-12T16:04:01.758 INFO:teuthology.orchestra.run.smithi112.stdout:(22/144): python3-rbd-18.0.0-6088.g2110e007.el8 4.8 MB/s | 364 kB 00:00 2023-09-12T16:04:01.825 INFO:teuthology.orchestra.run.smithi112.stdout:(23/144): python3-rgw-18.0.0-6088.g2110e007.el8 1.6 MB/s | 106 kB 00:00 2023-09-12T16:04:01.892 INFO:teuthology.orchestra.run.smithi112.stdout:(24/144): rbd-fuse-18.0.0-6088.g2110e007.el8.x8 1.4 MB/s | 94 kB 00:00 2023-09-12T16:04:01.940 INFO:teuthology.orchestra.run.smithi144.stdout:(97/144): liboath-2.6.2-3.el8.x86_64.rpm 102 kB/s | 59 kB 00:00 2023-09-12T16:04:01.965 INFO:teuthology.orchestra.run.smithi144.stdout:(98/144): libunwind-1.3.1-3.el8.x86_64.rpm 130 kB/s | 75 kB 00:00 2023-09-12T16:04:02.082 INFO:teuthology.orchestra.run.smithi144.stdout:(99/144): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 374 kB/s | 44 kB 00:00 2023-09-12T16:04:02.142 INFO:teuthology.orchestra.run.smithi112.stdout:(25/144): rbd-mirror-18.0.0-6088.g2110e007.el8. 14 MB/s | 3.6 MB 00:00 2023-09-12T16:04:02.209 INFO:teuthology.orchestra.run.smithi112.stdout:(26/144): rbd-nbd-18.0.0-6088.g2110e007.el8.x86 2.6 MB/s | 179 kB 00:00 2023-09-12T16:04:02.268 INFO:teuthology.orchestra.run.smithi112.stdout:(27/144): ceph-grafana-dashboards-18.0.0-6088.g 395 kB/s | 23 kB 00:00 2023-09-12T16:04:02.291 INFO:teuthology.orchestra.run.smithi144.stdout:(100/144): gperftools-libs-2.7-9.el8.x86_64.rpm 322 kB/s | 306 kB 00:00 2023-09-12T16:04:02.351 INFO:teuthology.orchestra.run.smithi112.stdout:(28/144): ceph-mgr-cephadm-18.0.0-6088.g2110e00 1.6 MB/s | 132 kB 00:00 2023-09-12T16:04:02.374 INFO:teuthology.orchestra.run.smithi144.stdout:(101/144): python3-beautifulsoup4-4.6.3-2.el8.1 634 kB/s | 185 kB 00:00 2023-09-12T16:04:02.407 INFO:teuthology.orchestra.run.smithi144.stdout:(102/144): python3-cachetools-3.1.1-4.el8.noarc 283 kB/s | 33 kB 00:00 2023-09-12T16:04:02.508 INFO:teuthology.orchestra.run.smithi144.stdout:(103/144): python3-certifi-2018.10.15-7.el8.noa 122 kB/s | 16 kB 00:00 2023-09-12T16:04:02.519 INFO:teuthology.orchestra.run.smithi112.stdout:(29/144): ceph-mgr-dashboard-18.0.0-6088.g2110e 10 MB/s | 1.7 MB 00:00 2023-09-12T16:04:02.591 INFO:teuthology.orchestra.run.smithi144.stdout:(104/144): python3-asyncssh-2.7.0-2.el8.noarch. 730 kB/s | 476 kB 00:00 2023-09-12T16:04:02.842 INFO:teuthology.orchestra.run.smithi144.stdout:(105/144): python3-cheroot-8.5.2-1.el8.noarch.r 398 kB/s | 173 kB 00:00 2023-09-12T16:04:02.867 INFO:teuthology.orchestra.run.smithi144.stdout:(106/144): python3-google-auth-1.1.1-10.el8.noa 295 kB/s | 81 kB 00:00 2023-09-12T16:04:02.960 INFO:teuthology.orchestra.run.smithi144.stdout:(107/144): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2023-09-12T16:04:02.985 INFO:teuthology.orchestra.run.smithi144.stdout:(108/144): python3-jaraco-functools-2.0-4.el8.n 150 kB/s | 18 kB 00:00 2023-09-12T16:04:03.003 INFO:teuthology.orchestra.run.smithi112.stdout:(30/144): ceph-osd-18.0.0-6088.g2110e007.el8.x8 4.4 MB/s | 18 MB 00:04 2023-09-12T16:04:03.068 INFO:teuthology.orchestra.run.smithi144.stdout:(109/144): python3-cherrypy-18.4.0-1.el8.noarch 687 kB/s | 384 kB 00:00 2023-09-12T16:04:03.101 INFO:teuthology.orchestra.run.smithi144.stdout:(110/144): python3-logutils-0.3.5-11.el8.noarch 417 kB/s | 49 kB 00:00 2023-09-12T16:04:03.103 INFO:teuthology.orchestra.run.smithi112.stdout:(31/144): ceph-mgr-diskprediction-local-18.0.0- 13 MB/s | 7.4 MB 00:00 2023-09-12T16:04:03.128 INFO:teuthology.orchestra.run.smithi112.stdout:(32/144): ceph-mgr-modules-core-18.0.0-6088.g21 1.9 MB/s | 242 kB 00:00 2023-09-12T16:04:03.162 INFO:teuthology.orchestra.run.smithi112.stdout:(33/144): ceph-mgr-rook-18.0.0-6088.g2110e007.e 813 kB/s | 47 kB 00:00 2023-09-12T16:04:03.186 INFO:teuthology.orchestra.run.smithi144.stdout:(111/144): python3-more-itertools-7.2.0-3.el8.n 502 kB/s | 59 kB 00:00 2023-09-12T16:04:03.187 INFO:teuthology.orchestra.run.smithi112.stdout:(34/144): ceph-prometheus-alerts-18.0.0-6088.g2 248 kB/s | 15 kB 00:00 2023-09-12T16:04:03.219 INFO:teuthology.orchestra.run.smithi144.stdout:(112/144): python3-natsort-7.1.1-2.el8.noarch.r 515 kB/s | 60 kB 00:00 2023-09-12T16:04:03.238 INFO:teuthology.orchestra.run.smithi112.stdout:(35/144): ceph-volume-18.0.0-6088.g2110e007.el8 3.4 MB/s | 261 kB 00:00 2023-09-12T16:04:03.264 INFO:teuthology.orchestra.run.smithi112.stdout:(36/144): cephadm-18.0.0-6088.g2110e007.el8.noa 2.3 MB/s | 177 kB 00:00 2023-09-12T16:04:03.288 INFO:teuthology.orchestra.run.smithi112.stdout:(37/144): cephfs-top-18.0.0-6088.g2110e007.el8. 359 kB/s | 18 kB 00:00 2023-09-12T16:04:03.336 INFO:teuthology.orchestra.run.smithi144.stdout:(113/144): python3-portend-2.6-1.el8.noarch.rpm 134 kB/s | 16 kB 00:00 2023-09-12T16:04:03.388 INFO:teuthology.orchestra.run.smithi112.stdout:(38/144): bison-3.0.4-10.el8.x86_64.rpm 6.7 MB/s | 688 kB 00:00 2023-09-12T16:04:03.422 INFO:teuthology.orchestra.run.smithi112.stdout:(39/144): automake-1.16.1-8.el8.noarch.rpm 4.6 MB/s | 740 kB 00:00 2023-09-12T16:04:03.447 INFO:teuthology.orchestra.run.smithi112.stdout:(40/144): flex-2.6.1-9.el8.x86_64.rpm 5.3 MB/s | 320 kB 00:00 2023-09-12T16:04:03.453 INFO:teuthology.orchestra.run.smithi144.stdout:(114/144): python3-repoze-lru-0.7-6.el8.noarch. 288 kB/s | 34 kB 00:00 2023-09-12T16:04:03.466 INFO:teuthology.orchestra.run.smithi112.stdout:(41/144): jq-1.6-7.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-09-12T16:04:03.489 INFO:teuthology.orchestra.run.smithi112.stdout:(42/144): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-09-12T16:04:03.514 INFO:teuthology.orchestra.run.smithi112.stdout:(43/144): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-09-12T16:04:03.549 INFO:teuthology.orchestra.run.smithi112.stdout:(44/144): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-09-12T16:04:03.570 INFO:teuthology.orchestra.run.smithi144.stdout:(115/144): python3-pecan-1.3.2-9.el8.noarch.rpm 736 kB/s | 283 kB 00:00 2023-09-12T16:04:03.573 INFO:teuthology.orchestra.run.smithi112.stdout:(45/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-09-12T16:04:03.599 INFO:teuthology.orchestra.run.smithi112.stdout:(46/144): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-09-12T16:04:03.687 INFO:teuthology.orchestra.run.smithi144.stdout:(116/144): python3-rsa-4.9-2.el8.noarch.rpm 552 kB/s | 64 kB 00:00 2023-09-12T16:04:03.708 INFO:teuthology.orchestra.run.smithi112.stdout:(47/144): openblas-0.3.15-4.el8.x86_64.rpm 35 MB/s | 4.7 MB 00:00 2023-09-12T16:04:03.771 INFO:teuthology.orchestra.run.smithi144.stdout:(117/144): python3-routes-2.4.1-12.el8.noarch.r 619 kB/s | 196 kB 00:00 2023-09-12T16:04:03.787 INFO:teuthology.orchestra.run.smithi144.stdout:(118/144): python3-simplegeneric-0.8.1-17.el8.n 186 kB/s | 19 kB 00:00 2023-09-12T16:04:03.799 INFO:teuthology.orchestra.run.smithi112.stdout:(48/144): openblas-threads-0.3.15-4.el8.x86_64. 24 MB/s | 4.9 MB 00:00 2023-09-12T16:04:03.850 INFO:teuthology.orchestra.run.smithi112.stdout:(49/144): postgresql-10.23-2.module_el8+572+929 11 MB/s | 1.6 MB 00:00 2023-09-12T16:04:03.880 INFO:teuthology.orchestra.run.smithi144.stdout:(119/144): python3-singledispatch-3.4.0.3-18.el 220 kB/s | 24 kB 00:00 2023-09-12T16:04:03.883 INFO:teuthology.orchestra.run.smithi112.stdout:(50/144): postgresql-contrib-10.23-2.module_el8 11 MB/s | 901 kB 00:00 2023-09-12T16:04:03.897 INFO:teuthology.orchestra.run.smithi144.stdout:(120/144): python3-tempora-1.14.1-5.el8.noarch. 269 kB/s | 29 kB 00:00 2023-09-12T16:04:03.989 INFO:teuthology.orchestra.run.smithi144.stdout:(121/144): python3-trustme-0.6.0-4.el8.noarch.r 254 kB/s | 27 kB 00:00 2023-09-12T16:04:04.000 INFO:teuthology.orchestra.run.smithi112.stdout:(51/144): postgresql-server-10.23-2.module_el8+ 34 MB/s | 5.1 MB 00:00 2023-09-12T16:04:04.109 INFO:teuthology.orchestra.run.smithi112.stdout:(52/144): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2023-09-12T16:04:04.142 INFO:teuthology.orchestra.run.smithi112.stdout:(53/144): python3-jinja2-2.10.1-3.el8.noarch.rp 3.7 MB/s | 538 kB 00:00 2023-09-12T16:04:04.159 INFO:teuthology.orchestra.run.smithi112.stdout:(54/144): python3-jsonpatch-1.21-2.el8.noarch.r 530 kB/s | 27 kB 00:00 2023-09-12T16:04:04.176 INFO:teuthology.orchestra.run.smithi112.stdout:(55/144): python3-jsonpointer-1.10-11.el8.noarc 596 kB/s | 20 kB 00:00 2023-09-12T16:04:04.202 INFO:teuthology.orchestra.run.smithi112.stdout:(56/144): python3-mako-1.0.6-14.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-09-12T16:04:04.235 INFO:teuthology.orchestra.run.smithi112.stdout:(57/144): python3-markupsafe-0.23-19.el8.x86_64 660 kB/s | 39 kB 00:00 2023-09-12T16:04:04.269 INFO:teuthology.orchestra.run.smithi112.stdout:(58/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 6.6 MB/s | 225 kB 00:00 2023-09-12T16:04:04.303 INFO:teuthology.orchestra.run.smithi112.stdout:(59/144): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-09-12T16:04:04.317 INFO:teuthology.orchestra.run.smithi144.stdout:(122/144): python3-waitress-1.4.3-1.el8.noarch. 608 kB/s | 255 kB 00:00 2023-09-12T16:04:04.378 INFO:teuthology.orchestra.run.smithi112.stdout:(60/144): python3-numpy-1.14.3-10.el8.x86_64.rp 21 MB/s | 3.7 MB 00:00 2023-09-12T16:04:04.403 INFO:teuthology.orchestra.run.smithi112.stdout:(61/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.0 MB/s | 103 kB 00:00 2023-09-12T16:04:04.414 INFO:teuthology.orchestra.run.smithi144.stdout:(123/144): python3-webob-1.8.5-1.el8.1.noarch.r 591 kB/s | 251 kB 00:00 2023-09-12T16:04:04.431 INFO:teuthology.orchestra.run.smithi144.stdout:(124/144): python3-websocket-client-0.56.0-5.el 540 kB/s | 61 kB 00:00 2023-09-12T16:04:04.495 INFO:teuthology.orchestra.run.smithi112.stdout:(62/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-09-12T16:04:04.521 INFO:teuthology.orchestra.run.smithi112.stdout:(63/144): python3-pyasn1-modules-0.3.7-6.el8.no 939 kB/s | 110 kB 00:00 2023-09-12T16:04:04.546 INFO:teuthology.orchestra.run.smithi112.stdout:(64/144): python3-pytz-2017.2-11.el8.noarch.rpm 1.1 MB/s | 57 kB 00:00 2023-09-12T16:04:04.548 INFO:teuthology.orchestra.run.smithi144.stdout:(125/144): python3-zc-lockfile-2.0-2.el8.noarch 197 kB/s | 23 kB 00:00 2023-09-12T16:04:04.588 INFO:teuthology.orchestra.run.smithi112.stdout:(65/144): python3-werkzeug-0.12.2-4.el8.noarch. 11 MB/s | 457 kB 00:00 2023-09-12T16:04:04.632 INFO:teuthology.orchestra.run.smithi144.stdout:(126/144): python3-kubernetes-11.0.0-6.el8.noar 714 kB/s | 1.2 MB 00:01 2023-09-12T16:04:04.638 INFO:teuthology.orchestra.run.smithi112.stdout:(66/144): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-09-12T16:04:04.657 INFO:teuthology.orchestra.run.smithi144.stdout:(127/144): python3-webtest-2.0.33-1.el8.noarch. 352 kB/s | 85 kB 00:00 2023-09-12T16:04:04.672 INFO:teuthology.orchestra.run.smithi112.stdout:(67/144): uuid-1.6.2-43.el8.x86_64.rpm 1.9 MB/s | 64 kB 00:00 2023-09-12T16:04:04.731 INFO:teuthology.orchestra.run.smithi112.stdout:(68/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2023-09-12T16:04:04.873 INFO:teuthology.orchestra.run.smithi112.stdout:(69/144): python3-scipy-1.0.0-21.module_el8.5.0 39 MB/s | 14 MB 00:00 2023-09-12T16:04:04.989 INFO:teuthology.orchestra.run.smithi112.stdout:(70/144): elfutils-libelf-devel-0.189-3.el8.x86 239 kB/s | 62 kB 00:00 2023-09-12T16:04:05.015 INFO:teuthology.orchestra.run.smithi112.stdout:(71/144): fuse-2.9.7-17.el8.x86_64.rpm 586 kB/s | 83 kB 00:00 2023-09-12T16:04:05.048 INFO:teuthology.orchestra.run.smithi112.stdout:(72/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 822 kB/s | 48 kB 00:00 2023-09-12T16:04:05.107 INFO:teuthology.orchestra.run.smithi112.stdout:(73/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 321 kB/s | 19 kB 00:00 2023-09-12T16:04:05.141 INFO:teuthology.orchestra.run.smithi112.stdout:(74/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 4.4 MB/s | 561 kB 00:00 2023-09-12T16:04:05.166 INFO:teuthology.orchestra.run.smithi112.stdout:(75/144): libcom_err-devel-1.45.6-5.el8.x86_64. 662 kB/s | 39 kB 00:00 2023-09-12T16:04:05.190 INFO:teuthology.orchestra.run.smithi144.stdout:(128/144): librbd1-18.0.0-6088.g2110e007.el8.x8 7.0 MB/s | 3.7 MB 00:00 2023-09-12T16:04:05.241 INFO:teuthology.orchestra.run.smithi112.stdout:(76/144): libgfortran-8.5.0-20.el8.x86_64.rpm 6.3 MB/s | 645 kB 00:00 2023-09-12T16:04:05.249 INFO:teuthology.orchestra.run.smithi144.stdout:(129/144): librados2-18.0.0-6088.g2110e007.el8. 6.0 MB/s | 3.7 MB 00:00 2023-09-12T16:04:05.266 INFO:teuthology.orchestra.run.smithi112.stdout:(77/144): libquadmath-8.5.0-20.el8.x86_64.rpm 1.7 MB/s | 172 kB 00:00 2023-09-12T16:04:05.300 INFO:teuthology.orchestra.run.smithi112.stdout:(78/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 799 kB/s | 47 kB 00:00 2023-09-12T16:04:05.325 INFO:teuthology.orchestra.run.smithi112.stdout:(79/144): libselinux-devel-2.9-8.el8.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2023-09-12T16:04:05.341 INFO:teuthology.orchestra.run.smithi144.stdout:(130/144): NetworkManager-initscripts-updown-1. 956 kB/s | 143 kB 00:00 2023-09-12T16:04:05.359 INFO:teuthology.orchestra.run.smithi112.stdout:(80/144): libsepol-devel-2.9-3.el8.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2023-09-12T16:04:05.366 INFO:teuthology.orchestra.run.smithi144.stdout:(131/144): elfutils-debuginfod-client-0.189-3.e 650 kB/s | 76 kB 00:00 2023-09-12T16:04:05.376 INFO:teuthology.orchestra.run.smithi112.stdout:(81/144): libuuid-devel-2.32.1-43.el8.x86_64.rp 1.9 MB/s | 100 kB 00:00 2023-09-12T16:04:05.418 INFO:teuthology.orchestra.run.smithi112.stdout:(82/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 309 kB/s | 18 kB 00:00 2023-09-12T16:04:05.425 INFO:teuthology.orchestra.run.smithi144.stdout:(132/144): elfutils-libelf-0.189-3.el8.x86_64.r 2.7 MB/s | 232 kB 00:00 2023-09-12T16:04:05.465 INFO:teuthology.orchestra.run.smithi112.stdout:(83/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 494 kB/s | 44 kB 00:00 2023-09-12T16:04:05.500 INFO:teuthology.orchestra.run.smithi144.stdout:(133/144): elfutils-libs-0.189-3.el8.x86_64.rpm 2.2 MB/s | 303 kB 00:00 2023-09-12T16:04:05.567 INFO:teuthology.orchestra.run.smithi144.stdout:(134/144): libblkid-2.32.1-43.el8.x86_64.rpm 3.3 MB/s | 220 kB 00:00 2023-09-12T16:04:05.601 INFO:teuthology.orchestra.run.smithi144.stdout:(135/144): iproute-6.2.0-2.el8.x86_64.rpm 4.9 MB/s | 880 kB 00:00 2023-09-12T16:04:05.602 INFO:teuthology.orchestra.run.smithi112.stdout:(84/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 17 MB/s | 3.2 MB 00:00 2023-09-12T16:04:05.626 INFO:teuthology.orchestra.run.smithi144.stdout:(136/144): libfdisk-2.32.1-43.el8.x86_64.rpm 4.2 MB/s | 254 kB 00:00 2023-09-12T16:04:05.627 INFO:teuthology.orchestra.run.smithi112.stdout:(85/144): pcre2-devel-10.32-3.el8.x86_64.rpm 3.6 MB/s | 605 kB 00:00 2023-09-12T16:04:05.659 INFO:teuthology.orchestra.run.smithi144.stdout:(137/144): libmount-2.32.1-43.el8.x86_64.rpm 4.0 MB/s | 236 kB 00:00 2023-09-12T16:04:05.660 INFO:teuthology.orchestra.run.smithi112.stdout:(86/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2023-09-12T16:04:05.693 INFO:teuthology.orchestra.run.smithi144.stdout:(138/144): libsmartcols-2.32.1-43.el8.x86_64.rp 2.6 MB/s | 179 kB 00:00 2023-09-12T16:04:05.694 INFO:teuthology.orchestra.run.smithi112.stdout:(87/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2023-09-12T16:04:05.718 INFO:teuthology.orchestra.run.smithi144.stdout:(139/144): libuuid-2.32.1-43.el8.x86_64.rpm 1.7 MB/s | 99 kB 00:00 2023-09-12T16:04:05.720 INFO:teuthology.orchestra.run.smithi112.stdout:(88/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 4.1 MB/s | 249 kB 00:00 2023-09-12T16:04:05.733 INFO:teuthology.orchestra.run.smithi112.stdout:[MIRROR] python3-cryptography-3.2.1-6.el8.x86_64.rpm: Status code: 403 for http://distro.ibiblio.org/centos/8-stream/BaseOS/x86_64/os/Packages/python3-cryptography-3.2.1-6.el8.x86_64.rpm (IP: 152.19.134.43) 2023-09-12T16:04:05.778 INFO:teuthology.orchestra.run.smithi112.stdout:(89/144): python3-jwt-1.6.1-2.el8.noarch.rpm 733 kB/s | 43 kB 00:00 2023-09-12T16:04:05.785 INFO:teuthology.orchestra.run.smithi144.stdout:(140/144): util-linux-user-2.32.1-43.el8.x86_64 1.5 MB/s | 103 kB 00:00 2023-09-12T16:04:05.837 INFO:teuthology.orchestra.run.smithi112.stdout:(90/144): python3-oauthlib-2.1.0-1.el8.noarch.r 2.6 MB/s | 155 kB 00:00 2023-09-12T16:04:05.877 INFO:teuthology.orchestra.run.smithi144.stdout:(141/144): util-linux-2.32.1-43.el8.x86_64.rpm 13 MB/s | 2.5 MB 00:00 2023-09-12T16:04:05.902 INFO:teuthology.orchestra.run.smithi144.stdout:(142/144): xfsdump-3.1.8-6.el8.x86_64.rpm 2.8 MB/s | 334 kB 00:00 2023-09-12T16:04:05.903 INFO:teuthology.orchestra.run.smithi112.stdout:(91/144): python3-pycparser-2.14-14.el8.noarch. 1.6 MB/s | 109 kB 00:00 2023-09-12T16:04:05.954 INFO:teuthology.orchestra.run.smithi112.stdout:(92/144): python3-requests-oauthlib-1.0.0-1.el8 858 kB/s | 43 kB 00:00 2023-09-12T16:04:05.961 INFO:teuthology.orchestra.run.smithi144.stdout:(143/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2023-09-12T16:04:06.463 INFO:teuthology.orchestra.run.smithi112.stdout:(93/144): ceph-test-18.0.0-6088.g2110e007.el8.x 7.7 MB/s | 49 MB 00:06 2023-09-12T16:04:06.488 INFO:teuthology.orchestra.run.smithi112.stdout:(94/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 140 kB/s | 74 kB 00:00 2023-09-12T16:04:06.522 INFO:teuthology.orchestra.run.smithi112.stdout:(95/144): python3-cryptography-3.2.1-6.el8.x86_ 775 kB/s | 641 kB 00:00 2023-09-12T16:04:06.547 INFO:teuthology.orchestra.run.smithi112.stdout:(96/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 695 kB/s | 58 kB 00:00 2023-09-12T16:04:07.019 INFO:teuthology.orchestra.run.smithi144.stdout:(144/144): thrift-0.13.0-2.el8.x86_64.rpm 719 kB/s | 1.7 MB 00:02 2023-09-12T16:04:07.026 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2023-09-12T16:04:07.026 INFO:teuthology.orchestra.run.smithi144.stdout:Total 15 MB/s | 214 MB 00:14 2023-09-12T16:04:07.072 INFO:teuthology.orchestra.run.smithi112.stdout:(97/144): liboath-2.6.2-3.el8.x86_64.rpm 107 kB/s | 59 kB 00:00 2023-09-12T16:04:07.098 INFO:teuthology.orchestra.run.smithi112.stdout:(98/144): libunwind-1.3.1-3.el8.x86_64.rpm 136 kB/s | 75 kB 00:00 2023-09-12T16:04:07.223 INFO:teuthology.orchestra.run.smithi112.stdout:(99/144): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 349 kB/s | 44 kB 00:00 2023-09-12T16:04:07.248 INFO:teuthology.orchestra.run.smithi112.stdout:(100/144): gperftools-libs-2.7-9.el8.x86_64.rpm 403 kB/s | 306 kB 00:00 2023-09-12T16:04:07.357 INFO:teuthology.orchestra.run.smithi112.stdout:(101/144): python3-cachetools-3.1.1-4.el8.noarc 305 kB/s | 33 kB 00:00 2023-09-12T16:04:07.424 INFO:teuthology.orchestra.run.smithi112.stdout:(102/144): python3-asyncssh-2.7.0-2.el8.noarch. 1.3 MB/s | 476 kB 00:00 2023-09-12T16:04:07.457 INFO:teuthology.orchestra.run.smithi112.stdout:(103/144): python3-certifi-2018.10.15-7.el8.noa 163 kB/s | 16 kB 00:00 2023-09-12T16:04:07.483 INFO:teuthology.orchestra.run.smithi112.stdout:(104/144): python3-beautifulsoup4-4.6.3-2.el8.1 715 kB/s | 185 kB 00:00 2023-09-12T16:04:07.549 INFO:teuthology.orchestra.run.smithi112.stdout:(105/144): python3-cheroot-8.5.2-1.el8.noarch.r 1.3 MB/s | 173 kB 00:00 2023-09-12T16:04:07.625 INFO:teuthology.orchestra.run.smithi112.stdout:(106/144): python3-google-auth-1.1.1-10.el8.noa 573 kB/s | 81 kB 00:00 2023-09-12T16:04:07.667 INFO:teuthology.orchestra.run.smithi112.stdout:(107/144): python3-cherrypy-18.4.0-1.el8.noarch 1.8 MB/s | 384 kB 00:00 2023-09-12T16:04:07.692 INFO:teuthology.orchestra.run.smithi112.stdout:(108/144): python3-jaraco-6.2-6.el8.noarch.rpm 78 kB/s | 11 kB 00:00 2023-09-12T16:04:07.759 INFO:teuthology.orchestra.run.smithi112.stdout:(109/144): python3-jaraco-functools-2.0-4.el8.n 131 kB/s | 18 kB 00:00 2023-09-12T16:04:07.818 INFO:teuthology.orchestra.run.smithi112.stdout:(110/144): python3-logutils-0.3.5-11.el8.noarch 389 kB/s | 49 kB 00:00 2023-09-12T16:04:07.893 INFO:teuthology.orchestra.run.smithi112.stdout:(111/144): python3-more-itertools-7.2.0-3.el8.n 440 kB/s | 59 kB 00:00 2023-09-12T16:04:07.943 INFO:teuthology.orchestra.run.smithi112.stdout:(112/144): python3-kubernetes-11.0.0-6.el8.noar 4.2 MB/s | 1.2 MB 00:00 2023-09-12T16:04:07.969 INFO:teuthology.orchestra.run.smithi112.stdout:(113/144): python3-natsort-7.1.1-2.el8.noarch.r 401 kB/s | 60 kB 00:00 2023-09-12T16:04:08.060 INFO:teuthology.orchestra.run.smithi112.stdout:(114/144): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2023-09-12T16:04:08.086 INFO:teuthology.orchestra.run.smithi112.stdout:(115/144): python3-repoze-lru-0.7-6.el8.noarch. 287 kB/s | 34 kB 00:00 2023-09-12T16:04:08.111 INFO:teuthology.orchestra.run.smithi112.stdout:(116/144): python3-pecan-1.3.2-9.el8.noarch.rpm 1.3 MB/s | 283 kB 00:00 2023-09-12T16:04:08.178 INFO:teuthology.orchestra.run.smithi112.stdout:(117/144): python3-routes-2.4.1-12.el8.noarch.r 1.6 MB/s | 196 kB 00:00 2023-09-12T16:04:08.204 INFO:teuthology.orchestra.run.smithi112.stdout:(118/144): python3-rsa-4.9-2.el8.noarch.rpm 548 kB/s | 64 kB 00:00 2023-09-12T16:04:08.229 INFO:teuthology.orchestra.run.smithi112.stdout:(119/144): python3-simplegeneric-0.8.1-17.el8.n 160 kB/s | 19 kB 00:00 2023-09-12T16:04:08.304 INFO:teuthology.orchestra.run.smithi112.stdout:(120/144): python3-singledispatch-3.4.0.3-18.el 191 kB/s | 24 kB 00:00 2023-09-12T16:04:08.329 INFO:teuthology.orchestra.run.smithi112.stdout:(121/144): python3-tempora-1.14.1-5.el8.noarch. 233 kB/s | 29 kB 00:00 2023-09-12T16:04:08.355 INFO:teuthology.orchestra.run.smithi112.stdout:(122/144): python3-trustme-0.6.0-4.el8.noarch.r 219 kB/s | 27 kB 00:00 2023-09-12T16:04:08.438 INFO:teuthology.orchestra.run.smithi112.stdout:(123/144): python3-waitress-1.4.3-1.el8.noarch. 1.9 MB/s | 255 kB 00:00 2023-09-12T16:04:08.480 INFO:teuthology.orchestra.run.smithi112.stdout:(124/144): python3-webob-1.8.5-1.el8.1.noarch.r 1.6 MB/s | 251 kB 00:00 2023-09-12T16:04:08.505 INFO:teuthology.orchestra.run.smithi112.stdout:(125/144): python3-websocket-client-0.56.0-5.el 407 kB/s | 61 kB 00:00 2023-09-12T16:04:08.556 INFO:teuthology.orchestra.run.smithi112.stdout:(126/144): python3-webtest-2.0.33-1.el8.noarch. 730 kB/s | 85 kB 00:00 2023-09-12T16:04:08.598 INFO:teuthology.orchestra.run.smithi112.stdout:(127/144): python3-zc-lockfile-2.0-2.el8.noarch 196 kB/s | 23 kB 00:00 2023-09-12T16:04:08.863 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2023-09-12T16:04:08.898 INFO:teuthology.orchestra.run.smithi112.stdout:(128/144): thrift-0.13.0-2.el8.x86_64.rpm 4.4 MB/s | 1.7 MB 00:00 2023-09-12T16:04:09.132 INFO:teuthology.orchestra.run.smithi112.stdout:(129/144): librbd1-18.0.0-6088.g2110e007.el8.x8 7.0 MB/s | 3.7 MB 00:00 2023-09-12T16:04:09.148 INFO:teuthology.orchestra.run.smithi112.stdout:(130/144): NetworkManager-initscripts-updown-1. 574 kB/s | 143 kB 00:00 2023-09-12T16:04:09.207 INFO:teuthology.orchestra.run.smithi112.stdout:(131/144): librados2-18.0.0-6088.g2110e007.el8. 5.7 MB/s | 3.7 MB 00:00 2023-09-12T16:04:09.232 INFO:teuthology.orchestra.run.smithi112.stdout:(132/144): elfutils-libelf-0.189-3.el8.x86_64.r 2.7 MB/s | 232 kB 00:00 2023-09-12T16:04:09.277 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2023-09-12T16:04:09.278 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2023-09-12T16:04:09.299 INFO:teuthology.orchestra.run.smithi112.stdout:(133/144): elfutils-debuginfod-client-0.189-3.e 455 kB/s | 76 kB 00:00 2023-09-12T16:04:09.349 INFO:teuthology.orchestra.run.smithi112.stdout:(134/144): iproute-6.2.0-2.el8.x86_64.rpm 7.4 MB/s | 880 kB 00:00 2023-09-12T16:04:09.408 INFO:teuthology.orchestra.run.smithi112.stdout:(135/144): libblkid-2.32.1-43.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2023-09-12T16:04:09.433 INFO:teuthology.orchestra.run.smithi112.stdout:(136/144): libfdisk-2.32.1-43.el8.x86_64.rpm 3.0 MB/s | 254 kB 00:00 2023-09-12T16:04:09.475 INFO:teuthology.orchestra.run.smithi112.stdout:(137/144): libmount-2.32.1-43.el8.x86_64.rpm 3.5 MB/s | 236 kB 00:00 2023-09-12T16:04:09.500 INFO:teuthology.orchestra.run.smithi112.stdout:(138/144): elfutils-libs-0.189-3.el8.x86_64.rpm 1.0 MB/s | 303 kB 00:00 2023-09-12T16:04:09.526 INFO:teuthology.orchestra.run.smithi112.stdout:(139/144): libsmartcols-2.32.1-43.el8.x86_64.rp 1.9 MB/s | 179 kB 00:00 2023-09-12T16:04:09.551 INFO:teuthology.orchestra.run.smithi112.stdout:(140/144): libuuid-2.32.1-43.el8.x86_64.rpm 1.3 MB/s | 99 kB 00:00 2023-09-12T16:04:09.584 INFO:teuthology.orchestra.run.smithi112.stdout:(141/144): util-linux-user-2.32.1-43.el8.x86_64 1.7 MB/s | 103 kB 00:00 2023-09-12T16:04:09.610 INFO:teuthology.orchestra.run.smithi112.stdout:(142/144): xfsdump-3.1.8-6.el8.x86_64.rpm 5.6 MB/s | 334 kB 00:00 2023-09-12T16:04:09.743 INFO:teuthology.orchestra.run.smithi112.stdout:(143/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 6.8 MB/s | 1.1 MB 00:00 2023-09-12T16:04:10.027 INFO:teuthology.orchestra.run.smithi112.stdout:(144/144): util-linux-2.32.1-43.el8.x86_64.rpm 4.7 MB/s | 2.5 MB 00:00 2023-09-12T16:04:10.033 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2023-09-12T16:04:10.034 INFO:teuthology.orchestra.run.smithi112.stdout:Total 15 MB/s | 214 MB 00:14 2023-09-12T16:04:10.765 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2023-09-12T16:04:10.769 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2023-09-12T16:04:11.885 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2023-09-12T16:04:12.299 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2023-09-12T16:04:12.300 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2023-09-12T16:04:13.798 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2023-09-12T16:04:13.802 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2023-09-12T16:04:16.238 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2023-09-12T16:04:16.451 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-09-12T16:04:16.653 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-09-12T16:04:16.795 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 2/160 2023-09-12T16:04:16.891 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 2/160 2023-09-12T16:04:17.079 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 3/160 2023-09-12T16:04:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 3/160 2023-09-12T16:04:17.361 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-09-12T16:04:17.575 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/160 2023-09-12T16:04:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-09-12T16:04:18.287 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-09-12T16:04:18.742 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-09-12T16:04:18.928 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librados2-2:18.0.0-6088.g2110e007.el8.x86_64 8/160 2023-09-12T16:04:19.253 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2023-09-12T16:04:19.392 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:18.0.0-6088.g2110e007.el8.x86_64 8/160 2023-09-12T16:04:19.469 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-09-12T16:04:19.587 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librbd1-2:18.0.0-6088.g2110e007.el8.x86_64 9/160 2023-09-12T16:04:19.670 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-09-12T16:04:19.726 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:18.0.0-6088.g2110e007.el8.x86_64 9/160 2023-09-12T16:04:19.791 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 2/160 2023-09-12T16:04:19.882 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 2/160 2023-09-12T16:04:19.931 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs2-2:18.0.0-6088.g2110e007.el8.x86_64 10/160 2023-09-12T16:04:20.049 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephfs2-2:18.0.0-6088.g2110e007.el8.x86_64 10/160 2023-09-12T16:04:20.058 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 3/160 2023-09-12T16:04:20.135 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 3/160 2023-09-12T16:04:20.245 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rados-2:18.0.0-6088.g2110e007.el8.x86_64 11/160 2023-09-12T16:04:20.346 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-09-12T16:04:20.411 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-09-12T16:04:20.564 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/160 2023-09-12T16:04:20.655 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-09-12T16:04:20.760 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-09-12T16:04:20.903 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-09-12T16:04:20.978 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-09-12T16:04:20.983 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-09-12T16:04:21.194 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-09-12T16:04:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-09-12T16:04:21.453 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-09-12T16:04:21.799 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-09-12T16:04:21.825 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librados2-2:18.0.0-6088.g2110e007.el8.x86_64 8/160 2023-09-12T16:04:21.978 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-10.23-2.module_el8+572+929c87ac.x86_6 17/160 2023-09-12T16:04:22.119 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephsqlite-2:18.0.0-6088.g2110e007.el8.x86_64 18/160 2023-09-12T16:04:22.245 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6088.g2110e007.el8.x86_64 18/160 2023-09-12T16:04:22.291 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:18.0.0-6088.g2110e007.el8.x86_64 8/160 2023-09-12T16:04:22.403 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libradosstriper1-2:18.0.0-6088.g2110e007.el8.x86 19/160 2023-09-12T16:04:22.483 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librbd1-2:18.0.0-6088.g2110e007.el8.x86_64 9/160 2023-09-12T16:04:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6088.g2110e007.el8.x86 19/160 2023-09-12T16:04:22.615 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:18.0.0-6088.g2110e007.el8.x86_64 9/160 2023-09-12T16:04:22.763 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-09-12T16:04:22.788 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs2-2:18.0.0-6088.g2110e007.el8.x86_64 10/160 2023-09-12T16:04:22.897 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs2-2:18.0.0-6088.g2110e007.el8.x86_64 10/160 2023-09-12T16:04:22.978 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-09-12T16:04:23.109 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rados-2:18.0.0-6088.g2110e007.el8.x86_64 11/160 2023-09-12T16:04:23.144 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-09-12T16:04:23.266 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-09-12T16:04:23.301 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-09-12T16:04:23.444 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-09-12T16:04:23.504 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-09-12T16:04:23.725 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-09-12T16:04:23.835 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-09-12T16:04:24.048 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-09-12T16:04:24.125 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-09-12T16:04:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-09-12T16:04:24.319 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-09-12T16:04:24.664 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-09-12T16:04:24.858 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-10.23-2.module_el8+572+929c87ac.x86_6 17/160 2023-09-12T16:04:24.999 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephsqlite-2:18.0.0-6088.g2110e007.el8.x86_64 18/160 2023-09-12T16:04:25.011 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-09-12T16:04:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6088.g2110e007.el8.x86_64 18/160 2023-09-12T16:04:25.202 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-09-12T16:04:25.332 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libradosstriper1-2:18.0.0-6088.g2110e007.el8.x86 19/160 2023-09-12T16:04:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6088.g2110e007.el8.x86 19/160 2023-09-12T16:04:25.729 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-09-12T16:04:25.931 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-09-12T16:04:26.024 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-09-12T16:04:26.116 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-09-12T16:04:26.272 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-09-12T16:04:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-09-12T16:04:26.457 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-09-12T16:04:26.544 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-09-12T16:04:26.718 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 28/160 2023-09-12T16:04:26.956 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-09-12T16:04:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-09-12T16:04:27.159 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-common-2:18.0.0-6088.g2110e007.el8. 30/160 2023-09-12T16:04:27.298 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-argparse-2:18.0.0-6088.g2110e007.el 31/160 2023-09-12T16:04:27.374 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-09-12T16:04:27.559 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cephfs-2:18.0.0-6088.g2110e007.el8.x86_6 32/160 2023-09-12T16:04:28.056 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-09-12T16:04:28.257 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-09-12T16:04:28.666 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-09-12T16:04:29.048 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-09-12T16:04:29.077 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-09-12T16:04:29.336 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-09-12T16:04:29.458 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-09-12T16:04:29.535 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-09-12T16:04:29.657 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-09-12T16:04:29.848 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 28/160 2023-09-12T16:04:30.094 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-09-12T16:04:30.340 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-common-2:18.0.0-6088.g2110e007.el8. 30/160 2023-09-12T16:04:30.503 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-argparse-2:18.0.0-6088.g2110e007.el 31/160 2023-09-12T16:04:30.757 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cephfs-2:18.0.0-6088.g2110e007.el8.x86_6 32/160 2023-09-12T16:04:31.607 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-09-12T16:04:31.908 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-09-12T16:04:31.913 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-09-12T16:04:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-09-12T16:04:32.356 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/160 2023-09-12T16:04:32.430 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-09-12T16:04:32.541 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rbd-2:18.0.0-6088.g2110e007.el8.x86_64 40/160 2023-09-12T16:04:32.731 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librados-devel-2:18.0.0-6088.g2110e007.el8.x86_6 41/160 2023-09-12T16:04:32.775 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-09-12T16:04:32.926 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 42/160 2023-09-12T16:04:33.040 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-09-12T16:04:33.136 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 43/160 2023-09-12T16:04:33.376 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/160 2023-09-12T16:04:33.466 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/160 2023-09-12T16:04:33.659 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 45/160 2023-09-12T16:04:33.742 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 45/160 2023-09-12T16:04:33.881 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 46/160 2023-09-12T16:04:34.059 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/160 2023-09-12T16:04:34.659 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/160 2023-09-12T16:04:34.926 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/160 2023-09-12T16:04:34.955 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/160 2023-09-12T16:04:35.137 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-09-12T16:04:35.158 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-09-12T16:04:35.409 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-09-12T16:04:35.452 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-09-12T16:04:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-09-12T16:04:35.680 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-09-12T16:04:35.780 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-09-12T16:04:35.894 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/160 2023-09-12T16:04:35.929 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-09-12T16:04:36.088 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rbd-2:18.0.0-6088.g2110e007.el8.x86_64 40/160 2023-09-12T16:04:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-09-12T16:04:36.284 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librados-devel-2:18.0.0-6088.g2110e007.el8.x86_6 41/160 2023-09-12T16:04:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-09-12T16:04:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 42/160 2023-09-12T16:04:36.547 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-09-12T16:04:36.758 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 43/160 2023-09-12T16:04:36.762 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-09-12T16:04:36.923 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-09-12T16:04:36.989 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/160 2023-09-12T16:04:37.087 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/160 2023-09-12T16:04:37.097 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-09-12T16:04:37.290 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-09-12T16:04:37.306 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 45/160 2023-09-12T16:04:37.397 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 45/160 2023-09-12T16:04:37.469 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-09-12T16:04:37.570 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 46/160 2023-09-12T16:04:37.675 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-09-12T16:04:37.781 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/160 2023-09-12T16:04:37.936 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-09-12T16:04:38.173 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-09-12T16:04:38.351 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/160 2023-09-12T16:04:38.391 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-09-12T16:04:38.665 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/160 2023-09-12T16:04:38.694 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/160 2023-09-12T16:04:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-09-12T16:04:38.921 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-09-12T16:04:39.043 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-09-12T16:04:39.196 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-09-12T16:04:39.238 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-09-12T16:04:39.447 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-09-12T16:04:39.619 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-09-12T16:04:39.785 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-09-12T16:04:39.995 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-09-12T16:04:40.086 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-09-12T16:04:40.205 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-09-12T16:04:40.324 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librgw2-2:18.0.0-6088.g2110e007.el8.x86_64 70/160 2023-09-12T16:04:40.413 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librgw2-2:18.0.0-6088.g2110e007.el8.x86_64 70/160 2023-09-12T16:04:40.421 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-09-12T16:04:40.618 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-09-12T16:04:40.636 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rgw-2:18.0.0-6088.g2110e007.el8.x86_64 71/160 2023-09-12T16:04:40.814 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-09-12T16:04:40.868 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-09-12T16:04:40.996 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-09-12T16:04:41.205 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-09-12T16:04:41.299 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-09-12T16:04:41.374 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-09-12T16:04:41.565 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-09-12T16:04:41.572 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-09-12T16:04:41.764 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-09-12T16:04:41.792 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-09-12T16:04:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-09-12T16:04:42.113 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-09-12T16:04:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-09-12T16:04:42.365 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-09-12T16:04:42.721 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-09-12T16:04:42.991 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-09-12T16:04:43.226 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-09-12T16:04:43.553 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-09-12T16:04:44.074 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-09-12T16:04:44.280 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librgw2-2:18.0.0-6088.g2110e007.el8.x86_64 70/160 2023-09-12T16:04:44.295 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-09-12T16:04:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librgw2-2:18.0.0-6088.g2110e007.el8.x86_64 70/160 2023-09-12T16:04:44.525 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-09-12T16:04:44.624 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rgw-2:18.0.0-6088.g2110e007.el8.x86_64 71/160 2023-09-12T16:04:44.771 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-09-12T16:04:44.882 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-09-12T16:04:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-09-12T16:04:45.330 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-09-12T16:04:45.335 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-09-12T16:04:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-09-12T16:04:45.604 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-09-12T16:04:45.762 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-09-12T16:04:45.802 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-09-12T16:04:46.066 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-09-12T16:04:46.122 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-09-12T16:04:46.323 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-09-12T16:04:46.354 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-09-12T16:04:46.517 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-09-12T16:04:46.724 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-09-12T16:04:47.060 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-09-12T16:04:47.282 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-09-12T16:04:47.430 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-09-12T16:04:47.621 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-09-12T16:04:47.622 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-09-12T16:04:47.801 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-09-12T16:04:47.997 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-09-12T16:04:48.035 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-09-12T16:04:48.231 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-09-12T16:04:48.251 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-09-12T16:04:48.431 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-09-12T16:04:48.482 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-09-12T16:04:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-09-12T16:04:48.749 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-09-12T16:04:48.786 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-09-12T16:04:48.898 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-09-12T16:04:49.050 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-09-12T16:04:49.325 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-09-12T16:04:49.559 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-09-12T16:04:49.937 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-09-12T16:04:50.152 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-09-12T16:04:50.323 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-09-12T16:04:50.523 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-09-12T16:04:50.891 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-09-12T16:04:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-09-12T16:04:51.320 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-09-12T16:04:51.529 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-09-12T16:04:51.757 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-09-12T16:04:52.008 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-09-12T16:04:52.156 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:18.0.0-6088.g2110e007.el8.x86_64 100/160 2023-09-12T16:04:52.381 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-common-2:18.0.0-6088.g2110e007.el8.x86_64 100/160 2023-09-12T16:04:52.600 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-09-12T16:04:52.804 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-09-12T16:04:52.912 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-09-12T16:04:53.059 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:18.0.0-6088.g2110e007.el8.x86_64 100/160 2023-09-12T16:04:53.115 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-09-12T16:04:53.271 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-09-12T16:04:53.382 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-base-2:18.0.0-6088.g2110e007.el8.x86_64 101/160 2023-09-12T16:04:53.587 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-base-2:18.0.0-6088.g2110e007.el8.x86_64 101/160 2023-09-12T16:04:53.764 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-selinux-2:18.0.0-6088.g2110e007.el8.x86_64 102/160 2023-09-12T16:04:56.182 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:18.0.0-6088.g2110e007.el8.x86_64 100/160 2023-09-12T16:04:56.479 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-common-2:18.0.0-6088.g2110e007.el8.x86_64 100/160 2023-09-12T16:04:57.145 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:18.0.0-6088.g2110e007.el8.x86_64 100/160 2023-09-12T16:04:57.931 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-base-2:18.0.0-6088.g2110e007.el8.x86_64 101/160 2023-09-12T16:04:58.147 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-base-2:18.0.0-6088.g2110e007.el8.x86_64 101/160 2023-09-12T16:04:58.378 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-selinux-2:18.0.0-6088.g2110e007.el8.x86_64 102/160 2023-09-12T16:05:14.352 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6088.g2110e007.el8.x86_64 102/160 2023-09-12T16:05:14.353 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /sys 2023-09-12T16:05:14.353 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /proc 2023-09-12T16:05:14.353 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /dev 2023-09-12T16:05:14.353 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /run 2023-09-12T16:05:14.353 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /mnt 2023-09-12T16:05:14.354 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /var/tmp 2023-09-12T16:05:14.354 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /home 2023-09-12T16:05:14.354 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /tmp 2023-09-12T16:05:14.354 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /dev 2023-09-12T16:05:14.354 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:14.735 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-volume-2:18.0.0-6088.g2110e007.el8.noarch 103/160 2023-09-12T16:05:16.465 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-volume-2:18.0.0-6088.g2110e007.el8.noarch 103/160 2023-09-12T16:05:16.686 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-osd-2:18.0.0-6088.g2110e007.el8.x86_64 104/160 2023-09-12T16:05:16.964 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-osd-2:18.0.0-6088.g2110e007.el8.x86_64 104/160 2023-09-12T16:05:17.127 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mds-2:18.0.0-6088.g2110e007.el8.x86_64 105/160 2023-09-12T16:05:17.678 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mds-2:18.0.0-6088.g2110e007.el8.x86_64 105/160 2023-09-12T16:05:17.860 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mon-2:18.0.0-6088.g2110e007.el8.x86_64 106/160 2023-09-12T16:05:17.909 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mon-2:18.0.0-6088.g2110e007.el8.x86_64 106/160 2023-09-12T16:05:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-09-12T16:05:18.323 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-09-12T16:05:18.357 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6088.g2110e007.el8.x86_64 102/160 2023-09-12T16:05:18.357 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /sys 2023-09-12T16:05:18.357 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /proc 2023-09-12T16:05:18.358 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /dev 2023-09-12T16:05:18.358 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /run 2023-09-12T16:05:18.358 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /mnt 2023-09-12T16:05:18.359 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /var/tmp 2023-09-12T16:05:18.359 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /home 2023-09-12T16:05:18.359 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /tmp 2023-09-12T16:05:18.359 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /dev 2023-09-12T16:05:18.359 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:18.476 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-09-12T16:05:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-09-12T16:05:18.784 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-volume-2:18.0.0-6088.g2110e007.el8.noarch 103/160 2023-09-12T16:05:18.902 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-09-12T16:05:19.118 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : automake-1.16.1-8.el8.noarch 111/160 2023-09-12T16:05:19.752 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephadm-2:18.0.0-6088.g2110e007.el8.noarch 112/160 2023-09-12T16:05:19.947 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephadm-2:18.0.0-6088.g2110e007.el8.noarch 112/160 2023-09-12T16:05:20.075 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6088.g2110e007.e 113/160 2023-09-12T16:05:20.264 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6088.g2110e007. 114/160 2023-09-12T16:05:20.476 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6088.g2110e007.el8.noa 115/160 2023-09-12T16:05:20.503 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-volume-2:18.0.0-6088.g2110e007.el8.noarch 103/160 2023-09-12T16:05:20.739 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6088.g2110e007.el8.noa 115/160 2023-09-12T16:05:20.786 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-osd-2:18.0.0-6088.g2110e007.el8.x86_64 104/160 2023-09-12T16:05:20.976 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6088.g2110e007.el8.n 116/160 2023-09-12T16:05:21.068 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-osd-2:18.0.0-6088.g2110e007.el8.x86_64 104/160 2023-09-12T16:05:21.260 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mds-2:18.0.0-6088.g2110e007.el8.x86_64 105/160 2023-09-12T16:05:21.794 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mds-2:18.0.0-6088.g2110e007.el8.x86_64 105/160 2023-09-12T16:05:21.984 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mon-2:18.0.0-6088.g2110e007.el8.x86_64 106/160 2023-09-12T16:05:22.034 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mon-2:18.0.0-6088.g2110e007.el8.x86_64 106/160 2023-09-12T16:05:22.086 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6088.g2110e007.el8.n 116/160 2023-09-12T16:05:22.276 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-09-12T16:05:22.325 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6088.g211 117/160 2023-09-12T16:05:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6088.g211 117/160 2023-09-12T16:05:22.488 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-09-12T16:05:22.667 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-09-12T16:05:22.762 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-09-12T16:05:22.838 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6088.g2110e007.el 118/160 2023-09-12T16:05:23.043 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-2:18.0.0-6088.g2110e007.el8.x86_64 119/160 2023-09-12T16:05:23.101 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-09-12T16:05:23.108 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6088.g2110e007.el8.x86_64 119/160 2023-09-12T16:05:23.317 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-rook-2:18.0.0-6088.g2110e007.el8.noarch 120/160 2023-09-12T16:05:23.345 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6088.g2110e007.el8.noarch 120/160 2023-09-12T16:05:23.367 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : automake-1.16.1-8.el8.noarch 111/160 2023-09-12T16:05:23.537 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-2:18.0.0-6088.g2110e007.el8.x86_64 121/160 2023-09-12T16:05:23.692 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-09-12T16:05:23.947 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:18.0.0-6088.g2110e007.el8.noarch 112/160 2023-09-12T16:05:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephadm-2:18.0.0-6088.g2110e007.el8.noarch 112/160 2023-09-12T16:05:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6088.g2110e007.e 113/160 2023-09-12T16:05:24.523 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6088.g2110e007. 114/160 2023-09-12T16:05:24.766 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6088.g2110e007.el8.noa 115/160 2023-09-12T16:05:25.027 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6088.g2110e007.el8.noa 115/160 2023-09-12T16:05:25.277 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6088.g2110e007.el8.n 116/160 2023-09-12T16:05:26.386 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6088.g2110e007.el8.n 116/160 2023-09-12T16:05:26.616 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6088.g211 117/160 2023-09-12T16:05:26.746 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6088.g211 117/160 2023-09-12T16:05:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6088.g2110e007.el 118/160 2023-09-12T16:05:27.360 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-2:18.0.0-6088.g2110e007.el8.x86_64 119/160 2023-09-12T16:05:27.425 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6088.g2110e007.el8.x86_64 119/160 2023-09-12T16:05:27.641 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-rook-2:18.0.0-6088.g2110e007.el8.noarch 120/160 2023-09-12T16:05:27.668 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6088.g2110e007.el8.noarch 120/160 2023-09-12T16:05:27.905 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-2:18.0.0-6088.g2110e007.el8.x86_64 121/160 2023-09-12T16:05:28.099 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-09-12T16:05:28.744 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-09-12T16:05:30.351 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-test-2:18.0.0-6088.g2110e007.el8.x86_64 123/160 2023-09-12T16:05:30.550 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-radosgw-2:18.0.0-6088.g2110e007.el8.x86_64 124/160 2023-09-12T16:05:30.611 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6088.g2110e007.el8.x86_64 124/160 2023-09-12T16:05:30.792 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6088.g2110e 125/160 2023-09-12T16:05:30.862 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6088.g2110e 125/160 2023-09-12T16:05:31.057 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-mirror-2:18.0.0-6088.g2110e007.el8.x86_64 126/160 2023-09-12T16:05:31.482 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6088.g2110e007.el8.x86_64 126/160 2023-09-12T16:05:31.700 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-mirror-2:18.0.0-6088.g2110e007.el8.x86_64 127/160 2023-09-12T16:05:31.990 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6088.g2110e007.el8.x86_64 127/160 2023-09-12T16:05:32.308 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-contrib-10.23-2.module_el8+572+929c87 128/160 2023-09-12T16:05:33.130 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-09-12T16:05:33.584 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-fuse-2:18.0.0-6088.g2110e007.el8.x86_64 129/160 2023-09-12T16:05:33.896 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-09-12T16:05:34.098 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 131/160 2023-09-12T16:05:34.354 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 132/160 2023-09-12T16:05:34.520 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-09-12T16:05:34.726 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs-devel-2:18.0.0-6088.g2110e007.el8.x86_ 134/160 2023-09-12T16:05:34.739 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-test-2:18.0.0-6088.g2110e007.el8.x86_64 123/160 2023-09-12T16:05:35.001 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-radosgw-2:18.0.0-6088.g2110e007.el8.x86_64 124/160 2023-09-12T16:05:35.062 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6088.g2110e007.el8.x86_64 124/160 2023-09-12T16:05:35.274 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6088.g2110e 125/160 2023-09-12T16:05:35.344 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6088.g2110e 125/160 2023-09-12T16:05:35.565 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-mirror-2:18.0.0-6088.g2110e007.el8.x86_64 126/160 2023-09-12T16:05:35.977 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-10.23-2.module_el8+572+929c87a 135/160 2023-09-12T16:05:35.987 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6088.g2110e007.el8.x86_64 126/160 2023-09-12T16:05:36.224 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-mirror-2:18.0.0-6088.g2110e007.el8.x86_64 127/160 2023-09-12T16:05:36.232 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-server-10.23-2.module_el8+572+929c87a 135/160 2023-09-12T16:05:36.318 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-10.23-2.module_el8+572+929c87a 135/160 2023-09-12T16:05:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6088.g2110e007.el8.x86_64 127/160 2023-09-12T16:05:36.536 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-09-12T16:05:36.724 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-top-2:18.0.0-6088.g2110e007.el8.noarch 137/160 2023-09-12T16:05:36.900 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-contrib-10.23-2.module_el8+572+929c87 128/160 2023-09-12T16:05:36.949 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-fuse-2:18.0.0-6088.g2110e007.el8.x86_64 138/160 2023-09-12T16:05:37.364 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-nbd-2:18.0.0-6088.g2110e007.el8.x86_64 139/160 2023-09-12T16:05:37.625 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-09-12T16:05:37.790 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 141/160 2023-09-12T16:05:37.816 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 141/160 2023-09-12T16:05:38.015 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-09-12T16:05:38.185 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-fuse-2:18.0.0-6088.g2110e007.el8.x86_64 129/160 2023-09-12T16:05:38.272 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-09-12T16:05:38.378 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-09-12T16:05:38.512 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-09-12T16:05:38.614 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-09-12T16:05:38.641 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-09-12T16:05:38.722 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 131/160 2023-09-12T16:05:38.807 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-09-12T16:05:38.953 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 132/160 2023-09-12T16:05:38.991 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-09-12T16:05:39.145 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-09-12T16:05:39.176 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-09-12T16:05:39.177 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-09-12T16:05:39.364 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs-devel-2:18.0.0-6088.g2110e007.el8.x86_ 134/160 2023-09-12T16:05:39.477 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-09-12T16:05:39.477 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-09-12T16:05:39.733 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-09-12T16:05:39.748 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-09-12T16:05:39.862 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-09-12T16:05:39.862 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-09-12T16:05:40.121 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-09-12T16:05:40.283 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-09-12T16:05:40.431 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-09-12T16:05:40.537 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: postgresql-server-10.23-2.module_el8+572+929c87a 135/160 2023-09-12T16:05:40.649 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-09-12T16:05:40.649 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-09-12T16:05:40.798 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-server-10.23-2.module_el8+572+929c87a 135/160 2023-09-12T16:05:40.842 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-09-12T16:05:40.842 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-09-12T16:05:40.890 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: postgresql-server-10.23-2.module_el8+572+929c87a 135/160 2023-09-12T16:05:41.051 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-09-12T16:05:41.051 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-09-12T16:05:41.102 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-09-12T16:05:41.234 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-09-12T16:05:41.234 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-09-12T16:05:41.315 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-top-2:18.0.0-6088.g2110e007.el8.noarch 137/160 2023-09-12T16:05:41.425 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-09-12T16:05:41.426 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-09-12T16:05:41.548 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-fuse-2:18.0.0-6088.g2110e007.el8.x86_64 138/160 2023-09-12T16:05:41.626 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-09-12T16:05:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-09-12T16:05:41.930 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-nbd-2:18.0.0-6088.g2110e007.el8.x86_64 139/160 2023-09-12T16:05:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-09-12T16:05:42.056 INFO:teuthology.orchestra.run.smithi144.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-09-12T16:05:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:42.250 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-09-12T16:05:42.423 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 141/160 2023-09-12T16:05:42.454 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 141/160 2023-09-12T16:05:42.638 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-09-12T16:05:42.787 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-2:18.0.0-6088.g2110e007.el8.x86_64 1/160 2023-09-12T16:05:42.787 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-base-2:18.0.0-6088.g2110e007.el8.x86_64 2/160 2023-09-12T16:05:42.788 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-common-2:18.0.0-6088.g2110e007.el8.x86_64 3/160 2023-09-12T16:05:42.788 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-fuse-2:18.0.0-6088.g2110e007.el8.x86_64 4/160 2023-09-12T16:05:42.788 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6088.g2110e 5/160 2023-09-12T16:05:42.788 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mds-2:18.0.0-6088.g2110e007.el8.x86_64 6/160 2023-09-12T16:05:42.789 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-2:18.0.0-6088.g2110e007.el8.x86_64 7/160 2023-09-12T16:05:42.789 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mon-2:18.0.0-6088.g2110e007.el8.x86_64 8/160 2023-09-12T16:05:42.789 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-osd-2:18.0.0-6088.g2110e007.el8.x86_64 9/160 2023-09-12T16:05:42.789 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-radosgw-2:18.0.0-6088.g2110e007.el8.x86_64 10/160 2023-09-12T16:05:42.789 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-selinux-2:18.0.0-6088.g2110e007.el8.x86_64 11/160 2023-09-12T16:05:42.790 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-test-2:18.0.0-6088.g2110e007.el8.x86_64 12/160 2023-09-12T16:05:42.790 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-mirror-2:18.0.0-6088.g2110e007.el8.x86_64 13/160 2023-09-12T16:05:42.790 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs-devel-2:18.0.0-6088.g2110e007.el8.x86_ 14/160 2023-09-12T16:05:42.790 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs2-2:18.0.0-6088.g2110e007.el8.x86_64 15/160 2023-09-12T16:05:42.790 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephsqlite-2:18.0.0-6088.g2110e007.el8.x86_64 16/160 2023-09-12T16:05:42.791 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados-devel-2:18.0.0-6088.g2110e007.el8.x86_6 17/160 2023-09-12T16:05:42.791 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libradosstriper1-2:18.0.0-6088.g2110e007.el8.x86 18/160 2023-09-12T16:05:42.791 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librgw2-2:18.0.0-6088.g2110e007.el8.x86_64 19/160 2023-09-12T16:05:42.791 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6088.g2110e007.el 20/160 2023-09-12T16:05:42.791 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-common-2:18.0.0-6088.g2110e007.el8. 21/160 2023-09-12T16:05:42.792 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cephfs-2:18.0.0-6088.g2110e007.el8.x86_6 22/160 2023-09-12T16:05:42.792 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rados-2:18.0.0-6088.g2110e007.el8.x86_64 23/160 2023-09-12T16:05:42.792 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rbd-2:18.0.0-6088.g2110e007.el8.x86_64 24/160 2023-09-12T16:05:42.792 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rgw-2:18.0.0-6088.g2110e007.el8.x86_64 25/160 2023-09-12T16:05:42.792 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-fuse-2:18.0.0-6088.g2110e007.el8.x86_64 26/160 2023-09-12T16:05:42.793 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-mirror-2:18.0.0-6088.g2110e007.el8.x86_64 27/160 2023-09-12T16:05:42.793 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-nbd-2:18.0.0-6088.g2110e007.el8.x86_64 28/160 2023-09-12T16:05:42.793 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6088.g2110e007. 29/160 2023-09-12T16:05:42.793 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6088.g2110e007.el8.noa 30/160 2023-09-12T16:05:42.793 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6088.g2110e007.el8.n 31/160 2023-09-12T16:05:42.794 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6088.g211 32/160 2023-09-12T16:05:42.794 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6088.g2110e007.el 33/160 2023-09-12T16:05:42.794 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6088.g2110e007.el8.noarch 34/160 2023-09-12T16:05:42.794 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6088.g2110e007.e 35/160 2023-09-12T16:05:42.794 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-volume-2:18.0.0-6088.g2110e007.el8.noarch 36/160 2023-09-12T16:05:42.795 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephadm-2:18.0.0-6088.g2110e007.el8.noarch 37/160 2023-09-12T16:05:42.795 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-top-2:18.0.0-6088.g2110e007.el8.noarch 38/160 2023-09-12T16:05:42.795 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : automake-1.16.1-8.el8.noarch 39/160 2023-09-12T16:05:42.795 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-09-12T16:05:42.795 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-09-12T16:05:42.796 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-09-12T16:05:42.796 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-09-12T16:05:42.796 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-09-12T16:05:42.796 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-09-12T16:05:42.796 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-09-12T16:05:42.797 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-09-12T16:05:42.797 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-09-12T16:05:42.797 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-09-12T16:05:42.797 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-10.23-2.module_el8+572+929c87ac.x86_6 50/160 2023-09-12T16:05:42.797 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-contrib-10.23-2.module_el8+572+929c87 51/160 2023-09-12T16:05:42.798 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-server-10.23-2.module_el8+572+929c87a 52/160 2023-09-12T16:05:42.798 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-09-12T16:05:42.798 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-09-12T16:05:42.798 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-09-12T16:05:42.798 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-09-12T16:05:42.799 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-09-12T16:05:42.799 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-09-12T16:05:42.799 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-09-12T16:05:42.799 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-09-12T16:05:42.799 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-09-12T16:05:42.800 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-09-12T16:05:42.800 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-09-12T16:05:42.800 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-09-12T16:05:42.800 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 65/160 2023-09-12T16:05:42.800 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-09-12T16:05:42.801 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-09-12T16:05:42.801 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-09-12T16:05:42.801 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-09-12T16:05:42.801 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-09-12T16:05:42.801 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 71/160 2023-09-12T16:05:42.802 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-09-12T16:05:42.802 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-09-12T16:05:42.802 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-09-12T16:05:42.802 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-09-12T16:05:42.803 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-09-12T16:05:42.803 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-09-12T16:05:42.803 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-09-12T16:05:42.803 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-09-12T16:05:42.803 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-09-12T16:05:42.804 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-09-12T16:05:42.804 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 82/160 2023-09-12T16:05:42.804 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-09-12T16:05:42.804 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-09-12T16:05:42.804 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-09-12T16:05:42.805 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-09-12T16:05:42.805 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-09-12T16:05:42.805 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-09-12T16:05:42.805 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-09-12T16:05:42.805 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-09-12T16:05:42.806 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-09-12T16:05:42.806 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-09-12T16:05:42.806 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-09-12T16:05:42.806 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-09-12T16:05:42.806 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-09-12T16:05:42.807 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-09-12T16:05:42.807 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-09-12T16:05:42.807 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-09-12T16:05:42.807 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-09-12T16:05:42.807 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-09-12T16:05:42.808 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-09-12T16:05:42.808 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-09-12T16:05:42.808 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-09-12T16:05:42.808 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-09-12T16:05:42.808 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-09-12T16:05:42.809 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-09-12T16:05:42.809 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-09-12T16:05:42.809 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-09-12T16:05:42.809 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-09-12T16:05:42.809 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-09-12T16:05:42.810 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-09-12T16:05:42.810 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-09-12T16:05:42.810 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-09-12T16:05:42.810 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-09-12T16:05:42.810 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-09-12T16:05:42.811 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-09-12T16:05:42.811 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-09-12T16:05:42.811 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 118/160 2023-09-12T16:05:42.811 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-09-12T16:05:42.812 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-09-12T16:05:42.812 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-09-12T16:05:42.812 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-09-12T16:05:42.812 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-09-12T16:05:42.812 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-09-12T16:05:42.813 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-09-12T16:05:42.813 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-09-12T16:05:42.813 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-09-12T16:05:42.813 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-09-12T16:05:42.813 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:18.0.0-6088.g2110e007.el8.x86_64 129/160 2023-09-12T16:05:42.814 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-09-12T16:05:42.814 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:18.0.0-6088.g2110e007.el8.x86_64 131/160 2023-09-12T16:05:42.814 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-09-12T16:05:42.814 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 133/160 2023-09-12T16:05:42.814 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-09-12T16:05:42.815 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 135/160 2023-09-12T16:05:42.815 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-09-12T16:05:42.815 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 137/160 2023-09-12T16:05:42.815 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-09-12T16:05:42.815 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 139/160 2023-09-12T16:05:42.816 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-09-12T16:05:42.816 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-09-12T16:05:42.816 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-09-12T16:05:42.816 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 143/160 2023-09-12T16:05:42.816 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-09-12T16:05:42.816 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 145/160 2023-09-12T16:05:42.817 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-09-12T16:05:42.817 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 147/160 2023-09-12T16:05:42.817 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-09-12T16:05:42.817 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 149/160 2023-09-12T16:05:42.817 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-09-12T16:05:42.818 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 151/160 2023-09-12T16:05:42.818 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-09-12T16:05:42.818 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 153/160 2023-09-12T16:05:42.818 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-09-12T16:05:42.818 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 155/160 2023-09-12T16:05:42.819 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-09-12T16:05:42.819 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-09-12T16:05:42.819 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-09-12T16:05:42.819 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-09-12T16:05:42.898 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-09-12T16:05:43.005 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-09-12T16:05:43.231 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-09-12T16:05:43.259 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-09-12T16:05:43.483 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-09-12T16:05:43.701 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-09-12T16:05:43.870 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-09-12T16:05:43.871 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-09-12T16:05:44.136 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-09-12T16:05:44.137 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-09-12T16:05:44.375 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-09-12T16:05:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-09-12T16:05:44.503 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-09-12T16:05:44.503 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-09-12T16:05:44.795 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-09-12T16:05:44.974 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-09-12T16:05:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-09-12T16:05:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:44.990 INFO:teuthology.orchestra.run.smithi144.stdout:Upgraded: 2023-09-12T16:05:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-09-12T16:05:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-09-12T16:05:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-09-12T16:05:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-09-12T16:05:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: iproute-6.2.0-2.el8.x86_64 2023-09-12T16:05:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: libblkid-2.32.1-43.el8.x86_64 2023-09-12T16:05:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-09-12T16:05:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: libmount-2.32.1-43.el8.x86_64 2023-09-12T16:05:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: librados2-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-09-12T16:05:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-2.32.1-43.el8.x86_64 2023-09-12T16:05:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: util-linux-2.32.1-43.el8.x86_64 2023-09-12T16:05:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-09-12T16:05:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-09-12T16:05:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-09-12T16:05:44.993 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2023-09-12T16:05:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: automake-1.16.1-8.el8.noarch 2023-09-12T16:05:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: bison-3.0.4-10.el8.x86_64 2023-09-12T16:05:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards-2:18.0.0-6088.g2110e007.el8.noarch 2023-09-12T16:05:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm-2:18.0.0-6088.g2110e007.el8.noarch 2023-09-12T16:05:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard-2:18.0.0-6088.g2110e007.el8.noarch 2023-09-12T16:05:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6088.g2110e007.el8.noarch 2023-09-12T16:05:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core-2:18.0.0-6088.g2110e007.el8.noarch 2023-09-12T16:05:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook-2:18.0.0-6088.g2110e007.el8.noarch 2023-09-12T16:05:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts-2:18.0.0-6088.g2110e007.el8.noarch 2023-09-12T16:05:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume-2:18.0.0-6088.g2110e007.el8.noarch 2023-09-12T16:05:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm-2:18.0.0-6088.g2110e007.el8.noarch 2023-09-12T16:05:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top-2:18.0.0-6088.g2110e007.el8.noarch 2023-09-12T16:05:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-09-12T16:05:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: flex-2.6.1-9.el8.x86_64 2023-09-12T16:05:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: fuse-2.9.7-17.el8.x86_64 2023-09-12T16:05:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-12T16:05:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: jq-1.6-7.el8.x86_64 2023-09-12T16:05:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-12T16:05:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-09-12T16:05:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-12T16:05:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-09-12T16:05:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-09-12T16:05:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-12T16:05:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: libpq-13.5-1.el8.x86_64 2023-09-12T16:05:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-09-12T16:05:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-09-12T16:05:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-12T16:05:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-09-12T16:05:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-12T16:05:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-12T16:05:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-12T16:05:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-09-12T16:05:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-09-12T16:05:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-09-12T16:05:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-12T16:05:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-12T16:05:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-0.3.15-4.el8.x86_64 2023-09-12T16:05:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-09-12T16:05:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-09-12T16:05:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-09-12T16:05:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-09-12T16:05:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-09-12T16:05:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-10.23-2.module_el8+572+929c87ac.x86_64 2023-09-12T16:05:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib-10.23-2.module_el8+572+929c87ac.x86_64 2023-09-12T16:05:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server-10.23-2.module_el8+572+929c87ac.x86_64 2023-09-12T16:05:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-12T16:05:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-12T16:05:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-12T16:05:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-12T16:05:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-12T16:05:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-12T16:05:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-09-12T16:05:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-12T16:05:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-12T16:05:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-09-12T16:05:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-12T16:05:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-12T16:05:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-12T16:05:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-12T16:05:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-12T16:05:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-12T16:05:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-12T16:05:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-12T16:05:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-12T16:05:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako-1.0.6-14.el8.noarch 2023-09-12T16:05:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-12T16:05:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-12T16:05:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-12T16:05:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-12T16:05:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-12T16:05:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-12T16:05:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-12T16:05:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend-2.6-1.el8.noarch 2023-09-12T16:05:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-12T16:05:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-12T16:05:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-12T16:05:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-12T16:05:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-12T16:05:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz-2017.2-11.el8.noarch 2023-09-12T16:05:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-12T16:05:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-12T16:05:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-12T16:05:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-12T16:05:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-09-12T16:05:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-12T16:05:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-12T16:05:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-12T16:05:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-12T16:05:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-12T16:05:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-12T16:05:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-12T16:05:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-12T16:05:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-12T16:05:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-12T16:05:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-12T16:05:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-12T16:05:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: uuid-1.6.2-43.el8.x86_64 2023-09-12T16:05:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-09-12T16:05:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-12T16:05:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-09-12T16:05:45.023 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:45.023 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2023-09-12T16:05:45.135 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-09-12T16:05:45.324 DEBUG:teuthology.parallel:result is None 2023-09-12T16:05:45.382 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-09-12T16:05:45.382 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-09-12T16:05:45.608 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-09-12T16:05:45.608 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-09-12T16:05:45.825 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-09-12T16:05:45.825 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-09-12T16:05:46.050 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-09-12T16:05:46.050 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-09-12T16:05:46.275 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-09-12T16:05:46.275 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-09-12T16:05:46.492 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-09-12T16:05:46.673 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-09-12T16:05:46.896 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-09-12T16:05:46.897 INFO:teuthology.orchestra.run.smithi112.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-09-12T16:05:46.897 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:47.622 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-2:18.0.0-6088.g2110e007.el8.x86_64 1/160 2023-09-12T16:05:47.622 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-base-2:18.0.0-6088.g2110e007.el8.x86_64 2/160 2023-09-12T16:05:47.622 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-common-2:18.0.0-6088.g2110e007.el8.x86_64 3/160 2023-09-12T16:05:47.623 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-fuse-2:18.0.0-6088.g2110e007.el8.x86_64 4/160 2023-09-12T16:05:47.623 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6088.g2110e 5/160 2023-09-12T16:05:47.623 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mds-2:18.0.0-6088.g2110e007.el8.x86_64 6/160 2023-09-12T16:05:47.623 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-2:18.0.0-6088.g2110e007.el8.x86_64 7/160 2023-09-12T16:05:47.623 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mon-2:18.0.0-6088.g2110e007.el8.x86_64 8/160 2023-09-12T16:05:47.623 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-osd-2:18.0.0-6088.g2110e007.el8.x86_64 9/160 2023-09-12T16:05:47.624 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-radosgw-2:18.0.0-6088.g2110e007.el8.x86_64 10/160 2023-09-12T16:05:47.624 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-selinux-2:18.0.0-6088.g2110e007.el8.x86_64 11/160 2023-09-12T16:05:47.624 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-test-2:18.0.0-6088.g2110e007.el8.x86_64 12/160 2023-09-12T16:05:47.625 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-mirror-2:18.0.0-6088.g2110e007.el8.x86_64 13/160 2023-09-12T16:05:47.625 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs-devel-2:18.0.0-6088.g2110e007.el8.x86_ 14/160 2023-09-12T16:05:47.625 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs2-2:18.0.0-6088.g2110e007.el8.x86_64 15/160 2023-09-12T16:05:47.625 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephsqlite-2:18.0.0-6088.g2110e007.el8.x86_64 16/160 2023-09-12T16:05:47.626 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados-devel-2:18.0.0-6088.g2110e007.el8.x86_6 17/160 2023-09-12T16:05:47.626 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libradosstriper1-2:18.0.0-6088.g2110e007.el8.x86 18/160 2023-09-12T16:05:47.626 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librgw2-2:18.0.0-6088.g2110e007.el8.x86_64 19/160 2023-09-12T16:05:47.626 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6088.g2110e007.el 20/160 2023-09-12T16:05:47.626 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-common-2:18.0.0-6088.g2110e007.el8. 21/160 2023-09-12T16:05:47.627 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cephfs-2:18.0.0-6088.g2110e007.el8.x86_6 22/160 2023-09-12T16:05:47.627 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rados-2:18.0.0-6088.g2110e007.el8.x86_64 23/160 2023-09-12T16:05:47.627 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rbd-2:18.0.0-6088.g2110e007.el8.x86_64 24/160 2023-09-12T16:05:47.627 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rgw-2:18.0.0-6088.g2110e007.el8.x86_64 25/160 2023-09-12T16:05:47.627 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-fuse-2:18.0.0-6088.g2110e007.el8.x86_64 26/160 2023-09-12T16:05:47.627 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-mirror-2:18.0.0-6088.g2110e007.el8.x86_64 27/160 2023-09-12T16:05:47.628 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-nbd-2:18.0.0-6088.g2110e007.el8.x86_64 28/160 2023-09-12T16:05:47.639 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6088.g2110e007. 29/160 2023-09-12T16:05:47.639 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6088.g2110e007.el8.noa 30/160 2023-09-12T16:05:47.640 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6088.g2110e007.el8.n 31/160 2023-09-12T16:05:47.640 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6088.g211 32/160 2023-09-12T16:05:47.640 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6088.g2110e007.el 33/160 2023-09-12T16:05:47.640 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6088.g2110e007.el8.noarch 34/160 2023-09-12T16:05:47.640 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6088.g2110e007.e 35/160 2023-09-12T16:05:47.640 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-volume-2:18.0.0-6088.g2110e007.el8.noarch 36/160 2023-09-12T16:05:47.641 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephadm-2:18.0.0-6088.g2110e007.el8.noarch 37/160 2023-09-12T16:05:47.641 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-top-2:18.0.0-6088.g2110e007.el8.noarch 38/160 2023-09-12T16:05:47.641 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : automake-1.16.1-8.el8.noarch 39/160 2023-09-12T16:05:47.641 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-09-12T16:05:47.641 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-09-12T16:05:47.642 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-09-12T16:05:47.642 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-09-12T16:05:47.642 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-09-12T16:05:47.642 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-09-12T16:05:47.642 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-09-12T16:05:47.643 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-09-12T16:05:47.643 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-09-12T16:05:47.643 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-09-12T16:05:47.643 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-10.23-2.module_el8+572+929c87ac.x86_6 50/160 2023-09-12T16:05:47.643 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-contrib-10.23-2.module_el8+572+929c87 51/160 2023-09-12T16:05:47.644 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-server-10.23-2.module_el8+572+929c87a 52/160 2023-09-12T16:05:47.644 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-09-12T16:05:47.644 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-09-12T16:05:47.644 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-09-12T16:05:47.644 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-09-12T16:05:47.645 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-09-12T16:05:47.645 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-09-12T16:05:47.645 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-09-12T16:05:47.645 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-09-12T16:05:47.645 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-09-12T16:05:47.645 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-09-12T16:05:47.646 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-09-12T16:05:47.646 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-09-12T16:05:47.646 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 65/160 2023-09-12T16:05:47.646 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-09-12T16:05:47.646 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-09-12T16:05:47.647 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-09-12T16:05:47.647 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-09-12T16:05:47.647 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-09-12T16:05:47.647 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 71/160 2023-09-12T16:05:47.647 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-09-12T16:05:47.647 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-09-12T16:05:47.648 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-09-12T16:05:47.648 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-09-12T16:05:47.648 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-09-12T16:05:47.648 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-09-12T16:05:47.648 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-09-12T16:05:47.649 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-09-12T16:05:47.649 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-09-12T16:05:47.649 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-09-12T16:05:47.649 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 82/160 2023-09-12T16:05:47.649 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-09-12T16:05:47.649 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-09-12T16:05:47.650 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-09-12T16:05:47.650 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-09-12T16:05:47.650 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-09-12T16:05:47.650 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-09-12T16:05:47.650 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-09-12T16:05:47.651 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-09-12T16:05:47.651 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-09-12T16:05:47.651 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-09-12T16:05:47.651 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-09-12T16:05:47.651 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-09-12T16:05:47.652 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-09-12T16:05:47.652 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-09-12T16:05:47.652 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-09-12T16:05:47.652 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-09-12T16:05:47.652 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-09-12T16:05:47.652 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-09-12T16:05:47.653 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-09-12T16:05:47.653 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-09-12T16:05:47.653 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-09-12T16:05:47.653 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-09-12T16:05:47.653 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-09-12T16:05:47.654 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-09-12T16:05:47.654 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-09-12T16:05:47.654 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-09-12T16:05:47.654 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-09-12T16:05:47.654 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-09-12T16:05:47.654 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-09-12T16:05:47.655 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-09-12T16:05:47.655 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-09-12T16:05:47.655 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-09-12T16:05:47.655 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-09-12T16:05:47.655 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-09-12T16:05:47.656 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-09-12T16:05:47.656 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 118/160 2023-09-12T16:05:47.656 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-09-12T16:05:47.656 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-09-12T16:05:47.656 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-09-12T16:05:47.656 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-09-12T16:05:47.657 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-09-12T16:05:47.657 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-09-12T16:05:47.657 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-09-12T16:05:47.657 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-09-12T16:05:47.657 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-09-12T16:05:47.658 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-09-12T16:05:47.658 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:18.0.0-6088.g2110e007.el8.x86_64 129/160 2023-09-12T16:05:47.658 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-09-12T16:05:47.658 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:18.0.0-6088.g2110e007.el8.x86_64 131/160 2023-09-12T16:05:47.658 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-09-12T16:05:47.659 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 133/160 2023-09-12T16:05:47.659 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-09-12T16:05:47.659 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 135/160 2023-09-12T16:05:47.659 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-09-12T16:05:47.659 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 137/160 2023-09-12T16:05:47.659 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-09-12T16:05:47.660 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 139/160 2023-09-12T16:05:47.660 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-09-12T16:05:47.660 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-09-12T16:05:47.660 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-09-12T16:05:47.660 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 143/160 2023-09-12T16:05:47.661 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-09-12T16:05:47.661 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 145/160 2023-09-12T16:05:47.661 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-09-12T16:05:47.661 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 147/160 2023-09-12T16:05:47.661 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-09-12T16:05:47.662 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 149/160 2023-09-12T16:05:47.662 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-09-12T16:05:47.662 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 151/160 2023-09-12T16:05:47.662 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-09-12T16:05:47.662 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 153/160 2023-09-12T16:05:47.662 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-09-12T16:05:47.663 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 155/160 2023-09-12T16:05:47.663 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-09-12T16:05:47.663 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-09-12T16:05:47.663 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-09-12T16:05:47.663 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-09-12T16:05:49.779 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-09-12T16:05:49.779 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:49.779 INFO:teuthology.orchestra.run.smithi112.stdout:Upgraded: 2023-09-12T16:05:49.780 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-09-12T16:05:49.780 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-09-12T16:05:49.780 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-09-12T16:05:49.780 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-09-12T16:05:49.781 INFO:teuthology.orchestra.run.smithi112.stdout: iproute-6.2.0-2.el8.x86_64 2023-09-12T16:05:49.781 INFO:teuthology.orchestra.run.smithi112.stdout: libblkid-2.32.1-43.el8.x86_64 2023-09-12T16:05:49.781 INFO:teuthology.orchestra.run.smithi112.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-09-12T16:05:49.781 INFO:teuthology.orchestra.run.smithi112.stdout: libmount-2.32.1-43.el8.x86_64 2023-09-12T16:05:49.782 INFO:teuthology.orchestra.run.smithi112.stdout: librados2-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.782 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.782 INFO:teuthology.orchestra.run.smithi112.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-09-12T16:05:49.783 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-2.32.1-43.el8.x86_64 2023-09-12T16:05:49.783 INFO:teuthology.orchestra.run.smithi112.stdout: util-linux-2.32.1-43.el8.x86_64 2023-09-12T16:05:49.783 INFO:teuthology.orchestra.run.smithi112.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-09-12T16:05:49.784 INFO:teuthology.orchestra.run.smithi112.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-09-12T16:05:49.784 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-09-12T16:05:49.784 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2023-09-12T16:05:49.785 INFO:teuthology.orchestra.run.smithi112.stdout: automake-1.16.1-8.el8.noarch 2023-09-12T16:05:49.785 INFO:teuthology.orchestra.run.smithi112.stdout: bison-3.0.4-10.el8.x86_64 2023-09-12T16:05:49.785 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.785 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.785 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.786 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.786 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards-2:18.0.0-6088.g2110e007.el8.noarch 2023-09-12T16:05:49.786 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.786 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.786 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.787 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm-2:18.0.0-6088.g2110e007.el8.noarch 2023-09-12T16:05:49.787 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard-2:18.0.0-6088.g2110e007.el8.noarch 2023-09-12T16:05:49.787 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6088.g2110e007.el8.noarch 2023-09-12T16:05:49.787 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core-2:18.0.0-6088.g2110e007.el8.noarch 2023-09-12T16:05:49.787 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook-2:18.0.0-6088.g2110e007.el8.noarch 2023-09-12T16:05:49.788 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.788 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.788 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts-2:18.0.0-6088.g2110e007.el8.noarch 2023-09-12T16:05:49.788 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.789 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.789 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.789 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume-2:18.0.0-6088.g2110e007.el8.noarch 2023-09-12T16:05:49.789 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm-2:18.0.0-6088.g2110e007.el8.noarch 2023-09-12T16:05:49.789 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.790 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top-2:18.0.0-6088.g2110e007.el8.noarch 2023-09-12T16:05:49.790 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-09-12T16:05:49.790 INFO:teuthology.orchestra.run.smithi112.stdout: flex-2.6.1-9.el8.x86_64 2023-09-12T16:05:49.790 INFO:teuthology.orchestra.run.smithi112.stdout: fuse-2.9.7-17.el8.x86_64 2023-09-12T16:05:49.790 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-12T16:05:49.791 INFO:teuthology.orchestra.run.smithi112.stdout: jq-1.6-7.el8.x86_64 2023-09-12T16:05:49.791 INFO:teuthology.orchestra.run.smithi112.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-12T16:05:49.791 INFO:teuthology.orchestra.run.smithi112.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-09-12T16:05:49.791 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-12T16:05:49.791 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.792 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.792 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.793 INFO:teuthology.orchestra.run.smithi112.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-09-12T16:05:49.793 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-09-12T16:05:49.793 INFO:teuthology.orchestra.run.smithi112.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-12T16:05:49.793 INFO:teuthology.orchestra.run.smithi112.stdout: libpq-13.5-1.el8.x86_64 2023-09-12T16:05:49.793 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-09-12T16:05:49.794 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-09-12T16:05:49.794 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.794 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.794 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-12T16:05:49.794 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.795 INFO:teuthology.orchestra.run.smithi112.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-09-12T16:05:49.795 INFO:teuthology.orchestra.run.smithi112.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-12T16:05:49.795 INFO:teuthology.orchestra.run.smithi112.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-12T16:05:49.795 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-12T16:05:49.795 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-09-12T16:05:49.796 INFO:teuthology.orchestra.run.smithi112.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-09-12T16:05:49.796 INFO:teuthology.orchestra.run.smithi112.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-09-12T16:05:49.796 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-12T16:05:49.797 INFO:teuthology.orchestra.run.smithi112.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-12T16:05:49.797 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-0.3.15-4.el8.x86_64 2023-09-12T16:05:49.797 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-09-12T16:05:49.797 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-09-12T16:05:49.797 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-09-12T16:05:49.798 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-09-12T16:05:49.798 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-09-12T16:05:49.798 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-10.23-2.module_el8+572+929c87ac.x86_64 2023-09-12T16:05:49.798 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-contrib-10.23-2.module_el8+572+929c87ac.x86_64 2023-09-12T16:05:49.798 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-server-10.23-2.module_el8+572+929c87ac.x86_64 2023-09-12T16:05:49.799 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-12T16:05:49.799 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-12T16:05:49.799 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-12T16:05:49.799 INFO:teuthology.orchestra.run.smithi112.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-12T16:05:49.799 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-12T16:05:49.800 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.800 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.800 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.800 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-12T16:05:49.800 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-09-12T16:05:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-12T16:05:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-12T16:05:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-09-12T16:05:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-12T16:05:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-12T16:05:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-12T16:05:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-12T16:05:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-12T16:05:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-12T16:05:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-12T16:05:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-12T16:05:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-12T16:05:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako-1.0.6-14.el8.noarch 2023-09-12T16:05:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-12T16:05:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-12T16:05:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-12T16:05:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-12T16:05:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-12T16:05:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-12T16:05:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-12T16:05:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend-2.6-1.el8.noarch 2023-09-12T16:05:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-12T16:05:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-12T16:05:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-12T16:05:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-12T16:05:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-12T16:05:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz-2017.2-11.el8.noarch 2023-09-12T16:05:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.807 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.807 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-12T16:05:49.807 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-12T16:05:49.807 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-12T16:05:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-12T16:05:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-09-12T16:05:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-12T16:05:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-12T16:05:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-12T16:05:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-12T16:05:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-12T16:05:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-12T16:05:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-12T16:05:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-12T16:05:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-12T16:05:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-12T16:05:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd-2:18.0.0-6088.g2110e007.el8.x86_64 2023-09-12T16:05:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-12T16:05:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-12T16:05:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: uuid-1.6.2-43.el8.x86_64 2023-09-12T16:05:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-09-12T16:05:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-12T16:05:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-09-12T16:05:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:49.814 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2023-09-12T16:05:50.082 DEBUG:teuthology.parallel:result is None 2023-09-12T16:05:50.083 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2110e00747b31a0d73768c9e5229da18b26b8aa0 2023-09-12T16:05:50.300 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-12T16:05:50.356 INFO:teuthology.orchestra.run.smithi112.stdout:18.0.0-6088.g2110e007.el8 2023-09-12T16:05:50.357 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6088.g2110e007.el8 2023-09-12T16:05:50.357 INFO:teuthology.task.install:The correct ceph version 18.0.0-6088.g2110e007 is installed. 2023-09-12T16:05:50.358 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2110e00747b31a0d73768c9e5229da18b26b8aa0 2023-09-12T16:05:50.493 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-12T16:05:50.550 INFO:teuthology.orchestra.run.smithi144.stdout:18.0.0-6088.g2110e007.el8 2023-09-12T16:05:50.550 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6088.g2110e007.el8 2023-09-12T16:05:50.551 INFO:teuthology.task.install:The correct ceph version 18.0.0-6088.g2110e007 is installed. 2023-09-12T16:05:50.551 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-12T16:05:50.552 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:05:50.552 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-12T16:05:50.628 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:05:50.629 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-12T16:05:50.707 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-12T16:05:50.708 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:05:50.708 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2023-09-12T16:05:50.779 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-12T16:05:50.889 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:05:50.889 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/daemon-helper 2023-09-12T16:05:50.963 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-12T16:05:51.075 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-12T16:05:51.076 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:05:51.076 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-12T16:05:51.148 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-12T16:05:51.258 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:05:51.259 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-12T16:05:51.331 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-12T16:05:51.446 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-12T16:05:51.449 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:05:51.449 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2023-09-12T16:05:51.521 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-12T16:05:51.631 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:05:51.632 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/stdin-killer 2023-09-12T16:05:51.703 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-12T16:05:51.814 INFO:teuthology.run_tasks:Running task ceph... 2023-09-12T16:05:51.887 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-09-12T16:05:51.887 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /var/log/ceph 2023-09-12T16:05:51.892 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 777 /var/log/ceph 2023-09-12T16:05:51.961 INFO:tasks.ceph:Disabling ceph logrotate... 2023-09-12T16:05:51.962 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-12T16:05:51.966 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-12T16:05:52.034 INFO:tasks.ceph:Creating extra log directories... 2023-09-12T16:05:52.035 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-12T16:05:52.040 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-12T16:05:52.121 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-09-12T16:05:52.122 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-09-12T16:05:52.123 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-09-12T16:05:52.123 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:05:52.124 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-12T16:05:52.171 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-12T16:05:52.451 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-09-12T16:05:52.523 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:05:52.523 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-12T16:05:52.569 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-12T16:05:52.803 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-09-12T16:05:52.879 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-09-12T16:05:52.879 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-09-12T16:05:52.880 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395106', 'branch': 'wip-batrick-testing-20230912.122437', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7395106', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-batrick-testing-20230912.122437'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '2110e00747b31a0d73768c9e5229da18b26b8aa0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2110e00747b31a0d73768c9e5229da18b26b8aa0'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20230912.122437', 'sha1': '3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9684, 'sha1': '2110e00747b31a0d73768c9e5229da18b26b8aa0', 'sleep_before_teardown': 0, 'subset': '236/256', 'suite': 'fs', 'suite_branch': 'wip-batrick-testing-20230912.122437', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph.git', 'suite_sha1': '3711e7dcbd7a68fe399334914fa2d5c17ccc9c2f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi112.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOxJ6kOmsgrZXrBHdjyaS3FupS2DpNCg992poiRE3v9HGGdki+q8Ob8IfsM20edNUkDFrcwcJBFX6N1WyRlzY5I=', 'smithi144.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFGsfkI/BaqRd4Q1OApYBZ/aE2WGKfM+H3kyeG0/zSMqM24+9vzyWS47Hj9eFoaxf1k/B1kRMo2LbDZqWjD2hXo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2110e00747b31a0d73768c9e5229da18b26b8aa0'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '2110e00747b31a0d73768c9e5229da18b26b8aa0', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-09-12_14:07:50', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1394'} 2023-09-12T16:05:52.880 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-12T16:05:52.885 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-12T16:05:52.932 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/run/ceph 2023-09-12T16:05:52.975 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/run/ceph 2023-09-12T16:05:53.045 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:05:53.045 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2023-09-12T16:05:53.092 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-12T16:05:53.092 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2023-09-12T16:05:53.181 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-12T16:05:53.181 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-12T16:05:53.181 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 444 Links: 1 2023-09-12T16:05:53.182 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-12T16:05:53.182 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2023-09-12T16:05:53.182 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2023-09-12 16:05:47.115286437 +0000 2023-09-12T16:05:53.182 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2023-09-12 16:02:29.430979459 +0000 2023-09-12T16:05:53.183 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2023-09-12 16:02:29.430979459 +0000 2023-09-12T16:05:53.183 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2023-09-12 16:02:29.403980149 +0000 2023-09-12T16:05:53.183 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-12T16:05:53.256 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2023-09-12T16:05:53.257 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2023-09-12T16:05:53.257 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.00027656 s, 1.9 MB/s 2023-09-12T16:05:53.260 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-12T16:05:53.310 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2023-09-12T16:05:53.357 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-12T16:05:53.357 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-12T16:05:53.357 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 450 Links: 1 2023-09-12T16:05:53.357 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-12T16:05:53.358 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2023-09-12T16:05:53.358 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2023-09-12 16:05:47.115286437 +0000 2023-09-12T16:05:53.358 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2023-09-12 16:02:30.305957128 +0000 2023-09-12T16:05:53.358 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2023-09-12 16:02:30.305957128 +0000 2023-09-12T16:05:53.359 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2023-09-12 16:02:30.280957766 +0000 2023-09-12T16:05:53.359 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-12T16:05:53.465 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2023-09-12T16:05:53.465 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2023-09-12T16:05:53.465 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000262553 s, 2.0 MB/s 2023-09-12T16:05:53.467 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-12T16:05:53.515 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2023-09-12T16:05:53.563 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-12T16:05:53.563 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-12T16:05:53.563 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 456 Links: 1 2023-09-12T16:05:53.564 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-12T16:05:53.564 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2023-09-12T16:05:53.564 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2023-09-12 16:05:47.116286412 +0000 2023-09-12T16:05:53.564 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2023-09-12 16:02:31.148935613 +0000 2023-09-12T16:05:53.565 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2023-09-12 16:02:31.148935613 +0000 2023-09-12T16:05:53.565 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2023-09-12 16:02:31.120936327 +0000 2023-09-12T16:05:53.565 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-12T16:05:53.634 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2023-09-12T16:05:53.635 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2023-09-12T16:05:53.635 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000263484 s, 1.9 MB/s 2023-09-12T16:05:53.637 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-12T16:05:53.687 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2023-09-12T16:05:53.734 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-12T16:05:53.735 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-12T16:05:53.735 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 462 Links: 1 2023-09-12T16:05:53.735 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-12T16:05:53.735 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2023-09-12T16:05:53.735 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2023-09-12 16:05:47.116286412 +0000 2023-09-12T16:05:53.736 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2023-09-12 16:02:31.988914174 +0000 2023-09-12T16:05:53.736 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2023-09-12 16:02:31.988914174 +0000 2023-09-12T16:05:53.736 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2023-09-12 16:02:31.963914812 +0000 2023-09-12T16:05:53.736 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-12T16:05:53.842 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2023-09-12T16:05:53.843 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2023-09-12T16:05:53.843 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000280199 s, 1.8 MB/s 2023-09-12T16:05:53.845 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-12T16:05:53.894 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-12T16:05:53.895 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:05:53.895 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/scratch_devs of=/dev/stdout 2023-09-12T16:05:53.945 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-12T16:05:53.946 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_1 2023-09-12T16:05:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-12T16:05:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-12T16:05:53.994 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-09-12T16:05:53.994 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-12T16:05:53.995 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-09-12T16:05:53.995 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-09-12 16:05:42.267510654 +0000 2023-09-12T16:05:53.995 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-09-12 16:02:29.506156095 +0000 2023-09-12T16:05:53.995 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-09-12 16:02:29.506156095 +0000 2023-09-12T16:05:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2023-09-12 16:02:29.481156481 +0000 2023-09-12T16:05:53.996 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-12T16:05:54.062 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-09-12T16:05:54.062 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-09-12T16:05:54.063 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000276598 s, 1.9 MB/s 2023-09-12T16:05:54.064 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-12T16:05:54.113 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_2 2023-09-12T16:05:54.159 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-12T16:05:54.160 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-12T16:05:54.160 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-09-12T16:05:54.160 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-12T16:05:54.160 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-09-12T16:05:54.161 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-09-12 16:05:42.268510638 +0000 2023-09-12T16:05:54.161 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-09-12 16:02:30.406142210 +0000 2023-09-12T16:05:54.161 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-09-12 16:02:30.406142210 +0000 2023-09-12T16:05:54.161 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2023-09-12 16:02:30.380142611 +0000 2023-09-12T16:05:54.162 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-12T16:05:54.265 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-09-12T16:05:54.265 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-09-12T16:05:54.266 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000286971 s, 1.8 MB/s 2023-09-12T16:05:54.267 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-12T16:05:54.315 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_3 2023-09-12T16:05:54.362 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-12T16:05:54.362 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-12T16:05:54.363 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-09-12T16:05:54.363 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-12T16:05:54.363 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-09-12T16:05:54.364 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-09-12 16:05:42.268510638 +0000 2023-09-12T16:05:54.364 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-09-12 16:02:31.248129219 +0000 2023-09-12T16:05:54.364 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-09-12 16:02:31.248129219 +0000 2023-09-12T16:05:54.364 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2023-09-12 16:02:31.225129574 +0000 2023-09-12T16:05:54.364 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-12T16:05:54.468 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-09-12T16:05:54.468 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-09-12T16:05:54.469 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000285874 s, 1.8 MB/s 2023-09-12T16:05:54.471 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-12T16:05:54.518 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_4 2023-09-12T16:05:54.603 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-12T16:05:54.604 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-12T16:05:54.604 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-09-12T16:05:54.604 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-12T16:05:54.604 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-09-12T16:05:54.605 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-09-12 16:05:42.268510638 +0000 2023-09-12T16:05:54.605 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-09-12 16:02:32.092116198 +0000 2023-09-12T16:05:54.605 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-09-12 16:02:32.092116198 +0000 2023-09-12T16:05:54.606 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2023-09-12 16:02:32.068116568 +0000 2023-09-12T16:05:54.606 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-12T16:05:54.709 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-09-12T16:05:54.709 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-09-12T16:05:54.710 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000456166 s, 1.1 MB/s 2023-09-12T16:05:54.711 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-12T16:05:54.758 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-12T16:05:54.759 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-12T16:05:54.759 INFO:tasks.ceph:Generating config... 2023-09-12T16:05:54.761 INFO:tasks.ceph:[client] pid file = 2023-09-12T16:05:54.761 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-09-12T16:05:54.761 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-09-12T16:05:54.762 INFO:tasks.ceph:[mgr] debug ms = 1 2023-09-12T16:05:54.762 INFO:tasks.ceph:[mon] debug mon = 20 2023-09-12T16:05:54.762 INFO:tasks.ceph:[mon] debug ms = 1 2023-09-12T16:05:54.763 INFO:tasks.ceph:[mon] debug paxos = 20 2023-09-12T16:05:54.763 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-09-12T16:05:54.764 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-09-12T16:05:54.764 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-09-12T16:05:54.764 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-09-12T16:05:54.764 INFO:tasks.ceph:[osd] debug ms = 1 2023-09-12T16:05:54.765 INFO:tasks.ceph:[osd] debug osd = 20 2023-09-12T16:05:54.765 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-09-12T16:05:54.765 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-09-12T16:05:54.766 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-09-12T16:05:54.766 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-09-12T16:05:54.766 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-09-12T16:05:54.766 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-09-12T16:05:54.767 INFO:tasks.ceph:Setting up mon.a... 2023-09-12T16:05:54.767 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-09-12T16:05:54.892 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.keyring 2023-09-12T16:05:54.898 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-09-12T16:05:55.000 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-12T16:05:55.071 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.112'), ('mon.b', '172.21.15.144'), ('mon.c', '[v2:172.21.15.144:3301,v1:172.21.15.144:6790]')] 2023-09-12T16:05:55.072 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.112,172.21.15.144,[v2:172.21.15.144:3301,v1:172.21.15.144:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2023-09-12T16:05:55.072 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:05:55.073 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-09-12T16:05:55.119 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.112 --add b 172.21.15.144 --addv c '[v2:172.21.15.144:3301,v1:172.21.15.144:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-09-12T16:05:55.250 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-09-12T16:05:55.250 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: generated fsid 81d9ebed-ec6c-4564-a5d4-cdbd74c977f8 2023-09-12T16:05:55.251 INFO:teuthology.orchestra.run.smithi112.stdout:setting min_mon_release = pacific 2023-09-12T16:05:55.251 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 0 2023-09-12T16:05:55.251 INFO:teuthology.orchestra.run.smithi112.stdout:fsid 81d9ebed-ec6c-4564-a5d4-cdbd74c977f8 2023-09-12T16:05:55.252 INFO:teuthology.orchestra.run.smithi112.stdout:last_changed 2023-09-12T16:05:55.251013+0000 2023-09-12T16:05:55.252 INFO:teuthology.orchestra.run.smithi112.stdout:created 2023-09-12T16:05:55.251013+0000 2023-09-12T16:05:55.252 INFO:teuthology.orchestra.run.smithi112.stdout:min_mon_release 16 (pacific) 2023-09-12T16:05:55.252 INFO:teuthology.orchestra.run.smithi112.stdout:election_strategy: 1 2023-09-12T16:05:55.252 INFO:teuthology.orchestra.run.smithi112.stdout:0: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.a 2023-09-12T16:05:55.253 INFO:teuthology.orchestra.run.smithi112.stdout:1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.b 2023-09-12T16:05:55.253 INFO:teuthology.orchestra.run.smithi112.stdout:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2023-09-12T16:05:55.253 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-09-12T16:05:55.254 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-09-12T16:05:55.301 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 81d9ebed-ec6c-4564-a5d4-cdbd74c977f8... 2023-09-12T16:05:55.302 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-12T16:05:55.345 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-12T16:05:55.462 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2023-09-12T16:05:55.462 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2023-09-12T16:05:55.462 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-12T16:05:55.462 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2023-09-12T16:05:55.463 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.463 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2023-09-12T16:05:55.463 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.463 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2023-09-12T16:05:55.463 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.464 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2023-09-12T16:05:55.464 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2023-09-12T16:05:55.464 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.464 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2023-09-12T16:05:55.464 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2023-09-12T16:05:55.465 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.465 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-12T16:05:55.465 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2023-09-12T16:05:55.465 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.465 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2023-09-12T16:05:55.465 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-12T16:05:55.466 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.466 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2023-09-12T16:05:55.466 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.466 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2023-09-12T16:05:55.466 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2023-09-12T16:05:55.467 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2023-09-12T16:05:55.467 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2023-09-12T16:05:55.467 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2023-09-12T16:05:55.467 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2023-09-12T16:05:55.467 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2023-09-12T16:05:55.468 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-12T16:05:55.468 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-12T16:05:55.468 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2023-09-12T16:05:55.468 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.469 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-12T16:05:55.469 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.469 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2023-09-12T16:05:55.469 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.470 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2023-09-12T16:05:55.470 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.470 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2023-09-12T16:05:55.470 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2023-09-12T16:05:55.470 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2023-09-12T16:05:55.471 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = "172.21.15.112,172.21.15.144,[v2:172.21.15.144:3301,v1:172.21.15.144:6790]" 2023-09-12T16:05:55.471 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on skipped message = False 2023-09-12T16:05:55.471 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = 81d9ebed-ec6c-4564-a5d4-cdbd74c977f8 2023-09-12T16:05:55.471 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.471 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2023-09-12T16:05:55.472 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2023-09-12T16:05:55.472 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.472 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2023-09-12T16:05:55.472 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2023-09-12T16:05:55.472 INFO:teuthology.orchestra.run.smithi112.stdout: osd mclock profile = high_recovery_ops 2023-09-12T16:05:55.472 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.473 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2023-09-12T16:05:55.473 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2023-09-12T16:05:55.473 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.473 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2023-09-12T16:05:55.473 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2023-09-12T16:05:55.474 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2023-09-12T16:05:55.474 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.474 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2023-09-12T16:05:55.474 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2023-09-12T16:05:55.474 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.475 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2023-09-12T16:05:55.475 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.475 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2023-09-12T16:05:55.475 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.475 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2023-09-12T16:05:55.476 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.476 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2023-09-12T16:05:55.476 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2023-09-12T16:05:55.476 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.476 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2023-09-12T16:05:55.477 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2023-09-12T16:05:55.477 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2023-09-12T16:05:55.477 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2023-09-12T16:05:55.477 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 20 2023-09-12T16:05:55.477 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 20 2023-09-12T16:05:55.477 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2023-09-12T16:05:55.478 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 20 2023-09-12T16:05:55.478 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 10 2023-09-12T16:05:55.478 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2023-09-12T16:05:55.478 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2023-09-12T16:05:55.479 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2023-09-12T16:05:55.479 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 0.95 2023-09-12T16:05:55.479 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = bluestore 2023-09-12T16:05:55.479 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.480 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2023-09-12T16:05:55.480 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2023-09-12T16:05:55.480 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2023-09-12T16:05:55.480 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2023-09-12T16:05:55.480 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2023-09-12T16:05:55.480 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2023-09-12T16:05:55.481 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2023-09-12T16:05:55.481 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2023-09-12T16:05:55.481 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.481 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2023-09-12T16:05:55.481 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2023-09-12T16:05:55.482 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2023-09-12T16:05:55.482 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2023-09-12T16:05:55.482 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2023-09-12T16:05:55.482 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2023-09-12T16:05:55.482 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2023-09-12T16:05:55.483 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2023-09-12T16:05:55.483 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2023-09-12T16:05:55.483 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2023-09-12T16:05:55.483 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2023-09-12T16:05:55.483 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.484 INFO:teuthology.orchestra.run.smithi112.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-12T16:05:55.484 INFO:teuthology.orchestra.run.smithi112.stdout: auth mon ticket ttl = 660 # 11m 2023-09-12T16:05:55.484 INFO:teuthology.orchestra.run.smithi112.stdout: auth service ticket ttl = 240 # 4m 2023-09-12T16:05:55.484 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.484 INFO:teuthology.orchestra.run.smithi112.stdout: # don't complain about insecure global_id in the test suite 2023-09-12T16:05:55.484 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-12T16:05:55.485 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-12T16:05:55.485 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.485 INFO:teuthology.orchestra.run.smithi112.stdout: # 1m isn't quite enough 2023-09-12T16:05:55.485 INFO:teuthology.orchestra.run.smithi112.stdout: mon_down_mkfs_grace = 2m 2023-09-12T16:05:55.485 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.486 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_filestore_osds = false 2023-09-12T16:05:55.486 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:05:55.486 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2023-09-12T16:05:55.486 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2023-09-12T16:05:55.486 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2023-09-12T16:05:55.487 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2023-09-12T16:05:55.487 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-12T16:05:55.487 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-12T16:05:55.487 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = "" 2023-09-12T16:05:55.487 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2023-09-12T16:05:55.488 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.b] 2023-09-12T16:05:55.488 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.c] 2023-09-12T16:05:55.488 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2023-09-12T16:05:55.488 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2023-09-12T16:05:55.488 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2023-09-12T16:05:55.488 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2023-09-12T16:05:55.489 INFO:teuthology.orchestra.run.smithi144.stdout:[global] 2023-09-12T16:05:55.490 INFO:teuthology.orchestra.run.smithi144.stdout: chdir = "" 2023-09-12T16:05:55.490 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-12T16:05:55.490 INFO:teuthology.orchestra.run.smithi144.stdout: auth supported = cephx 2023-09-12T16:05:55.490 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.490 INFO:teuthology.orchestra.run.smithi144.stdout: filestore xattr use omap = true 2023-09-12T16:05:55.491 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.491 INFO:teuthology.orchestra.run.smithi144.stdout: mon clock drift allowed = 1.000 2023-09-12T16:05:55.491 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.491 INFO:teuthology.orchestra.run.smithi144.stdout: osd crush chooseleaf type = 0 2023-09-12T16:05:55.491 INFO:teuthology.orchestra.run.smithi144.stdout: auth debug = true 2023-09-12T16:05:55.492 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.492 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on old message = true 2023-09-12T16:05:55.492 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on bug = true 2023-09-12T16:05:55.492 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.492 INFO:teuthology.orchestra.run.smithi144.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-12T16:05:55.493 INFO:teuthology.orchestra.run.smithi144.stdout: mon pg warn max object skew = 0 2023-09-12T16:05:55.493 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.493 INFO:teuthology.orchestra.run.smithi144.stdout: # disable pg_autoscaler by default for new pools 2023-09-12T16:05:55.493 INFO:teuthology.orchestra.run.smithi144.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-12T16:05:55.493 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.494 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default size = 2 2023-09-12T16:05:55.494 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.494 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow primary affinity = true 2023-09-12T16:05:55.494 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow pg remap = true 2023-09-12T16:05:55.494 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on legacy crush tunables = false 2023-09-12T16:05:55.494 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on crush straw calc version zero = false 2023-09-12T16:05:55.495 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on no sortbitwise = false 2023-09-12T16:05:55.495 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on osd down out interval zero = false 2023-09-12T16:05:55.495 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on too few osds = false 2023-09-12T16:05:55.495 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-12T16:05:55.495 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-12T16:05:55.496 INFO:teuthology.orchestra.run.smithi144.stdout: mon_allow_pool_size_one = true 2023-09-12T16:05:55.496 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.496 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-12T16:05:55.496 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.496 INFO:teuthology.orchestra.run.smithi144.stdout: osd default data pool replay window = 5 2023-09-12T16:05:55.496 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.497 INFO:teuthology.orchestra.run.smithi144.stdout: mon allow pool delete = true 2023-09-12T16:05:55.497 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.497 INFO:teuthology.orchestra.run.smithi144.stdout: mon cluster log file level = debug 2023-09-12T16:05:55.497 INFO:teuthology.orchestra.run.smithi144.stdout: debug asserts on shutdown = true 2023-09-12T16:05:55.497 INFO:teuthology.orchestra.run.smithi144.stdout: mon health detail to clog = false 2023-09-12T16:05:55.498 INFO:teuthology.orchestra.run.smithi144.stdout: mon host = "172.21.15.112,172.21.15.144,[v2:172.21.15.144:3301,v1:172.21.15.144:6790]" 2023-09-12T16:05:55.498 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on skipped message = False 2023-09-12T16:05:55.498 INFO:teuthology.orchestra.run.smithi144.stdout: fsid = 81d9ebed-ec6c-4564-a5d4-cdbd74c977f8 2023-09-12T16:05:55.498 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.498 INFO:teuthology.orchestra.run.smithi144.stdout:[osd] 2023-09-12T16:05:55.499 INFO:teuthology.orchestra.run.smithi144.stdout: osd journal size = 100 2023-09-12T16:05:55.499 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.499 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub load threshold = 5.0 2023-09-12T16:05:55.500 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub max interval = 600 2023-09-12T16:05:55.500 INFO:teuthology.orchestra.run.smithi144.stdout: osd mclock profile = high_recovery_ops 2023-09-12T16:05:55.500 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.500 INFO:teuthology.orchestra.run.smithi144.stdout: osd recover clone overlap = true 2023-09-12T16:05:55.501 INFO:teuthology.orchestra.run.smithi144.stdout: osd recovery max chunk = 1048576 2023-09-12T16:05:55.501 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.501 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug shutdown = true 2023-09-12T16:05:55.501 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug op order = true 2023-09-12T16:05:55.501 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug verify stray on activate = true 2023-09-12T16:05:55.502 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.502 INFO:teuthology.orchestra.run.smithi144.stdout: osd open classes on start = true 2023-09-12T16:05:55.502 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug pg log writeout = true 2023-09-12T16:05:55.502 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.502 INFO:teuthology.orchestra.run.smithi144.stdout: osd deep scrub update digest min age = 30 2023-09-12T16:05:55.503 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.503 INFO:teuthology.orchestra.run.smithi144.stdout: osd map max advance = 10 2023-09-12T16:05:55.503 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.503 INFO:teuthology.orchestra.run.smithi144.stdout: journal zero on create = true 2023-09-12T16:05:55.503 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.503 INFO:teuthology.orchestra.run.smithi144.stdout: filestore ondisk finisher threads = 3 2023-09-12T16:05:55.504 INFO:teuthology.orchestra.run.smithi144.stdout: filestore apply finisher threads = 3 2023-09-12T16:05:55.504 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.504 INFO:teuthology.orchestra.run.smithi144.stdout: bdev debug aio = true 2023-09-12T16:05:55.504 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug misdirected ops = true 2023-09-12T16:05:55.504 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore block size = 96636764160 2023-09-12T16:05:55.505 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore fsck on mount = True 2023-09-12T16:05:55.505 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluefs = 20 2023-09-12T16:05:55.505 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluestore = 20 2023-09-12T16:05:55.505 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-09-12T16:05:55.505 INFO:teuthology.orchestra.run.smithi144.stdout: debug osd = 20 2023-09-12T16:05:55.506 INFO:teuthology.orchestra.run.smithi144.stdout: debug rocksdb = 10 2023-09-12T16:05:55.506 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd backfillfull_ratio = 0.85 2023-09-12T16:05:55.506 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd full ratio = 0.9 2023-09-12T16:05:55.506 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd nearfull ratio = 0.8 2023-09-12T16:05:55.506 INFO:teuthology.orchestra.run.smithi144.stdout: osd failsafe full ratio = 0.95 2023-09-12T16:05:55.506 INFO:teuthology.orchestra.run.smithi144.stdout: osd objectstore = bluestore 2023-09-12T16:05:55.507 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.507 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr] 2023-09-12T16:05:55.507 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-09-12T16:05:55.507 INFO:teuthology.orchestra.run.smithi144.stdout: debug mgr = 20 2023-09-12T16:05:55.507 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2023-09-12T16:05:55.508 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2023-09-12T16:05:55.508 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2023-09-12T16:05:55.508 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2023-09-12T16:05:55.508 INFO:teuthology.orchestra.run.smithi144.stdout: mgr/telemetry/nag = false 2023-09-12T16:05:55.508 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.509 INFO:teuthology.orchestra.run.smithi144.stdout:[mon] 2023-09-12T16:05:55.509 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-09-12T16:05:55.509 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2023-09-12T16:05:55.509 INFO:teuthology.orchestra.run.smithi144.stdout: debug paxos = 20 2023-09-12T16:05:55.509 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2023-09-12T16:05:55.509 INFO:teuthology.orchestra.run.smithi144.stdout: mon data avail warn = 5 2023-09-12T16:05:55.510 INFO:teuthology.orchestra.run.smithi144.stdout: mon mgr mkfs grace = 240 2023-09-12T16:05:55.510 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2023-09-12T16:05:55.510 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd reporter subtree level = osd 2023-09-12T16:05:55.511 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd prime pg temp = true 2023-09-12T16:05:55.511 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2023-09-12T16:05:55.511 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.511 INFO:teuthology.orchestra.run.smithi144.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-12T16:05:55.511 INFO:teuthology.orchestra.run.smithi144.stdout: auth mon ticket ttl = 660 # 11m 2023-09-12T16:05:55.512 INFO:teuthology.orchestra.run.smithi144.stdout: auth service ticket ttl = 240 # 4m 2023-09-12T16:05:55.512 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.512 INFO:teuthology.orchestra.run.smithi144.stdout: # don't complain about insecure global_id in the test suite 2023-09-12T16:05:55.512 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-12T16:05:55.512 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-12T16:05:55.513 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.513 INFO:teuthology.orchestra.run.smithi144.stdout: # 1m isn't quite enough 2023-09-12T16:05:55.513 INFO:teuthology.orchestra.run.smithi144.stdout: mon_down_mkfs_grace = 2m 2023-09-12T16:05:55.513 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.513 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_filestore_osds = false 2023-09-12T16:05:55.514 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-12T16:05:55.514 INFO:teuthology.orchestra.run.smithi144.stdout:[client] 2023-09-12T16:05:55.514 INFO:teuthology.orchestra.run.smithi144.stdout: rgw cache enabled = true 2023-09-12T16:05:55.514 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable ops log = true 2023-09-12T16:05:55.514 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable usage log = true 2023-09-12T16:05:55.515 INFO:teuthology.orchestra.run.smithi144.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-12T16:05:55.515 INFO:teuthology.orchestra.run.smithi144.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-12T16:05:55.515 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = "" 2023-09-12T16:05:55.515 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.a] 2023-09-12T16:05:55.515 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.b] 2023-09-12T16:05:55.515 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.c] 2023-09-12T16:05:55.516 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2023-09-12T16:05:55.516 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.c] 2023-09-12T16:05:55.516 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2023-09-12T16:05:55.516 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.d] 2023-09-12T16:05:55.518 INFO:tasks.ceph:Creating admin key on mon.a... 2023-09-12T16:05:55.518 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-09-12T16:05:55.638 INFO:tasks.ceph:Copying monmap to all nodes... 2023-09-12T16:05:55.639 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:05:55.640 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-09-12T16:05:55.685 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:05:55.685 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-09-12T16:05:55.771 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi112.front.sepia.ceph.com 2023-09-12T16:05:55.772 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:05:55.772 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-12T16:05:55.773 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-12T16:05:55.910 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:05:55.911 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-12T16:05:55.998 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi144.front.sepia.ceph.com 2023-09-12T16:05:55.999 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:05:55.999 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-12T16:05:55.999 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-12T16:05:56.094 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:05:56.095 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-12T16:05:56.179 INFO:tasks.ceph:Setting up mon nodes... 2023-09-12T16:05:56.179 INFO:tasks.ceph:Setting up mgr nodes... 2023-09-12T16:05:56.180 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-09-12T16:05:56.305 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-09-12T16:05:56.311 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-09-12T16:05:56.440 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-09-12T16:05:56.447 INFO:tasks.ceph:Setting up mds nodes... 2023-09-12T16:05:56.447 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-09-12T16:05:56.573 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-09-12T16:05:56.578 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-09-12T16:05:56.654 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-09-12T16:05:56.778 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-09-12T16:05:56.784 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-09-12T16:05:56.854 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-09-12T16:05:56.976 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-09-12T16:05:56.982 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-09-12T16:05:57.053 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-09-12T16:05:57.173 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-09-12T16:05:57.178 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-09-12T16:05:57.251 INFO:tasks.ceph_client:Setting up client nodes... 2023-09-12T16:05:57.251 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-12T16:05:57.347 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-09-12T16:05:57.377 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-09-12T16:05:57.473 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-09-12T16:05:57.504 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-09-12T16:05:57.600 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-09-12T16:05:57.630 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-09-12T16:05:57.726 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-09-12T16:05:57.756 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-09-12T16:05:57.757 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-12T16:05:57.757 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-09-12T16:05:57.830 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-12T16:05:57.831 INFO:tasks.ceph:role: osd.0 2023-09-12T16:05:57.831 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com 2023-09-12T16:05:57.831 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-12T16:05:57.909 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-12T16:05:57.909 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-12T16:05:57.910 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-12T16:05:57.910 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-12T16:05:57.910 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-12T16:05:57.910 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2023-09-12T16:05:57.910 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-12T16:05:57.911 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-12T16:05:57.911 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-12T16:05:57.911 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-12T16:05:58.341 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2023-09-12T16:05:58.345 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2023-09-12T16:05:58.346 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-09-12T16:05:58.559 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-09-12T16:05:58.639 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-09-12T16:05:58.709 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-12T16:05:58.709 INFO:tasks.ceph:role: osd.1 2023-09-12T16:05:58.709 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com 2023-09-12T16:05:58.710 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-12T16:05:58.787 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-12T16:05:58.787 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-12T16:05:58.788 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-12T16:05:58.788 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-12T16:05:58.788 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-12T16:05:58.788 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2023-09-12T16:05:58.788 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-12T16:05:58.789 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-12T16:05:58.789 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-12T16:05:58.789 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-12T16:05:59.193 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2023-09-12T16:05:59.197 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2023-09-12T16:05:59.198 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-09-12T16:05:59.336 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-09-12T16:05:59.413 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-09-12T16:05:59.482 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-12T16:05:59.483 INFO:tasks.ceph:role: osd.2 2023-09-12T16:05:59.483 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com 2023-09-12T16:05:59.484 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-12T16:05:59.562 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-12T16:05:59.562 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-12T16:05:59.563 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-12T16:05:59.563 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-12T16:05:59.563 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-12T16:05:59.564 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2023-09-12T16:05:59.564 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-12T16:05:59.564 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-12T16:05:59.565 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-12T16:05:59.565 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-12T16:06:00.008 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2023-09-12T16:06:00.012 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2023-09-12T16:06:00.012 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-09-12T16:06:00.218 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-09-12T16:06:00.296 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-09-12T16:06:00.365 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-12T16:06:00.365 INFO:tasks.ceph:role: osd.3 2023-09-12T16:06:00.365 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com 2023-09-12T16:06:00.366 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-12T16:06:00.441 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-12T16:06:00.441 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-12T16:06:00.441 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-12T16:06:00.442 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-12T16:06:00.442 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-12T16:06:00.442 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2023-09-12T16:06:00.442 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-12T16:06:00.442 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-12T16:06:00.443 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-12T16:06:00.443 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-12T16:06:00.875 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2023-09-12T16:06:00.879 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2023-09-12T16:06:00.880 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-09-12T16:06:01.006 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-09-12T16:06:01.081 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-12T16:06:01.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:01.205+0000 7fdda1894680 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-09-12T16:06:01.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:01.206+0000 7fdda1894680 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-09-12T16:06:01.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:01.206+0000 7fdda1894680 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-12T16:06:01.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:01.206+0000 7fdda1894680 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-12T16:06:01.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:01.206+0000 7fdda1894680 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-12T16:06:01.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:01.208+0000 7fdda1894680 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-09-12T16:06:04.103 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-09-12T16:06:04.180 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-12T16:06:04.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:04.286+0000 7f0e21c28680 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-09-12T16:06:04.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:04.286+0000 7f0e21c28680 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-09-12T16:06:04.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:04.286+0000 7f0e21c28680 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-12T16:06:04.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:04.286+0000 7f0e21c28680 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-12T16:06:04.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:04.286+0000 7f0e21c28680 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-12T16:06:04.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:04.288+0000 7f0e21c28680 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-09-12T16:06:07.167 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-09-12T16:06:07.237 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-12T16:06:07.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:07.342+0000 7f6b57841680 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-09-12T16:06:07.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:07.343+0000 7f6b57841680 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-09-12T16:06:07.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:07.343+0000 7f6b57841680 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-12T16:06:07.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:07.343+0000 7f6b57841680 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-12T16:06:07.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:07.343+0000 7f6b57841680 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-12T16:06:07.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:07.344+0000 7f6b57841680 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-09-12T16:06:10.230 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-09-12T16:06:10.305 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-12T16:06:10.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:10.412+0000 7f7ed5cba680 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-09-12T16:06:10.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:10.412+0000 7f7ed5cba680 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-09-12T16:06:10.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:10.412+0000 7f7ed5cba680 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-12T16:06:10.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:10.412+0000 7f7ed5cba680 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-12T16:06:10.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:10.412+0000 7f7ed5cba680 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-12T16:06:10.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:10.414+0000 7f7ed5cba680 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-09-12T16:06:13.295 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-09-12T16:06:13.366 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-09-12T16:06:13.443 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-12T16:06:13.443 INFO:tasks.ceph:role: osd.4 2023-09-12T16:06:13.443 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com 2023-09-12T16:06:13.444 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-12T16:06:13.522 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-12T16:06:13.522 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-12T16:06:13.522 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-12T16:06:13.523 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-12T16:06:13.523 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-12T16:06:13.523 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2023-09-12T16:06:13.523 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-12T16:06:13.523 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-12T16:06:13.524 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-12T16:06:13.524 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-12T16:06:13.955 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2023-09-12T16:06:13.959 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2023-09-12T16:06:13.959 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-09-12T16:06:14.151 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-09-12T16:06:14.231 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-09-12T16:06:14.300 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-12T16:06:14.301 INFO:tasks.ceph:role: osd.5 2023-09-12T16:06:14.301 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com 2023-09-12T16:06:14.301 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-12T16:06:14.377 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-12T16:06:14.377 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-12T16:06:14.378 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-12T16:06:14.378 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-12T16:06:14.378 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-12T16:06:14.378 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2023-09-12T16:06:14.378 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-12T16:06:14.379 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-12T16:06:14.379 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-12T16:06:14.379 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-12T16:06:14.790 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2023-09-12T16:06:14.794 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2023-09-12T16:06:14.794 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-09-12T16:06:14.938 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-09-12T16:06:15.014 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-09-12T16:06:15.083 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-12T16:06:15.084 INFO:tasks.ceph:role: osd.6 2023-09-12T16:06:15.084 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com 2023-09-12T16:06:15.084 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-12T16:06:15.162 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-12T16:06:15.163 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-12T16:06:15.163 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-12T16:06:15.163 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-12T16:06:15.163 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-12T16:06:15.163 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2023-09-12T16:06:15.164 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-12T16:06:15.164 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-12T16:06:15.164 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-12T16:06:15.164 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-12T16:06:15.612 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2023-09-12T16:06:15.616 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2023-09-12T16:06:15.616 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-09-12T16:06:15.814 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-09-12T16:06:15.891 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-09-12T16:06:15.960 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-12T16:06:15.961 INFO:tasks.ceph:role: osd.7 2023-09-12T16:06:15.961 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi144.front.sepia.ceph.com 2023-09-12T16:06:15.961 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-12T16:06:16.037 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-12T16:06:16.037 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-12T16:06:16.038 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-12T16:06:16.038 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-12T16:06:16.038 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-12T16:06:16.038 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2023-09-12T16:06:16.038 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-12T16:06:16.039 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-12T16:06:16.039 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-12T16:06:16.039 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-12T16:06:16.474 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2023-09-12T16:06:16.478 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2023-09-12T16:06:16.478 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-09-12T16:06:16.601 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-09-12T16:06:16.677 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-12T16:06:16.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:16.814+0000 7fde64f13680 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-09-12T16:06:16.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:16.815+0000 7fde64f13680 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-09-12T16:06:16.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:16.815+0000 7fde64f13680 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-12T16:06:16.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:16.815+0000 7fde64f13680 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-12T16:06:16.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:16.815+0000 7fde64f13680 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-12T16:06:16.818 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:16.817+0000 7fde64f13680 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-09-12T16:06:19.690 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-09-12T16:06:19.760 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-12T16:06:19.866 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:19.865+0000 7f2d77481680 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-09-12T16:06:19.866 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:19.865+0000 7f2d77481680 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-09-12T16:06:19.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:19.865+0000 7f2d77481680 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-12T16:06:19.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:19.865+0000 7f2d77481680 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-12T16:06:19.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:19.865+0000 7f2d77481680 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-12T16:06:19.868 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:19.867+0000 7f2d77481680 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-09-12T16:06:22.754 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-09-12T16:06:22.824 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-12T16:06:22.883 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:06:22.890 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:06:22.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:22.931+0000 7fdd4ed41680 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-09-12T16:06:22.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:22.931+0000 7fdd4ed41680 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-09-12T16:06:22.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:22.931+0000 7fdd4ed41680 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-12T16:06:22.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:22.931+0000 7fdd4ed41680 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-12T16:06:22.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:22.931+0000 7fdd4ed41680 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-12T16:06:22.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:22.933+0000 7fdd4ed41680 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-09-12T16:06:25.811 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-09-12T16:06:25.883 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-12T16:06:25.989 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:25.988+0000 7fb083b3d680 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-09-12T16:06:25.989 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:25.988+0000 7fb083b3d680 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-09-12T16:06:25.990 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:25.988+0000 7fb083b3d680 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-12T16:06:25.990 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:25.988+0000 7fb083b3d680 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-12T16:06:25.990 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:25.989+0000 7fb083b3d680 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-12T16:06:25.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:25.990+0000 7fb083b3d680 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-09-12T16:06:28.873 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-09-12T16:06:28.968 INFO:tasks.ceph:Reading keys from all nodes... 2023-09-12T16:06:28.969 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:06:28.969 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-09-12T16:06:29.047 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:06:29.048 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-09-12T16:06:29.119 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:06:29.119 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-09-12T16:06:29.228 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:06:29.228 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-09-12T16:06:29.340 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:06:29.340 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-09-12T16:06:29.450 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:06:29.450 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-09-12T16:06:29.558 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:06:29.558 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-09-12T16:06:29.666 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:06:29.667 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-09-12T16:06:29.738 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:06:29.738 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-09-12T16:06:29.846 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:06:29.847 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-09-12T16:06:29.955 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:06:29.955 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-09-12T16:06:30.064 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:06:30.065 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-09-12T16:06:30.172 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:06:30.173 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-09-12T16:06:30.281 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:06:30.281 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-09-12T16:06:30.390 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:06:30.390 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-09-12T16:06:30.440 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:06:30.441 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-09-12T16:06:30.488 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:06:30.488 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-09-12T16:06:30.534 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:06:30.534 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-09-12T16:06:30.620 INFO:tasks.ceph:Adding keys to all mons... 2023-09-12T16:06:30.620 DEBUG:teuthology.orchestra.run.smithi112:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-12T16:06:30.625 DEBUG:teuthology.orchestra.run.smithi144:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-12T16:06:30.688 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.y] 2023-09-12T16:06:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBkjABl+vBDEhAA4guEAd/rB5VT70uNSD4lyQ== 2023-09-12T16:06:30.689 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2023-09-12T16:06:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBkjABlcnI5IhAA4KjsiSlms0q15lYoehZrpA== 2023-09-12T16:06:30.690 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2023-09-12T16:06:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBkjABlSEB7LhAAKj906Xw+a7p03uZdi7G/0w== 2023-09-12T16:06:30.690 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.0] 2023-09-12T16:06:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBpjABl5jhjDBAAO4mg8APpbTMqMiavi6+75Q== 2023-09-12T16:06:30.691 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.1] 2023-09-12T16:06:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBsjABlfDAwERAAeOAvw+ROioCY8uTw0QuYHQ== 2023-09-12T16:06:30.691 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.2] 2023-09-12T16:06:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBvjABlElx9FBAA//LK5Gz3B9uovoZa3RtdEA== 2023-09-12T16:06:30.691 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.3] 2023-09-12T16:06:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQByjABlSSyeGBAAQ68qs/Xy5R/gCknRy4cmzA== 2023-09-12T16:06:30.692 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.x] 2023-09-12T16:06:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBkjABld3pVGhAAla9C2ULbpQGFmMOCTXS8Ew== 2023-09-12T16:06:30.692 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2023-09-12T16:06:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBkjABllolFOhAAiGUCCZYXPwNOHlWOOdBmBg== 2023-09-12T16:06:30.693 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2023-09-12T16:06:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBljABlMuxrChAAdgPVTKIGrdlkz1WX5clXRg== 2023-09-12T16:06:30.694 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.4] 2023-09-12T16:06:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQB4jABls22oMBAAIEWtvZaDd+nLjbEsBFqyjA== 2023-09-12T16:06:30.694 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.5] 2023-09-12T16:06:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQB7jABl0zuoMxAArU9jOFhO+XkwBBEGXPQZkg== 2023-09-12T16:06:30.695 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.6] 2023-09-12T16:06:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQB+jABlOcqZNxAA1xbcGjYt2yV3zE7vSB+Mtg== 2023-09-12T16:06:30.695 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.7] 2023-09-12T16:06:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCBjABlM7oBOxAAiQm3vxPpzGFS/iihZdux2A== 2023-09-12T16:06:30.696 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2023-09-12T16:06:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBljABl3NnCFBAAwqxLxKcPIqofg05riNxItA== 2023-09-12T16:06:30.696 INFO:teuthology.orchestra.run.smithi112.stdout:[client.2] 2023-09-12T16:06:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBljABlQtxGHBAAG3RVHWCbv47uaDSvO+P95g== 2023-09-12T16:06:30.696 INFO:teuthology.orchestra.run.smithi112.stdout:[client.1] 2023-09-12T16:06:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBljABl0EDcIxAAxcXZKmXoV0YGuRy6fhqNqw== 2023-09-12T16:06:30.697 INFO:teuthology.orchestra.run.smithi112.stdout:[client.3] 2023-09-12T16:06:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBljABlsAtWKxAAe2kr/0FNktRRXWa7IRVXCQ== 2023-09-12T16:06:30.725 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr.y] 2023-09-12T16:06:30.725 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBkjABl+vBDEhAA4guEAd/rB5VT70uNSD4lyQ== 2023-09-12T16:06:30.726 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2023-09-12T16:06:30.726 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBkjABlcnI5IhAA4KjsiSlms0q15lYoehZrpA== 2023-09-12T16:06:30.726 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.c] 2023-09-12T16:06:30.727 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBkjABlSEB7LhAAKj906Xw+a7p03uZdi7G/0w== 2023-09-12T16:06:30.728 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.0] 2023-09-12T16:06:30.728 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBpjABl5jhjDBAAO4mg8APpbTMqMiavi6+75Q== 2023-09-12T16:06:30.728 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.1] 2023-09-12T16:06:30.728 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBsjABlfDAwERAAeOAvw+ROioCY8uTw0QuYHQ== 2023-09-12T16:06:30.728 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.2] 2023-09-12T16:06:30.729 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBvjABlElx9FBAA//LK5Gz3B9uovoZa3RtdEA== 2023-09-12T16:06:30.729 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.3] 2023-09-12T16:06:30.729 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQByjABlSSyeGBAAQ68qs/Xy5R/gCknRy4cmzA== 2023-09-12T16:06:30.730 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr.x] 2023-09-12T16:06:30.730 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBkjABld3pVGhAAla9C2ULbpQGFmMOCTXS8Ew== 2023-09-12T16:06:30.730 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2023-09-12T16:06:30.730 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBkjABllolFOhAAiGUCCZYXPwNOHlWOOdBmBg== 2023-09-12T16:06:30.730 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.d] 2023-09-12T16:06:30.731 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBljABlMuxrChAAdgPVTKIGrdlkz1WX5clXRg== 2023-09-12T16:06:30.731 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.4] 2023-09-12T16:06:30.731 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQB4jABls22oMBAAIEWtvZaDd+nLjbEsBFqyjA== 2023-09-12T16:06:30.732 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.5] 2023-09-12T16:06:30.732 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQB7jABl0zuoMxAArU9jOFhO+XkwBBEGXPQZkg== 2023-09-12T16:06:30.732 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.6] 2023-09-12T16:06:30.732 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQB+jABlOcqZNxAA1xbcGjYt2yV3zE7vSB+Mtg== 2023-09-12T16:06:30.732 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.7] 2023-09-12T16:06:30.733 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCBjABlM7oBOxAAiQm3vxPpzGFS/iihZdux2A== 2023-09-12T16:06:30.733 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2023-09-12T16:06:30.733 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBljABl3NnCFBAAwqxLxKcPIqofg05riNxItA== 2023-09-12T16:06:30.733 INFO:teuthology.orchestra.run.smithi144.stdout:[client.2] 2023-09-12T16:06:30.733 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBljABlQtxGHBAAG3RVHWCbv47uaDSvO+P95g== 2023-09-12T16:06:30.734 INFO:teuthology.orchestra.run.smithi144.stdout:[client.1] 2023-09-12T16:06:30.734 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBljABl0EDcIxAAxcXZKmXoV0YGuRy6fhqNqw== 2023-09-12T16:06:30.734 INFO:teuthology.orchestra.run.smithi144.stdout:[client.3] 2023-09-12T16:06:30.734 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBljABlsAtWKxAAe2kr/0FNktRRXWa7IRVXCQ== 2023-09-12T16:06:30.735 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-12T16:06:30.743 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-12T16:06:30.883 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-12T16:06:30.888 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-12T16:06:31.000 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-12T16:06:31.004 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-12T16:06:31.115 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-12T16:06:31.119 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-12T16:06:31.228 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-12T16:06:31.233 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-12T16:06:31.342 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-12T16:06:31.347 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-12T16:06:31.455 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-12T16:06:31.460 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-12T16:06:31.568 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-12T16:06:31.574 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-12T16:06:31.683 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-12T16:06:31.687 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-12T16:06:31.800 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-12T16:06:31.804 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-12T16:06:31.916 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-12T16:06:31.921 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-12T16:06:32.030 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-12T16:06:32.035 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-12T16:06:32.143 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-12T16:06:32.148 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-12T16:06:32.256 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-12T16:06:32.260 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-12T16:06:32.369 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-12T16:06:32.373 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-12T16:06:32.484 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-12T16:06:32.489 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-12T16:06:32.601 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-12T16:06:32.606 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-12T16:06:32.718 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-12T16:06:32.723 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-12T16:06:32.834 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-09-12T16:06:32.835 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-09-12T16:06:32.904 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-12T16:06:33.026 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-09-12T16:06:33.098 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-09-12T16:06:33.167 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-12T16:06:33.291 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-09-12T16:06:33.361 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-09-12T16:06:33.431 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-12T16:06:33.553 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-09-12T16:06:33.624 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-12T16:06:33.629 DEBUG:teuthology.orchestra.run.smithi144:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-12T16:06:33.674 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-09-12T16:06:33.674 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-12T16:06:33.675 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-12T16:06:33.716 INFO:tasks.ceph.mon.a:Started 2023-09-12T16:06:33.716 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-12T16:06:33.717 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-12T16:06:33.722 INFO:tasks.ceph.mon.b:Started 2023-09-12T16:06:33.723 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-12T16:06:33.723 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-12T16:06:33.728 INFO:tasks.ceph.mon.c:Started 2023-09-12T16:06:33.728 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2023-09-12T16:06:33.729 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2023-09-12T16:06:33.733 INFO:tasks.ceph:setting config [client] debug_client = 20 2023-09-12T16:06:33.733 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set client debug_client 20 2023-09-12T16:06:33.778 INFO:tasks.ceph:setting config [client] debug_ms = 1 2023-09-12T16:06:33.779 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set client debug_ms 1 2023-09-12T16:06:33.825 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2023-09-12T16:06:33.826 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2023-09-12T16:06:33.873 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2023-09-12T16:06:33.873 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2023-09-12T16:06:33.921 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2023-09-12T16:06:33.921 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set mds debug_mds 20 2023-09-12T16:06:33.968 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2023-09-12T16:06:33.969 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2023-09-12T16:06:34.017 INFO:tasks.ceph:setting config [mds] debug_ms = 1 2023-09-12T16:06:34.017 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set mds debug_ms 1 2023-09-12T16:06:34.067 INFO:tasks.ceph:setting config [mds] mds_bal_fragment_size_max = 10000 2023-09-12T16:06:34.067 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set mds mds_bal_fragment_size_max 10000 2023-09-12T16:06:34.122 INFO:tasks.ceph:setting config [mds] mds_bal_merge_size = 5 2023-09-12T16:06:34.122 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set mds mds_bal_merge_size 5 2023-09-12T16:06:34.164 INFO:tasks.ceph:setting config [mds] mds_bal_split_bits = 3 2023-09-12T16:06:34.165 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set mds mds_bal_split_bits 3 2023-09-12T16:06:34.241 INFO:tasks.ceph:setting config [mds] mds_bal_split_size = 100 2023-09-12T16:06:34.242 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set mds mds_bal_split_size 100 2023-09-12T16:06:34.254 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2023-09-12T16:06:34.254 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2023-09-12T16:06:34.309 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2023-09-12T16:06:34.309 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2023-09-12T16:06:34.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.315+0000 7fadaf5ff700 1 -- 172.21.15.112:0/1068511925 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fada80cd950 msgr2=0x7fada80b0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.315+0000 7fadaf5ff700 1 --2- 172.21.15.112:0/1068511925 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fada80cd950 0x7fada80b0220 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fada0000f80 tx=0x7fada0004ad0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.327 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2023-09-12T16:06:34.327 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2023-09-12T16:06:34.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.318+0000 7fadaf5ff700 1 -- 172.21.15.112:0/1068511925 shutdown_connections 2023-09-12T16:06:34.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.318+0000 7fadaf5ff700 1 --2- 172.21.15.112:0/1068511925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fada815caf0 0x7fada80c37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.318+0000 7fadaf5ff700 1 --2- 172.21.15.112:0/1068511925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fada80cd570 0x7fada80b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.318+0000 7fadaf5ff700 1 --2- 172.21.15.112:0/1068511925 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fada80cd950 0x7fada80b0220 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.318+0000 7fadaf5ff700 1 -- 172.21.15.112:0/1068511925 >> 172.21.15.112:0/1068511925 conn(0x7fada806a020 msgr2=0x7fada80ae7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:34.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.334+0000 7f1e951ff700 1 -- 172.21.15.112:0/2559557413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e900cd570 msgr2=0x7f1e900ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.334+0000 7f1e951ff700 1 --2- 172.21.15.112:0/2559557413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e900cd570 0x7f1e900ccb60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1e840098c0 tx=0x7f1e84009bd0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.347 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2023-09-12T16:06:34.348 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2023-09-12T16:06:34.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.335+0000 7fadaf5ff700 1 -- 172.21.15.112:0/1068511925 shutdown_connections 2023-09-12T16:06:34.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.337+0000 7fadaf5ff700 1 -- 172.21.15.112:0/1068511925 wait complete. 2023-09-12T16:06:34.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.337+0000 7f1e951ff700 1 -- 172.21.15.112:0/2559557413 shutdown_connections 2023-09-12T16:06:34.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.337+0000 7f1e951ff700 1 --2- 172.21.15.112:0/2559557413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e900cd570 0x7f1e900ccb60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.337+0000 7f1e951ff700 1 --2- 172.21.15.112:0/2559557413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e9015caf0 0x7f1e900cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.337+0000 7f1e951ff700 1 -- 172.21.15.112:0/2559557413 >> 172.21.15.112:0/2559557413 conn(0x7f1e9006a020 msgr2=0x7f1e9006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:34.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.355+0000 7f248ebff700 1 -- 172.21.15.112:0/2732360592 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7f2460000e80 con 0x7f248816bb20 2023-09-12T16:06:34.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.355+0000 7f1e951ff700 1 -- 172.21.15.112:0/2559557413 shutdown_connections 2023-09-12T16:06:34.389 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2023-09-12T16:06:34.389 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2023-09-12T16:06:34.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.357+0000 7f1e951ff700 1 -- 172.21.15.112:0/2559557413 wait complete. 2023-09-12T16:06:34.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.360+0000 7f1e951ff700 1 Processor -- start 2023-09-12T16:06:34.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.360+0000 7f1e951ff700 1 -- start start 2023-09-12T16:06:34.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.361+0000 7f1e951ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e900cd570 0x7f1e900a64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.361+0000 7f1e951ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e900cd950 0x7f1e900c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.361+0000 7f1e951ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e9015caf0 0x7f1e900c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.361+0000 7f1e951ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e900a6aa0 con 0x7f1e9015caf0 2023-09-12T16:06:34.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.361+0000 7f1e951ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e900a6d80 con 0x7f1e900cd570 2023-09-12T16:06:34.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.362+0000 7f1e951ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e900a7060 con 0x7f1e900cd950 2023-09-12T16:06:34.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.363+0000 7f1e8ed9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e900cd570 0x7f1e900a64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:34.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.364+0000 7f1e8e59c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e900cd950 0x7f1e900c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:34.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.364+0000 7f1e8e59c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e900cd950 0x7f1e900c5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.112:48658/0 (socket says 172.21.15.112:48658) 2023-09-12T16:06:34.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.364+0000 7f1e8e59c700 1 -- 172.21.15.112:0/987272885 learned_addr learned my addr 172.21.15.112:0/987272885 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:34.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.365+0000 7f1e8e59c700 1 -- 172.21.15.112:0/987272885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e900cd570 msgr2=0x7f1e900a64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.365+0000 7f1e8e59c700 1 --2- 172.21.15.112:0/987272885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e900cd570 0x7f1e900a64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.365+0000 7f1e8e59c700 1 -- 172.21.15.112:0/987272885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e9015caf0 msgr2=0x7f1e900c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.365+0000 7f1e8e59c700 1 --2- 172.21.15.112:0/987272885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e9015caf0 0x7f1e900c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.365+0000 7f1e8e59c700 1 -- 172.21.15.112:0/987272885 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e84009520 con 0x7f1e900cd950 2023-09-12T16:06:34.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.365+0000 7f1e8e59c700 1 --2- 172.21.15.112:0/987272885 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e900cd950 0x7f1e900c5dd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1e8000b4a0 tx=0x7f1e8000b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:34.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.367+0000 7f1e777fe700 1 -- 172.21.15.112:0/987272885 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e80011830 con 0x7f1e900cd950 2023-09-12T16:06:34.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.367+0000 7f1e777fe700 1 -- 172.21.15.112:0/987272885 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(3 keys) v1 ==== 79+0+0 (secure 0 0 0) 0x7f1e80011990 con 0x7f1e900cd950 2023-09-12T16:06:34.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.367+0000 7f1e777fe700 1 -- 172.21.15.112:0/987272885 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e80011d40 con 0x7f1e900cd950 2023-09-12T16:06:34.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.367+0000 7f1e951ff700 1 -- 172.21.15.112:0/987272885 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e900a7340 con 0x7f1e900cd950 2023-09-12T16:06:34.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.367+0000 7f1e951ff700 1 -- 172.21.15.112:0/987272885 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e900c6310 con 0x7f1e900cd950 2023-09-12T16:06:34.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.369+0000 7f1e777fe700 1 -- 172.21.15.112:0/987272885 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1e8001a700 con 0x7f1e900cd950 2023-09-12T16:06:34.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.369+0000 7f1e777fe700 1 -- 172.21.15.112:0/987272885 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1e80019790 con 0x7f1e900cd950 2023-09-12T16:06:34.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.371+0000 7f1e951ff700 1 -- 172.21.15.112:0/987272885 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e700050e0 con 0x7f1e900cd950 2023-09-12T16:06:34.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.375+0000 7f1e777fe700 1 -- 172.21.15.112:0/987272885 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f1e80039b20 con 0x7f1e900cd950 2023-09-12T16:06:34.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.389+0000 7f24857fa700 1 -- 172.21.15.112:0/2732360592 <== mon.2 v2:172.21.15.144:3301/0 9 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7f2480003f60 con 0x7f248816bb20 2023-09-12T16:06:34.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.389+0000 7f24857fa700 1 -- 172.21.15.112:0/2732360592 <== mon.2 v2:172.21.15.144:3301/0 10 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v5)=0 v5) v1 ==== 123+0+0 (secure 0 0 0) 0x7f2480004170 con 0x7f248816bb20 2023-09-12T16:06:34.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.392+0000 7f248ebff700 1 -- 172.21.15.112:0/2732360592 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f248816bb20 msgr2=0x7f248816a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.392+0000 7f248ebff700 1 --2- 172.21.15.112:0/2732360592 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f248816bb20 0x7f248816a700 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2480007f30 tx=0x7f248000c3a0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.395+0000 7f248ebff700 1 -- 172.21.15.112:0/2732360592 shutdown_connections 2023-09-12T16:06:34.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.395+0000 7f248ebff700 1 --2- 172.21.15.112:0/2732360592 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f248816bb20 0x7f248816a700 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.395+0000 7f248ebff700 1 --2- 172.21.15.112:0/2732360592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2488088be0 0x7f2488160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.395+0000 7f248ebff700 1 --2- 172.21.15.112:0/2732360592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24880cd9e0 0x7f24880b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.395+0000 7f248ebff700 1 -- 172.21.15.112:0/2732360592 >> 172.21.15.112:0/2732360592 conn(0x7f248806a020 msgr2=0x7f2488070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:34.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.397+0000 7f9d377fe700 1 -- 172.21.15.112:0/2080731994 <== mon.1 v2:172.21.15.144:3300/0 8 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7f9d44020db0 con 0x7f9d501f97e0 2023-09-12T16:06:34.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.396+0000 7f1e777fe700 1 -- 172.21.15.112:0/987272885 <== mon.2 v2:172.21.15.144:3301/0 7 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7f1e8001ac10 con 0x7f1e900cd950 2023-09-12T16:06:34.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.398+0000 7faec35ff700 1 -- 172.21.15.112:0/3965506984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faebc0c7b60 msgr2=0x7faebc0c8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.398+0000 7faec35ff700 1 --2- 172.21.15.112:0/3965506984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faebc0c7b60 0x7faebc0c8370 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7faeb8005fd0 tx=0x7faeb8009c70 comp rx=0 tx=0).stop 2023-09-12T16:06:34.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.401+0000 7faec35ff700 1 -- 172.21.15.112:0/3965506984 shutdown_connections 2023-09-12T16:06:34.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.401+0000 7faec35ff700 1 --2- 172.21.15.112:0/3965506984 >> v2:172.21.15.144:3300/0 conn(0x7faebc0cd7e0 0x7faebc0c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.401+0000 7faec35ff700 1 --2- 172.21.15.112:0/3965506984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faebc0c7b60 0x7faebc0c8370 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.401+0000 7faec35ff700 1 --2- 172.21.15.112:0/3965506984 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faebc0cb740 0x7faebc0cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.401+0000 7faec35ff700 1 -- 172.21.15.112:0/3965506984 >> 172.21.15.112:0/3965506984 conn(0x7faebc06a020 msgr2=0x7faebc06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:34.419 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2023-09-12T16:06:34.419 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2023-09-12T16:06:34.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.410+0000 7f248ebff700 1 -- 172.21.15.112:0/2732360592 shutdown_connections 2023-09-12T16:06:34.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.410+0000 7f248ebff700 1 -- 172.21.15.112:0/2732360592 wait complete. 2023-09-12T16:06:34.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.409+0000 7faec35ff700 1 -- 172.21.15.112:0/3965506984 shutdown_connections 2023-09-12T16:06:34.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.409+0000 7faec35ff700 1 -- 172.21.15.112:0/3965506984 wait complete. 2023-09-12T16:06:34.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.412+0000 7faec35ff700 1 Processor -- start 2023-09-12T16:06:34.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.412+0000 7faec35ff700 1 -- start start 2023-09-12T16:06:34.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.414+0000 7faec35ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faebc0c7b60 0x7faebc166d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.414+0000 7faec35ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faebc0cb740 0x7faebc0714f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.414+0000 7faec35ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faebc0cd7e0 0x7faebc071a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.414+0000 7faec35ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc0c71a0 con 0x7faebc0c7b60 2023-09-12T16:06:34.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.414+0000 7faec35ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc0c6620 con 0x7faebc0cd7e0 2023-09-12T16:06:34.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.414+0000 7faec35ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faebc0c6900 con 0x7faebc0cb740 2023-09-12T16:06:34.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.419+0000 7faec1b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faebc0cd7e0 0x7faebc071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:34.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.419+0000 7faec1b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faebc0cd7e0 0x7faebc071a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.112:45128/0 (socket says 172.21.15.112:45128) 2023-09-12T16:06:34.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.419+0000 7faec1b9c700 1 -- 172.21.15.112:0/621810738 learned_addr learned my addr 172.21.15.112:0/621810738 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:34.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.422+0000 7faec0b9a700 1 --2- 172.21.15.112:0/621810738 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faebc0cb740 0x7faebc0714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:34.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.423+0000 7faec1b9c700 1 -- 172.21.15.112:0/621810738 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faebc0cb740 msgr2=0x7faebc0714f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.423+0000 7faec1b9c700 1 --2- 172.21.15.112:0/621810738 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faebc0cb740 0x7faebc0714f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.423+0000 7faec1b9c700 1 -- 172.21.15.112:0/621810738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faebc0c7b60 msgr2=0x7faebc166d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.423+0000 7faec1b9c700 1 --2- 172.21.15.112:0/621810738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faebc0c7b60 0x7faebc166d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.423+0000 7faec1b9c700 1 -- 172.21.15.112:0/621810738 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb80095f0 con 0x7faebc0cd7e0 2023-09-12T16:06:34.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.424+0000 7faec1b9c700 1 --2- 172.21.15.112:0/621810738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faebc0cd7e0 0x7faebc071a30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faeb400b990 tx=0x7faeb400bca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:34.433 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2023-09-12T16:06:34.434 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2023-09-12T16:06:34.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.425+0000 7faeb1ffb700 1 -- 172.21.15.112:0/621810738 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb400c930 con 0x7faebc0cd7e0 2023-09-12T16:06:34.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.425+0000 7faeb1ffb700 1 -- 172.21.15.112:0/621810738 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7faeb400cb60 con 0x7faebc0cd7e0 2023-09-12T16:06:34.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.425+0000 7faeb1ffb700 1 -- 172.21.15.112:0/621810738 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4014440 con 0x7faebc0cd7e0 2023-09-12T16:06:34.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.425+0000 7faec35ff700 1 -- 172.21.15.112:0/621810738 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faebc0c6be0 con 0x7faebc0cd7e0 2023-09-12T16:06:34.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.425+0000 7faec35ff700 1 -- 172.21.15.112:0/621810738 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faebc167750 con 0x7faebc0cd7e0 2023-09-12T16:06:34.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.428+0000 7faeb1ffb700 1 -- 172.21.15.112:0/621810738 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faeb4006d50 con 0x7faebc0cd7e0 2023-09-12T16:06:34.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.428+0000 7faeb1ffb700 1 -- 172.21.15.112:0/621810738 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7faeb401eb20 con 0x7faebc0cd7e0 2023-09-12T16:06:34.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.433+0000 7faec35ff700 1 -- 172.21.15.112:0/621810738 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae9c0052f0 con 0x7faebc0cd7e0 2023-09-12T16:06:34.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.442+0000 7faeb1ffb700 1 -- 172.21.15.112:0/621810738 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7faeb4019070 con 0x7faebc0cd7e0 2023-09-12T16:06:34.497 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2023-09-12T16:06:34.497 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2023-09-12T16:06:34.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.475+0000 7f9d553ff700 1 -- 172.21.15.112:0/2080731994 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7f9d28005370 con 0x7f9d501f97e0 2023-09-12T16:06:34.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.486+0000 7fb2843ff700 1 -- 172.21.15.112:0/2771798214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb27c071c20 msgr2=0x7fb27c0cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.486+0000 7fb2843ff700 1 --2- 172.21.15.112:0/2771798214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb27c071c20 0x7fb27c0cd140 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb278005fd0 tx=0x7fb278009c70 comp rx=0 tx=0).stop 2023-09-12T16:06:34.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.488+0000 7fb2843ff700 1 -- 172.21.15.112:0/2771798214 shutdown_connections 2023-09-12T16:06:34.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.488+0000 7fb2843ff700 1 --2- 172.21.15.112:0/2771798214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb27c071c20 0x7fb27c0cd140 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.488+0000 7fb2843ff700 1 -- 172.21.15.112:0/2771798214 >> 172.21.15.112:0/2771798214 conn(0x7fb27c06e220 msgr2=0x7fb27c06a020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:34.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.488+0000 7fb2843ff700 1 -- 172.21.15.112:0/2771798214 shutdown_connections 2023-09-12T16:06:34.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.488+0000 7fb2843ff700 1 -- 172.21.15.112:0/2771798214 wait complete. 2023-09-12T16:06:34.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.491+0000 7fb2843ff700 1 Processor -- start 2023-09-12T16:06:34.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.491+0000 7fb2843ff700 1 -- start start 2023-09-12T16:06:34.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.493+0000 7fb2843ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb27c0701d0 0x7fb27c1fbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.493+0000 7fb2843ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb27c071c20 0x7fb27c153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.493+0000 7fb2843ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb27c072000 0x7fb27c0adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.493+0000 7fb2843ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c1420a0 con 0x7fb27c072000 2023-09-12T16:06:34.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.493+0000 7fb2843ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c0afca0 con 0x7fb27c0701d0 2023-09-12T16:06:34.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.493+0000 7fb2843ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c0ad670 con 0x7fb27c071c20 2023-09-12T16:06:34.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.494+0000 7fb28219b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb27c0701d0 0x7fb27c1fbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:34.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.494+0000 7fb28219b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb27c0701d0 0x7fb27c1fbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.112:45136/0 (socket says 172.21.15.112:45136) 2023-09-12T16:06:34.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.494+0000 7fb28219b700 1 -- 172.21.15.112:0/4231859517 learned_addr learned my addr 172.21.15.112:0/4231859517 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:34.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.494+0000 7fb28199a700 1 --2- 172.21.15.112:0/4231859517 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb27c071c20 0x7fb27c153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:34.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.494+0000 7fb28219b700 1 -- 172.21.15.112:0/4231859517 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb27c071c20 msgr2=0x7fb27c153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.494+0000 7fb28219b700 1 --2- 172.21.15.112:0/4231859517 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb27c071c20 0x7fb27c153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.494+0000 7fb28219b700 1 -- 172.21.15.112:0/4231859517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb27c072000 msgr2=0x7fb27c0adb00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-12T16:06:34.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.494+0000 7fb28219b700 1 --2- 172.21.15.112:0/4231859517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb27c072000 0x7fb27c0adb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.494+0000 7fb28219b700 1 -- 172.21.15.112:0/4231859517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2780095f0 con 0x7fb27c0701d0 2023-09-12T16:06:34.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.495+0000 7fb28219b700 1 --2- 172.21.15.112:0/4231859517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb27c0701d0 0x7fb27c1fbf70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb278000c00 tx=0x7fb278004a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:34.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.508+0000 7fb272ffd700 1 -- 172.21.15.112:0/4231859517 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27801d070 con 0x7fb27c0701d0 2023-09-12T16:06:34.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.508+0000 7fb272ffd700 1 -- 172.21.15.112:0/4231859517 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7fb2780050b0 con 0x7fb27c0701d0 2023-09-12T16:06:34.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.508+0000 7fb272ffd700 1 -- 172.21.15.112:0/4231859517 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb278005480 con 0x7fb27c0701d0 2023-09-12T16:06:34.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.510+0000 7fb2843ff700 1 -- 172.21.15.112:0/4231859517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb27c154360 con 0x7fb27c0701d0 2023-09-12T16:06:34.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.510+0000 7fb2843ff700 1 -- 172.21.15.112:0/4231859517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27c0ad020 con 0x7fb27c0701d0 2023-09-12T16:06:34.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.512+0000 7fb2843ff700 1 -- 172.21.15.112:0/4231859517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27c04eb50 con 0x7fb27c0701d0 2023-09-12T16:06:34.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.512+0000 7fb272ffd700 1 -- 172.21.15.112:0/4231859517 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb278022470 con 0x7fb27c0701d0 2023-09-12T16:06:34.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.512+0000 7fb272ffd700 1 -- 172.21.15.112:0/4231859517 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb278005680 con 0x7fb27c0701d0 2023-09-12T16:06:34.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.523+0000 7f9d377fe700 1 -- 172.21.15.112:0/2080731994 <== mon.1 v2:172.21.15.144:3300/0 9 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9d440178a0 con 0x7f9d501f97e0 2023-09-12T16:06:34.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.523+0000 7f9d377fe700 1 -- 172.21.15.112:0/2080731994 <== mon.1 v2:172.21.15.144:3300/0 10 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7f9d44017b80 con 0x7f9d501f97e0 2023-09-12T16:06:34.541 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2023-09-12T16:06:34.541 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2023-09-12T16:06:34.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.527+0000 7fb272ffd700 1 -- 172.21.15.112:0/4231859517 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fb278031060 con 0x7fb27c0701d0 2023-09-12T16:06:34.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.527+0000 7fb272ffd700 1 -- 172.21.15.112:0/4231859517 <== mon.1 v2:172.21.15.144:3300/0 7 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb278022720 con 0x7fb27c0701d0 2023-09-12T16:06:34.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.540+0000 7f9d553ff700 1 -- 172.21.15.112:0/2080731994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d501f97e0 msgr2=0x7f9d501f9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.540+0000 7f9d553ff700 1 --2- 172.21.15.112:0/2080731994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d501f97e0 0x7f9d501f9c60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400b360 tx=0x7f9d4400b720 comp rx=0 tx=0).stop 2023-09-12T16:06:34.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.531+0000 7f1e777fe700 1 -- 172.21.15.112:0/987272885 <== mon.2 v2:172.21.15.144:3301/0 8 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1e8001ae00 con 0x7f1e900cd950 2023-09-12T16:06:34.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.542+0000 7faeb1ffb700 1 -- 172.21.15.112:0/621810738 <== mon.1 v2:172.21.15.144:3300/0 7 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7faeb4014a30 con 0x7faebc0cd7e0 2023-09-12T16:06:34.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.554+0000 7f9d553ff700 1 -- 172.21.15.112:0/2080731994 shutdown_connections 2023-09-12T16:06:34.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.554+0000 7f9d553ff700 1 --2- 172.21.15.112:0/2080731994 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d50156600 0x7f9d500b2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.554+0000 7f9d553ff700 1 --2- 172.21.15.112:0/2080731994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d5015ad60 0x7f9d5015b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.554+0000 7f9d553ff700 1 --2- 172.21.15.112:0/2080731994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d501f97e0 0x7f9d501f9c60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.554+0000 7f9d553ff700 1 -- 172.21.15.112:0/2080731994 >> 172.21.15.112:0/2080731994 conn(0x7f9d5006a020 msgr2=0x7f9d500ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:34.577 DEBUG:tasks.ceph:set 21 configs 2023-09-12T16:06:34.578 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi112') 2023-09-12T16:06:34.579 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi112') 2023-09-12T16:06:34.579 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi112') 2023-09-12T16:06:34.579 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi112') 2023-09-12T16:06:34.580 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi112') 2023-09-12T16:06:34.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.576+0000 7f9d553ff700 1 -- 172.21.15.112:0/2080731994 shutdown_connections 2023-09-12T16:06:34.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.577+0000 7f9d553ff700 1 -- 172.21.15.112:0/2080731994 wait complete. 2023-09-12T16:06:34.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.589+0000 7f1e951ff700 1 -- 172.21.15.112:0/987272885 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) v1 -- 0x7f1e68005350 con 0x7f1e900cd950 2023-09-12T16:06:34.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.631+0000 7f1e777fe700 1 -- 172.21.15.112:0/987272885 <== mon.2 v2:172.21.15.144:3301/0 9 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) v1 ==== 108+0+0 (secure 0 0 0) 0x7f1e80028020 con 0x7f1e900cd950 2023-09-12T16:06:34.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.646+0000 7f1e951ff700 1 -- 172.21.15.112:0/987272885 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e900cd950 msgr2=0x7f1e900c5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.646+0000 7f1e951ff700 1 --2- 172.21.15.112:0/987272885 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e900cd950 0x7f1e900c5dd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1e8000b4a0 tx=0x7f1e8000b860 comp rx=0 tx=0).stop 2023-09-12T16:06:34.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.646+0000 7f1e951ff700 1 -- 172.21.15.112:0/987272885 shutdown_connections 2023-09-12T16:06:34.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.646+0000 7f1e951ff700 1 --2- 172.21.15.112:0/987272885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e9015caf0 0x7f1e900c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.646+0000 7f1e951ff700 1 --2- 172.21.15.112:0/987272885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e900cd570 0x7f1e900a64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.646+0000 7f1e951ff700 1 --2- 172.21.15.112:0/987272885 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e900cd950 0x7f1e900c5dd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.646+0000 7f1e951ff700 1 -- 172.21.15.112:0/987272885 >> 172.21.15.112:0/987272885 conn(0x7f1e9006a020 msgr2=0x7f1e90168580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:34.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.647+0000 7f1e951ff700 1 -- 172.21.15.112:0/987272885 shutdown_connections 2023-09-12T16:06:34.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.647+0000 7f1e951ff700 1 -- 172.21.15.112:0/987272885 wait complete. 2023-09-12T16:06:34.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.664+0000 7f17169ff700 1 -- 172.21.15.112:0/1160789733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17100cd950 msgr2=0x7f17100ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.664+0000 7f17169ff700 1 --2- 172.21.15.112:0/1160789733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17100cd950 0x7f17100ccb60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1708009f50 tx=0x7f170801c340 comp rx=0 tx=0).stop 2023-09-12T16:06:34.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.667+0000 7fb6ef9ff700 1 -- 172.21.15.112:0/3256672652 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6e815caf0 msgr2=0x7fb6e80ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.667+0000 7fb6ef9ff700 1 --2- 172.21.15.112:0/3256672652 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6e815caf0 0x7fb6e80ccb60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8005fd0 tx=0x7fb6d8009c70 comp rx=0 tx=0).stop 2023-09-12T16:06:34.676 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi112') 2023-09-12T16:06:34.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.664+0000 7f17169ff700 1 -- 172.21.15.112:0/1160789733 shutdown_connections 2023-09-12T16:06:34.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.664+0000 7f17169ff700 1 --2- 172.21.15.112:0/1160789733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17100cd950 0x7f17100ccb60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.664+0000 7f17169ff700 1 -- 172.21.15.112:0/1160789733 >> 172.21.15.112:0/1160789733 conn(0x7f171006a020 msgr2=0x7f171006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:34.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.664+0000 7f17169ff700 1 -- 172.21.15.112:0/1160789733 shutdown_connections 2023-09-12T16:06:34.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.664+0000 7f17169ff700 1 -- 172.21.15.112:0/1160789733 wait complete. 2023-09-12T16:06:34.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.670+0000 7fb6ef9ff700 1 -- 172.21.15.112:0/3256672652 shutdown_connections 2023-09-12T16:06:34.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.670+0000 7fb6ef9ff700 1 --2- 172.21.15.112:0/3256672652 >> v2:172.21.15.112:3300/0 conn(0x7fb6e80cd950 0x7fb6e80c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.670+0000 7fb6ef9ff700 1 --2- 172.21.15.112:0/3256672652 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6e815caf0 0x7fb6e80ccb60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.670+0000 7fb6ef9ff700 1 -- 172.21.15.112:0/3256672652 >> 172.21.15.112:0/3256672652 conn(0x7fb6e806a020 msgr2=0x7fb6e806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:34.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.680+0000 7fb6ef9ff700 1 -- 172.21.15.112:0/3256672652 shutdown_connections 2023-09-12T16:06:34.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.687+0000 7fb6ef9ff700 1 -- 172.21.15.112:0/3256672652 wait complete. 2023-09-12T16:06:34.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.690+0000 7fb6ef9ff700 1 Processor -- start 2023-09-12T16:06:34.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.690+0000 7fb6ef9ff700 1 -- start start 2023-09-12T16:06:34.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.696+0000 7fb6ef9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6e80cd570 0x7fb6e8201d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.696+0000 7fb6ef9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6e80cd950 0x7fb6e813c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.696+0000 7fb6ef9ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6e815caf0 0x7fb6e813ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.696+0000 7fb6ef9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e80b2b30 con 0x7fb6e80cd950 2023-09-12T16:06:34.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.696+0000 7fb6ef9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e80b2e10 con 0x7fb6e80cd570 2023-09-12T16:06:34.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.696+0000 7fb6ef9ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e81ff690 con 0x7fb6e815caf0 2023-09-12T16:06:34.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.697+0000 7fb6edf9c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6e815caf0 0x7fb6e813ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:34.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.697+0000 7fb6edf9c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6e815caf0 0x7fb6e813ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.112:48700/0 (socket says 172.21.15.112:48700) 2023-09-12T16:06:34.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.697+0000 7fb6edf9c700 1 -- 172.21.15.112:0/38069709 learned_addr learned my addr 172.21.15.112:0/38069709 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:34.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.692+0000 7f17169ff700 1 Processor -- start 2023-09-12T16:06:34.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.697+0000 7fb6ed79b700 1 --2- 172.21.15.112:0/38069709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6e80cd570 0x7fb6e8201d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:34.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.697+0000 7fb6edf9c700 1 -- 172.21.15.112:0/38069709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6e80cd570 msgr2=0x7fb6e8201d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.697+0000 7fb6edf9c700 1 --2- 172.21.15.112:0/38069709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6e80cd570 0x7fb6e8201d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.697+0000 7fb6edf9c700 1 -- 172.21.15.112:0/38069709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6e80cd950 msgr2=0x7fb6e813c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.697+0000 7fb6edf9c700 1 --2- 172.21.15.112:0/38069709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6e80cd950 0x7fb6e813c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.697+0000 7fb6edf9c700 1 -- 172.21.15.112:0/38069709 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d80095f0 con 0x7fb6e815caf0 2023-09-12T16:06:34.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.698+0000 7fb6edf9c700 1 --2- 172.21.15.112:0/38069709 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6e815caf0 0x7fb6e813ce80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb6e000b970 tx=0x7fb6e000bd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:34.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.703+0000 7fb6ddffb700 1 -- 172.21.15.112:0/38069709 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e000c9b0 con 0x7fb6e815caf0 2023-09-12T16:06:34.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.703+0000 7fb6ddffb700 1 -- 172.21.15.112:0/38069709 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb6e000cc20 con 0x7fb6e815caf0 2023-09-12T16:06:34.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.703+0000 7fb6ddffb700 1 -- 172.21.15.112:0/38069709 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0014440 con 0x7fb6e815caf0 2023-09-12T16:06:34.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.703+0000 7fb6ef9ff700 1 -- 172.21.15.112:0/38069709 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e81ff970 con 0x7fb6e815caf0 2023-09-12T16:06:34.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.703+0000 7fb6ef9ff700 1 -- 172.21.15.112:0/38069709 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e8202260 con 0x7fb6e815caf0 2023-09-12T16:06:34.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.707+0000 7fb6ef9ff700 1 -- 172.21.15.112:0/38069709 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c80052f0 con 0x7fb6e815caf0 2023-09-12T16:06:34.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.716+0000 7faec35ff700 1 -- 172.21.15.112:0/621810738 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) v1 -- 0x7fae9c005910 con 0x7faebc0cd7e0 2023-09-12T16:06:34.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.702+0000 7f17169ff700 1 -- start start 2023-09-12T16:06:34.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.703+0000 7f17169ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17100cd570 0x7f17101594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.703+0000 7f17169ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17100cd950 0x7f17100b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.703+0000 7f17169ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f171015caf0 0x7f17100b2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.703+0000 7f17169ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17101571b0 con 0x7f17100cd570 2023-09-12T16:06:34.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.703+0000 7f17169ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17101568c0 con 0x7f171015caf0 2023-09-12T16:06:34.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.703+0000 7f17169ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17100b2f40 con 0x7f17100cd950 2023-09-12T16:06:34.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.704+0000 7f170f7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17100cd950 0x7f17100b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:34.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.704+0000 7f170f7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17100cd950 0x7f17100b1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.112:48716/0 (socket says 172.21.15.112:48716) 2023-09-12T16:06:34.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.704+0000 7f170f7fe700 1 -- 172.21.15.112:0/3491114954 learned_addr learned my addr 172.21.15.112:0/3491114954 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:34.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.704+0000 7f1714f9c700 1 --2- 172.21.15.112:0/3491114954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f171015caf0 0x7f17100b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:34.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.705+0000 7f170f7fe700 1 -- 172.21.15.112:0/3491114954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f171015caf0 msgr2=0x7f17100b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.705+0000 7f170f7fe700 1 --2- 172.21.15.112:0/3491114954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f171015caf0 0x7f17100b2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.705+0000 7f170f7fe700 1 -- 172.21.15.112:0/3491114954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17100cd570 msgr2=0x7f17101594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.705+0000 7f170f7fe700 1 --2- 172.21.15.112:0/3491114954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17100cd570 0x7f17101594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.705+0000 7f170f7fe700 1 -- 172.21.15.112:0/3491114954 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1708009c40 con 0x7f17100cd950 2023-09-12T16:06:34.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.706+0000 7f170f7fe700 1 --2- 172.21.15.112:0/3491114954 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17100cd950 0x7f17100b1e00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1704001e90 tx=0x7f170400c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:34.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.711+0000 7f170cff9700 1 -- 172.21.15.112:0/3491114954 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1704005030 con 0x7f17100cd950 2023-09-12T16:06:34.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.711+0000 7f170cff9700 1 -- 172.21.15.112:0/3491114954 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1704005280 con 0x7f17100cd950 2023-09-12T16:06:34.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.711+0000 7f170cff9700 1 -- 172.21.15.112:0/3491114954 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1704004730 con 0x7f17100cd950 2023-09-12T16:06:34.721 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi112') 2023-09-12T16:06:34.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.720+0000 7fb6ddffb700 1 -- 172.21.15.112:0/38069709 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb6e00148a0 con 0x7fb6e815caf0 2023-09-12T16:06:34.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.720+0000 7fb6ddffb700 1 -- 172.21.15.112:0/38069709 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb6e0006e40 con 0x7fb6e815caf0 2023-09-12T16:06:34.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.718+0000 7f17169ff700 1 -- 172.21.15.112:0/3491114954 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17101575d0 con 0x7f17100cd950 2023-09-12T16:06:34.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.718+0000 7f17169ff700 1 -- 172.21.15.112:0/3491114954 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1710156af0 con 0x7f17100cd950 2023-09-12T16:06:34.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.723+0000 7f170cff9700 1 -- 172.21.15.112:0/3491114954 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1704004b90 con 0x7f17100cd950 2023-09-12T16:06:34.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.723+0000 7f170cff9700 1 -- 172.21.15.112:0/3491114954 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f170403e780 con 0x7f17100cd950 2023-09-12T16:06:34.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.723+0000 7f17169ff700 1 -- 172.21.15.112:0/3491114954 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f00052f0 con 0x7f17100cd950 2023-09-12T16:06:34.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.737+0000 7fb6ddffb700 1 -- 172.21.15.112:0/38069709 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fb6e0019070 con 0x7fb6e815caf0 2023-09-12T16:06:34.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.731+0000 7f170cff9700 1 -- 172.21.15.112:0/3491114954 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f1704039070 con 0x7f17100cd950 2023-09-12T16:06:34.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.748+0000 7faeb1ffb700 1 -- 172.21.15.112:0/621810738 <== mon.1 v2:172.21.15.144:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) v1 ==== 117+0+0 (secure 0 0 0) 0x7faeb4014ba0 con 0x7faebc0cd7e0 2023-09-12T16:06:34.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.778+0000 7faec35ff700 1 -- 172.21.15.112:0/621810738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faebc0cd7e0 msgr2=0x7faebc071a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.778+0000 7faec35ff700 1 --2- 172.21.15.112:0/621810738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faebc0cd7e0 0x7faebc071a30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faeb400b990 tx=0x7faeb400bca0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.800+0000 7faec35ff700 1 -- 172.21.15.112:0/621810738 shutdown_connections 2023-09-12T16:06:34.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.800+0000 7faec35ff700 1 --2- 172.21.15.112:0/621810738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faebc0cd7e0 0x7faebc071a30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.800+0000 7faec35ff700 1 --2- 172.21.15.112:0/621810738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faebc0c7b60 0x7faebc166d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.800+0000 7faec35ff700 1 --2- 172.21.15.112:0/621810738 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faebc0cb740 0x7faebc0714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.800+0000 7faec35ff700 1 -- 172.21.15.112:0/621810738 >> 172.21.15.112:0/621810738 conn(0x7faebc06a020 msgr2=0x7faebc0ae130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:34.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.804+0000 7fc6063ff700 1 -- 172.21.15.112:0/693796334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e8003a30 msgr2=0x7fc5e8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.804+0000 7fc6063ff700 1 --2- 172.21.15.112:0/693796334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e8003a30 0x7fc5e8003e30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc5f800c6f0 tx=0x7fc5e8005880 comp rx=0 tx=0).stop 2023-09-12T16:06:34.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.804+0000 7fc60499c700 1 -- 172.21.15.112:0/693796334 reap_dead start 2023-09-12T16:06:34.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.809+0000 7fc6063ff700 1 -- 172.21.15.112:0/693796334 shutdown_connections 2023-09-12T16:06:34.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.809+0000 7fc6063ff700 1 -- 172.21.15.112:0/693796334 >> 172.21.15.112:0/693796334 conn(0x7fc60006a020 msgr2=0x7fc60006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:34.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.810+0000 7fb2843ff700 1 -- 172.21.15.112:0/4231859517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) v1 -- 0x7fb27c1490b0 con 0x7fb27c0701d0 2023-09-12T16:06:34.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.811+0000 7faec35ff700 1 -- 172.21.15.112:0/621810738 shutdown_connections 2023-09-12T16:06:34.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.818+0000 7faec35ff700 1 -- 172.21.15.112:0/621810738 wait complete. 2023-09-12T16:06:34.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.817+0000 7fc6063ff700 1 -- 172.21.15.112:0/693796334 shutdown_connections 2023-09-12T16:06:34.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.828+0000 7fc6063ff700 1 -- 172.21.15.112:0/693796334 wait complete. 2023-09-12T16:06:34.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.831+0000 7fc6063ff700 1 Processor -- start 2023-09-12T16:06:34.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.831+0000 7fc6063ff700 1 -- start start 2023-09-12T16:06:34.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.832+0000 7fc6063ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e8003a30 0x7fc600152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.832+0000 7fc6063ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc600152d70 0x7fc600154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.833+0000 7fc6063ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc600154660 0x7fc600154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.833+0000 7fc6063ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6000b0630 con 0x7fc5e8003a30 2023-09-12T16:06:34.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.833+0000 7fc6063ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6001535a0 con 0x7fc600152d70 2023-09-12T16:06:34.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.833+0000 7fc6063ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc600153880 con 0x7fc600154660 2023-09-12T16:06:34.839 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.833+0000 7fc5ff7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc600152d70 0x7fc600154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:34.839 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.833+0000 7fc5ff7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc600152d70 0x7fc600154120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.112:45184/0 (socket says 172.21.15.112:45184) 2023-09-12T16:06:34.839 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.833+0000 7fc5ff7fe700 1 -- 172.21.15.112:0/3562897454 learned_addr learned my addr 172.21.15.112:0/3562897454 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:34.839 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.834+0000 7fc5ff7fe700 1 -- 172.21.15.112:0/3562897454 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc600154660 msgr2=0x7fc600154ac0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-12T16:06:34.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.834+0000 7fc5ff7fe700 1 --2- 172.21.15.112:0/3562897454 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc600154660 0x7fc600154ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.834+0000 7fc5ff7fe700 1 -- 172.21.15.112:0/3562897454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e8003a30 msgr2=0x7fc600152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.834+0000 7fc5ff7fe700 1 --2- 172.21.15.112:0/3562897454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e8003a30 0x7fc600152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.834+0000 7fc5ff7fe700 1 -- 172.21.15.112:0/3562897454 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc600153b60 con 0x7fc600152d70 2023-09-12T16:06:34.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.834+0000 7fc5ff7fe700 1 --2- 172.21.15.112:0/3562897454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc600152d70 0x7fc600154120 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000b390 tx=0x7fc5f000b750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:34.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.834+0000 7fc5fcff9700 1 -- 172.21.15.112:0/3562897454 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0011830 con 0x7fc600152d70 2023-09-12T16:06:34.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.835+0000 7fc5fcff9700 1 -- 172.21.15.112:0/3562897454 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc5f0011aa0 con 0x7fc600152d70 2023-09-12T16:06:34.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.835+0000 7fc5fcff9700 1 -- 172.21.15.112:0/3562897454 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f000be80 con 0x7fc600152d70 2023-09-12T16:06:34.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.835+0000 7fc6063ff700 1 -- 172.21.15.112:0/3562897454 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc600153e40 con 0x7fc600152d70 2023-09-12T16:06:34.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.835+0000 7fc6063ff700 1 -- 172.21.15.112:0/3562897454 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6001531f0 con 0x7fc600152d70 2023-09-12T16:06:34.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.836+0000 7fc5fcff9700 1 -- 172.21.15.112:0/3562897454 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc5f001a700 con 0x7fc600152d70 2023-09-12T16:06:34.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.836+0000 7fc5fcff9700 1 -- 172.21.15.112:0/3562897454 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc5f0019750 con 0x7fc600152d70 2023-09-12T16:06:34.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.838+0000 7fc6063ff700 1 -- 172.21.15.112:0/3562897454 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e00052f0 con 0x7fc600152d70 2023-09-12T16:06:34.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.850+0000 7fc1789ff700 1 -- 172.21.15.112:0/1025389514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1740cd9e0 msgr2=0x7fc1740700a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.850+0000 7fc1789ff700 1 --2- 172.21.15.112:0/1025389514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1740cd9e0 0x7fc1740700a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009f60 tx=0x7fc16c009f90 comp rx=0 tx=0).stop 2023-09-12T16:06:34.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.856+0000 7fc1789ff700 1 -- 172.21.15.112:0/1025389514 shutdown_connections 2023-09-12T16:06:34.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.856+0000 7fc1789ff700 1 --2- 172.21.15.112:0/1025389514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1740cd9e0 0x7fc1740700a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.856+0000 7fc1789ff700 1 --2- 172.21.15.112:0/1025389514 >> v2:172.21.15.112:3300/0 conn(0x7fc17416bb20 0x7fc1740886a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.856+0000 7fc1789ff700 1 -- 172.21.15.112:0/1025389514 >> 172.21.15.112:0/1025389514 conn(0x7fc17406a020 msgr2=0x7fc17406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:34.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.856+0000 7fc5fcff9700 1 -- 172.21.15.112:0/3562897454 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fc5f0039b20 con 0x7fc600152d70 2023-09-12T16:06:34.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.866+0000 7fb272ffd700 1 -- 172.21.15.112:0/4231859517 <== mon.1 v2:172.21.15.144:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) v1 ==== 106+0+0 (secure 0 0 0) 0x7fb278027070 con 0x7fb27c0701d0 2023-09-12T16:06:34.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.866+0000 7fc1789ff700 1 -- 172.21.15.112:0/1025389514 shutdown_connections 2023-09-12T16:06:34.880 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '1'], check_status=True, hostname='smithi112') 2023-09-12T16:06:34.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.879+0000 7fb2843ff700 1 -- 172.21.15.112:0/4231859517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb27c0701d0 msgr2=0x7fb27c1fbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.879+0000 7fb2843ff700 1 --2- 172.21.15.112:0/4231859517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb27c0701d0 0x7fb27c1fbf70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb278000c00 tx=0x7fb278004a60 comp rx=0 tx=0).stop 2023-09-12T16:06:34.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.880+0000 7fb2843ff700 1 -- 172.21.15.112:0/4231859517 shutdown_connections 2023-09-12T16:06:34.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.880+0000 7fb2843ff700 1 --2- 172.21.15.112:0/4231859517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb27c072000 0x7fb27c0adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.880+0000 7fb2843ff700 1 --2- 172.21.15.112:0/4231859517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb27c0701d0 0x7fb27c1fbf70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.880+0000 7fb2843ff700 1 --2- 172.21.15.112:0/4231859517 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb27c071c20 0x7fb27c153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.880+0000 7fb2843ff700 1 -- 172.21.15.112:0/4231859517 >> 172.21.15.112:0/4231859517 conn(0x7fb27c06e220 msgr2=0x7fb27c14c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:34.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.880+0000 7fb2843ff700 1 -- 172.21.15.112:0/4231859517 shutdown_connections 2023-09-12T16:06:34.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.880+0000 7fb2843ff700 1 -- 172.21.15.112:0/4231859517 wait complete. 2023-09-12T16:06:34.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.887+0000 7fc1789ff700 1 -- 172.21.15.112:0/1025389514 wait complete. 2023-09-12T16:06:34.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.889+0000 7fc1789ff700 1 Processor -- start 2023-09-12T16:06:34.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.890+0000 7fc1789ff700 1 -- start start 2023-09-12T16:06:34.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.891+0000 7fc1789ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc174088be0 0x7fc1740b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.891+0000 7fc1789ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1740cd9e0 0x7fc1741648d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.891+0000 7fc1789ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc17416bb20 0x7fc1740b2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.891+0000 7fc1789ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740b21d0 con 0x7fc1740cd9e0 2023-09-12T16:06:34.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.891+0000 7fc1789ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740b1310 con 0x7fc174088be0 2023-09-12T16:06:34.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.891+0000 7fc1789ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740b18a0 con 0x7fc17416bb20 2023-09-12T16:06:34.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.894+0000 7fc17259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc174088be0 0x7fc1740b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:34.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.895+0000 7fc17259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc174088be0 0x7fc1740b0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.112:45198/0 (socket says 172.21.15.112:45198) 2023-09-12T16:06:34.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.895+0000 7fc17259c700 1 -- 172.21.15.112:0/1695910779 learned_addr learned my addr 172.21.15.112:0/1695910779 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:34.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.895+0000 7fc172d9d700 1 --2- 172.21.15.112:0/1695910779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc17416bb20 0x7fc1740b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:34.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.895+0000 7fc17259c700 1 -- 172.21.15.112:0/1695910779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc17416bb20 msgr2=0x7fc1740b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.895+0000 7fc17259c700 1 --2- 172.21.15.112:0/1695910779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc17416bb20 0x7fc1740b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.895+0000 7fc17259c700 1 -- 172.21.15.112:0/1695910779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1740cd9e0 msgr2=0x7fc1741648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.895+0000 7fc17259c700 1 --2- 172.21.15.112:0/1695910779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1740cd9e0 0x7fc1741648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.895+0000 7fc17259c700 1 -- 172.21.15.112:0/1695910779 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16c009c40 con 0x7fc174088be0 2023-09-12T16:06:34.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.896+0000 7fc17259c700 1 --2- 172.21.15.112:0/1695910779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc174088be0 0x7fc1740b0ae0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc16400b4a0 tx=0x7fc16400b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:34.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.896+0000 7fc162ffd700 1 -- 172.21.15.112:0/1695910779 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164011830 con 0x7fc174088be0 2023-09-12T16:06:34.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.896+0000 7fc162ffd700 1 -- 172.21.15.112:0/1695910779 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc164011a80 con 0x7fc174088be0 2023-09-12T16:06:34.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.896+0000 7fc162ffd700 1 -- 172.21.15.112:0/1695910779 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164011e70 con 0x7fc174088be0 2023-09-12T16:06:34.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.896+0000 7fc1789ff700 1 -- 172.21.15.112:0/1695910779 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1740b1b80 con 0x7fc174088be0 2023-09-12T16:06:34.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.896+0000 7fc1789ff700 1 -- 172.21.15.112:0/1695910779 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1740b1020 con 0x7fc174088be0 2023-09-12T16:06:34.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.897+0000 7fc162ffd700 1 -- 172.21.15.112:0/1695910779 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc16401a700 con 0x7fc174088be0 2023-09-12T16:06:34.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.897+0000 7fc162ffd700 1 -- 172.21.15.112:0/1695910779 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc164019830 con 0x7fc174088be0 2023-09-12T16:06:34.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.907+0000 7fc1789ff700 1 -- 172.21.15.112:0/1695910779 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1580052f0 con 0x7fc174088be0 2023-09-12T16:06:34.927 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi112') 2023-09-12T16:06:34.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.927+0000 7fc162ffd700 1 -- 172.21.15.112:0/1695910779 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fc164039b20 con 0x7fc174088be0 2023-09-12T16:06:34.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.920+0000 7fe926dff700 1 -- 172.21.15.112:0/485104315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe92015caf0 msgr2=0x7fe9200ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.920+0000 7fe926dff700 1 --2- 172.21.15.112:0/485104315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe92015caf0 0x7fe9200ccb60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe9100098c0 tx=0x7fe910009bd0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.931+0000 7fe926dff700 1 -- 172.21.15.112:0/485104315 shutdown_connections 2023-09-12T16:06:34.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.931+0000 7fe926dff700 1 --2- 172.21.15.112:0/485104315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe92015caf0 0x7fe9200ccb60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.931+0000 7fe926dff700 1 -- 172.21.15.112:0/485104315 >> 172.21.15.112:0/485104315 conn(0x7fe92006a020 msgr2=0x7fe92006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:34.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.931+0000 7fe926dff700 1 -- 172.21.15.112:0/485104315 shutdown_connections 2023-09-12T16:06:34.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.931+0000 7fe926dff700 1 -- 172.21.15.112:0/485104315 wait complete. 2023-09-12T16:06:34.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.934+0000 7fe926dff700 1 Processor -- start 2023-09-12T16:06:34.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.934+0000 7fe926dff700 1 -- start start 2023-09-12T16:06:34.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.935+0000 7fe926dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9200cd570 0x7fe92013cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.935+0000 7fe926dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9200cd950 0x7fe92015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.936+0000 7fe926dff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe92015caf0 0x7fe92015a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:34.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.936+0000 7fe926dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe920138480 con 0x7fe9200cd570 2023-09-12T16:06:34.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.936+0000 7fe926dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92013bf20 con 0x7fe9200cd950 2023-09-12T16:06:34.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.936+0000 7fe926dff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92013c200 con 0x7fe92015caf0 2023-09-12T16:06:34.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.937+0000 7fe92539c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe92015caf0 0x7fe92015a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:34.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.937+0000 7fe92539c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe92015caf0 0x7fe92015a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.112:48734/0 (socket says 172.21.15.112:48734) 2023-09-12T16:06:34.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.937+0000 7fe92539c700 1 -- 172.21.15.112:0/1326064599 learned_addr learned my addr 172.21.15.112:0/1326064599 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:34.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.937+0000 7fe91ffff700 1 --2- 172.21.15.112:0/1326064599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9200cd950 0x7fe92015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:34.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.937+0000 7fe92539c700 1 -- 172.21.15.112:0/1326064599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9200cd950 msgr2=0x7fe92015a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.937+0000 7fe92539c700 1 --2- 172.21.15.112:0/1326064599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9200cd950 0x7fe92015a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.937+0000 7fe92539c700 1 -- 172.21.15.112:0/1326064599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9200cd570 msgr2=0x7fe92013cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.937+0000 7fe92539c700 1 --2- 172.21.15.112:0/1326064599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9200cd570 0x7fe92013cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.937+0000 7fe92539c700 1 -- 172.21.15.112:0/1326064599 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe910009520 con 0x7fe92015caf0 2023-09-12T16:06:34.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.938+0000 7fe92539c700 1 --2- 172.21.15.112:0/1326064599 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe92015caf0 0x7fe92015a800 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe918004ac0 tx=0x7fe91800cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:34.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.949+0000 7fe91d7fa700 1 -- 172.21.15.112:0/1326064599 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe918003c00 con 0x7fe92015caf0 2023-09-12T16:06:34.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.949+0000 7fe91d7fa700 1 -- 172.21.15.112:0/1326064599 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe918003e70 con 0x7fe92015caf0 2023-09-12T16:06:34.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.949+0000 7fe91d7fa700 1 -- 172.21.15.112:0/1326064599 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91800aae0 con 0x7fe92015caf0 2023-09-12T16:06:34.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.950+0000 7fe926dff700 1 -- 172.21.15.112:0/1326064599 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92013c4e0 con 0x7fe92015caf0 2023-09-12T16:06:34.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.950+0000 7fe926dff700 1 -- 172.21.15.112:0/1326064599 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92013d220 con 0x7fe92015caf0 2023-09-12T16:06:34.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.952+0000 7fe926dff700 1 -- 172.21.15.112:0/1326064599 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92013ca00 con 0x7fe92015caf0 2023-09-12T16:06:34.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.952+0000 7fe91d7fa700 1 -- 172.21.15.112:0/1326064599 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe918004030 con 0x7fe92015caf0 2023-09-12T16:06:34.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.952+0000 7fe91d7fa700 1 -- 172.21.15.112:0/1326064599 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe91801ba90 con 0x7fe92015caf0 2023-09-12T16:06:34.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.963+0000 7fe91d7fa700 1 -- 172.21.15.112:0/1326064599 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fe92013ca00 con 0x7fe92015caf0 2023-09-12T16:06:34.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.968+0000 7f95309ff700 1 -- 172.21.15.112:0/2920826751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c15caf0 msgr2=0x7f952c0ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.968+0000 7f95309ff700 1 --2- 172.21.15.112:0/2920826751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c15caf0 0x7f952c0ccb60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9524009fd0 tx=0x7f952400b380 comp rx=0 tx=0).stop 2023-09-12T16:06:34.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.980+0000 7f95309ff700 1 -- 172.21.15.112:0/2920826751 shutdown_connections 2023-09-12T16:06:34.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.980+0000 7f95309ff700 1 --2- 172.21.15.112:0/2920826751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c15caf0 0x7f952c0ccb60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.980+0000 7f95309ff700 1 -- 172.21.15.112:0/2920826751 >> 172.21.15.112:0/2920826751 conn(0x7f952c06a020 msgr2=0x7f952c06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:34.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.987+0000 7f159bdff700 1 -- 172.21.15.112:0/1457091193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f159415caf0 msgr2=0x7f15940cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:34.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.987+0000 7f159bdff700 1 --2- 172.21.15.112:0/1457091193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f159415caf0 0x7f15940cb270 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f15940cada0 tx=0x7f158401ac80 comp rx=0 tx=0).stop 2023-09-12T16:06:34.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.989+0000 7f17169ff700 1 -- 172.21.15.112:0/3491114954 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) v1 -- 0x7f16f0005160 con 0x7f17100cd950 2023-09-12T16:06:34.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.998+0000 7f159bdff700 1 -- 172.21.15.112:0/1457091193 shutdown_connections 2023-09-12T16:06:34.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.998+0000 7f159bdff700 1 --2- 172.21.15.112:0/1457091193 >> v2:172.21.15.144:3300/0 conn(0x7f15940cd950 0x7f15940c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.998+0000 7f159bdff700 1 --2- 172.21.15.112:0/1457091193 >> v2:172.21.15.112:3300/0 conn(0x7f15940cd570 0x7f15940ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.998+0000 7f159bdff700 1 --2- 172.21.15.112:0/1457091193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f159415caf0 0x7f15940cb270 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:34.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.998+0000 7f159bdff700 1 -- 172.21.15.112:0/1457091193 >> 172.21.15.112:0/1457091193 conn(0x7f159406a020 msgr2=0x7f159406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:35.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.001+0000 7f159bdff700 1 -- 172.21.15.112:0/1457091193 shutdown_connections 2023-09-12T16:06:35.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.001+0000 7f159bdff700 1 -- 172.21.15.112:0/1457091193 wait complete. 2023-09-12T16:06:35.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.003+0000 7f159bdff700 1 Processor -- start 2023-09-12T16:06:35.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.004+0000 7f159bdff700 1 -- start start 2023-09-12T16:06:35.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.005+0000 7f159bdff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15940cd570 0x7f15940b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.005+0000 7f159bdff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15940cd950 0x7f159413db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.006+0000 7f159bdff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f159415caf0 0x7f159413e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.006+0000 7f159bdff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15940c4fe0 con 0x7f15940cd950 2023-09-12T16:06:35.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.006+0000 7f159bdff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15940c51c0 con 0x7f159415caf0 2023-09-12T16:06:35.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.006+0000 7f159bdff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15940c54a0 con 0x7f15940cd570 2023-09-12T16:06:35.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.001+0000 7fb6ef9ff700 1 -- 172.21.15.112:0/38069709 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) v1 -- 0x7fb6c8005870 con 0x7fb6e815caf0 2023-09-12T16:06:35.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:34.986+0000 7f95309ff700 1 -- 172.21.15.112:0/2920826751 shutdown_connections 2023-09-12T16:06:35.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.012+0000 7f159a39c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f159415caf0 0x7f159413e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:35.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.012+0000 7f1599b9b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15940cd570 0x7f15940b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:35.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.012+0000 7f159a39c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f159415caf0 0x7f159413e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.112:45236/0 (socket says 172.21.15.112:45236) 2023-09-12T16:06:35.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.012+0000 7f159a39c700 1 -- 172.21.15.112:0/1714244130 learned_addr learned my addr 172.21.15.112:0/1714244130 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:35.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.015+0000 7f159939a700 1 --2- 172.21.15.112:0/1714244130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15940cd950 0x7f159413db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:35.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.016+0000 7f159939a700 1 -- 172.21.15.112:0/1714244130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15940cd570 msgr2=0x7f15940b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.016+0000 7f159939a700 1 --2- 172.21.15.112:0/1714244130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15940cd570 0x7f15940b1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.016+0000 7f159939a700 1 -- 172.21.15.112:0/1714244130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f159415caf0 msgr2=0x7f159413e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.016+0000 7f159939a700 1 --2- 172.21.15.112:0/1714244130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f159415caf0 0x7f159413e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.016+0000 7f159939a700 1 -- 172.21.15.112:0/1714244130 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158401a600 con 0x7f15940cd950 2023-09-12T16:06:35.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.017+0000 7f159939a700 1 --2- 172.21.15.112:0/1714244130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15940cd950 0x7f159413db10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1584026000 tx=0x7f1584004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:35.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.017+0000 7f158a7fc700 1 -- 172.21.15.112:0/1714244130 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158402d070 con 0x7f15940cd950 2023-09-12T16:06:35.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.017+0000 7f158a7fc700 1 -- 172.21.15.112:0/1714244130 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1584003890 con 0x7f15940cd950 2023-09-12T16:06:35.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.017+0000 7f158a7fc700 1 -- 172.21.15.112:0/1714244130 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584003a60 con 0x7f15940cd950 2023-09-12T16:06:35.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.017+0000 7f159bdff700 1 -- 172.21.15.112:0/1714244130 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15940c5780 con 0x7f15940cd950 2023-09-12T16:06:35.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.018+0000 7f159bdff700 1 -- 172.21.15.112:0/1714244130 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15940c5d40 con 0x7f15940cd950 2023-09-12T16:06:35.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.018+0000 7f158a7fc700 1 -- 172.21.15.112:0/1714244130 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1584003bc0 con 0x7f15940cd950 2023-09-12T16:06:35.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.018+0000 7f158a7fc700 1 -- 172.21.15.112:0/1714244130 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1584032420 con 0x7f15940cd950 2023-09-12T16:06:35.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.012+0000 7f95309ff700 1 -- 172.21.15.112:0/2920826751 wait complete. 2023-09-12T16:06:35.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.015+0000 7f95309ff700 1 Processor -- start 2023-09-12T16:06:35.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.015+0000 7f95309ff700 1 -- start start 2023-09-12T16:06:35.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.017+0000 7f95309ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f952c0cd570 0x7f952c1f6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.017+0000 7f95309ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f952c0cd950 0x7f952c0c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.017+0000 7f95309ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c15caf0 0x7f952c15fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.017+0000 7f95309ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c160260 con 0x7f952c0cd570 2023-09-12T16:06:35.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.017+0000 7f95309ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c13d6d0 con 0x7f952c15caf0 2023-09-12T16:06:35.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.017+0000 7f95309ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0b1740 con 0x7f952c0cd950 2023-09-12T16:06:35.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.018+0000 7f952a59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f952c0cd570 0x7f952c1f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:35.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.018+0000 7f952a59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f952c0cd570 0x7f952c1f6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55272/0 (socket says 172.21.15.112:55272) 2023-09-12T16:06:35.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.018+0000 7f952a59c700 1 -- 172.21.15.112:0/1474789935 learned_addr learned my addr 172.21.15.112:0/1474789935 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:35.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.019+0000 7f9529d9b700 1 --2- 172.21.15.112:0/1474789935 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f952c0cd950 0x7f952c0c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:35.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.019+0000 7f952ad9d700 1 --2- 172.21.15.112:0/1474789935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c15caf0 0x7f952c15fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:35.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.020+0000 7f159bdff700 1 -- 172.21.15.112:0/1714244130 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159415c910 con 0x7f15940cd950 2023-09-12T16:06:35.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.027+0000 7f158a7fc700 1 -- 172.21.15.112:0/1714244130 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f158403b430 con 0x7f15940cd950 2023-09-12T16:06:35.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.019+0000 7f952a59c700 1 -- 172.21.15.112:0/1474789935 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f952c0cd950 msgr2=0x7f952c0c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.019+0000 7f952a59c700 1 --2- 172.21.15.112:0/1474789935 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f952c0cd950 0x7f952c0c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.019+0000 7f952a59c700 1 -- 172.21.15.112:0/1474789935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c15caf0 msgr2=0x7f952c15fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.019+0000 7f952a59c700 1 --2- 172.21.15.112:0/1474789935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c15caf0 0x7f952c15fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.019+0000 7f952a59c700 1 -- 172.21.15.112:0/1474789935 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9524009d00 con 0x7f952c0cd570 2023-09-12T16:06:35.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.020+0000 7f952a59c700 1 --2- 172.21.15.112:0/1474789935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f952c0cd570 0x7f952c1f6250 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f952000c4d0 tx=0x7f952000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:35.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.026+0000 7f951affd700 1 -- 172.21.15.112:0/1474789935 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95200054e0 con 0x7f952c0cd570 2023-09-12T16:06:35.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.026+0000 7f951affd700 1 -- 172.21.15.112:0/1474789935 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9520003680 con 0x7f952c0cd570 2023-09-12T16:06:35.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.026+0000 7f951affd700 1 -- 172.21.15.112:0/1474789935 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520003a90 con 0x7f952c0cd570 2023-09-12T16:06:35.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.026+0000 7f95309ff700 1 -- 172.21.15.112:0/1474789935 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952c0b19b0 con 0x7f952c0cd570 2023-09-12T16:06:35.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.026+0000 7f95309ff700 1 -- 172.21.15.112:0/1474789935 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952c0b1f70 con 0x7f952c0cd570 2023-09-12T16:06:35.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.026+0000 7f9529d9b700 1 --2- 172.21.15.112:0/1474789935 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f952c0cd950 0x7f952c0c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:06:35.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.027+0000 7f952ad9d700 1 --2- 172.21.15.112:0/1474789935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c15caf0 0x7f952c15fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:06:35.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.034+0000 7f951affd700 1 -- 172.21.15.112:0/1474789935 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f952001c440 con 0x7f952c0cd570 2023-09-12T16:06:35.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.034+0000 7f951affd700 1 -- 172.21.15.112:0/1474789935 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9520012860 con 0x7f952c0cd570 2023-09-12T16:06:35.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.042+0000 7f170cff9700 1 -- 172.21.15.112:0/3491114954 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v10)=0 v10) v1 ==== 116+0+0 (secure 0 0 0) 0x7f1704033db0 con 0x7f17100cd950 2023-09-12T16:06:35.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.052+0000 7ff3981ff700 1 -- 172.21.15.112:0/2686877762 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3900cd950 msgr2=0x7ff3900ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.052+0000 7ff3981ff700 1 --2- 172.21.15.112:0/2686877762 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3900cd950 0x7ff3900ccb60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff388009f90 tx=0x7ff38800b330 comp rx=0 tx=0).stop 2023-09-12T16:06:35.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.053+0000 7ff3981ff700 1 -- 172.21.15.112:0/2686877762 shutdown_connections 2023-09-12T16:06:35.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.053+0000 7ff3981ff700 1 --2- 172.21.15.112:0/2686877762 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3900cd950 0x7ff3900ccb60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.053+0000 7ff3981ff700 1 -- 172.21.15.112:0/2686877762 >> 172.21.15.112:0/2686877762 conn(0x7ff39006a020 msgr2=0x7ff39006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:35.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.042+0000 7f95309ff700 1 -- 172.21.15.112:0/1474789935 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95100052f0 con 0x7f952c0cd570 2023-09-12T16:06:35.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.053+0000 7f951affd700 1 -- 172.21.15.112:0/1474789935 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f9520017070 con 0x7f952c0cd570 2023-09-12T16:06:35.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.062+0000 7ff3981ff700 1 -- 172.21.15.112:0/2686877762 shutdown_connections 2023-09-12T16:06:35.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.071+0000 7fe0b7dff700 1 -- 172.21.15.112:0/3830532879 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0b00cd570 msgr2=0x7fe0b00ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.071+0000 7fe0b7dff700 1 --2- 172.21.15.112:0/3830532879 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0b00cd570 0x7fe0b00ccb60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe0a801c0e0 tx=0x7fe0a8009f90 comp rx=0 tx=0).stop 2023-09-12T16:06:35.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.071+0000 7fe0b7dff700 1 -- 172.21.15.112:0/3830532879 shutdown_connections 2023-09-12T16:06:35.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.071+0000 7fe0b7dff700 1 --2- 172.21.15.112:0/3830532879 >> v2:172.21.15.112:3300/0 conn(0x7fe0b00cd950 0x7fe0b00c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.071+0000 7fe0b7dff700 1 --2- 172.21.15.112:0/3830532879 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0b00cd570 0x7fe0b00ccb60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.071+0000 7fe0b7dff700 1 -- 172.21.15.112:0/3830532879 >> 172.21.15.112:0/3830532879 conn(0x7fe0b006a020 msgr2=0x7fe0b006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:35.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.073+0000 7ff3981ff700 1 -- 172.21.15.112:0/2686877762 wait complete. 2023-09-12T16:06:35.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.076+0000 7ff3981ff700 1 Processor -- start 2023-09-12T16:06:35.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.078+0000 7ff3981ff700 1 -- start start 2023-09-12T16:06:35.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.080+0000 7ff3981ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3900cd570 0x7ff3900c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.080+0000 7ff3981ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3900cd950 0x7ff39015ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.080+0000 7ff3981ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff39015caf0 0x7ff39015f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.080+0000 7ff3981ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39015aff0 con 0x7ff39015caf0 2023-09-12T16:06:35.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.080+0000 7ff3981ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3900c3c20 con 0x7ff3900cd950 2023-09-12T16:06:35.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.080+0000 7ff3981ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3900b0ef0 con 0x7ff3900cd570 2023-09-12T16:06:35.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.081+0000 7ff39579a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3900cd950 0x7ff39015ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:35.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.081+0000 7ff39579a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3900cd950 0x7ff39015ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.112:45244/0 (socket says 172.21.15.112:45244) 2023-09-12T16:06:35.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.081+0000 7ff39579a700 1 -- 172.21.15.112:0/3266425438 learned_addr learned my addr 172.21.15.112:0/3266425438 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:35.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.081+0000 7fb6ddffb700 1 -- 172.21.15.112:0/38069709 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v11)=0 v11) v1 ==== 127+0+0 (secure 0 0 0) 0x7fb6e001e520 con 0x7fb6e815caf0 2023-09-12T16:06:35.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.078+0000 7f17169ff700 1 -- 172.21.15.112:0/3491114954 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17100cd950 msgr2=0x7f17100b1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.078+0000 7f17169ff700 1 --2- 172.21.15.112:0/3491114954 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17100cd950 0x7f17100b1e00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1704001e90 tx=0x7f170400c7e0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.083+0000 7fe0b7dff700 1 -- 172.21.15.112:0/3830532879 shutdown_connections 2023-09-12T16:06:35.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.083+0000 7fe0b7dff700 1 -- 172.21.15.112:0/3830532879 wait complete. 2023-09-12T16:06:35.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.085+0000 7fe0b7dff700 1 Processor -- start 2023-09-12T16:06:35.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.086+0000 7fe0b7dff700 1 -- start start 2023-09-12T16:06:35.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.087+0000 7fe0b7dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0b00cd570 0x7fe0b00b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.087+0000 7fe0b7dff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0b00cd950 0x7fe0b00b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.087+0000 7fe0b7dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0b015caf0 0x7fe0b01478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.087+0000 7fe0b7dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b00c5170 con 0x7fe0b00cd570 2023-09-12T16:06:35.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.087+0000 7fe0b7dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b00c5450 con 0x7fe0b015caf0 2023-09-12T16:06:35.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.087+0000 7fe0b7dff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b00c5730 con 0x7fe0b00cd950 2023-09-12T16:06:35.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.088+0000 7fe0b539a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0b00cd950 0x7fe0b00b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:35.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.088+0000 7fe0b539a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0b00cd950 0x7fe0b00b2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.112:48798/0 (socket says 172.21.15.112:48798) 2023-09-12T16:06:35.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.088+0000 7fe0b539a700 1 -- 172.21.15.112:0/3611705215 learned_addr learned my addr 172.21.15.112:0/3611705215 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:35.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.088+0000 7fe0b539a700 1 -- 172.21.15.112:0/3611705215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0b015caf0 msgr2=0x7fe0b01478e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-12T16:06:35.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.088+0000 7fe0b539a700 1 --2- 172.21.15.112:0/3611705215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0b015caf0 0x7fe0b01478e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.088+0000 7fe0b539a700 1 -- 172.21.15.112:0/3611705215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0b00cd570 msgr2=0x7fe0b00b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.088+0000 7fe0b539a700 1 --2- 172.21.15.112:0/3611705215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0b00cd570 0x7fe0b00b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.088+0000 7fe0b539a700 1 -- 172.21.15.112:0/3611705215 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a8009d00 con 0x7fe0b00cd950 2023-09-12T16:06:35.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.089+0000 7fe0b539a700 1 --2- 172.21.15.112:0/3611705215 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0b00cd950 0x7fe0b00b2b50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac00c450 tx=0x7fe0ac00c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:35.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.088+0000 7ff395f9b700 1 --2- 172.21.15.112:0/3266425438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3900cd570 0x7ff3900c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:35.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.092+0000 7f17169ff700 1 -- 172.21.15.112:0/3491114954 shutdown_connections 2023-09-12T16:06:35.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.092+0000 7f17169ff700 1 --2- 172.21.15.112:0/3491114954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f171015caf0 0x7f17100b2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.092+0000 7f17169ff700 1 --2- 172.21.15.112:0/3491114954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17100cd570 0x7f17101594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.092+0000 7f17169ff700 1 --2- 172.21.15.112:0/3491114954 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17100cd950 0x7f17100b1e00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.092+0000 7f17169ff700 1 -- 172.21.15.112:0/3491114954 >> 172.21.15.112:0/3491114954 conn(0x7f171006a020 msgr2=0x7f171006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:35.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.091+0000 7fc6063ff700 1 -- 172.21.15.112:0/3562897454 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) v1 -- 0x7fc5e0005160 con 0x7fc600152d70 2023-09-12T16:06:35.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.092+0000 7fe0a67fc700 1 -- 172.21.15.112:0/3611705215 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac0052d0 con 0x7fe0b00cd950 2023-09-12T16:06:35.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.092+0000 7fe0a67fc700 1 -- 172.21.15.112:0/3611705215 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe0ac005520 con 0x7fe0b00cd950 2023-09-12T16:06:35.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.092+0000 7fe0a67fc700 1 -- 172.21.15.112:0/3611705215 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac0038e0 con 0x7fe0b00cd950 2023-09-12T16:06:35.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.092+0000 7ff39579a700 1 -- 172.21.15.112:0/3266425438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3900cd570 msgr2=0x7ff3900c36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.092+0000 7ff39579a700 1 --2- 172.21.15.112:0/3266425438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3900cd570 0x7ff3900c36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.092+0000 7ff39579a700 1 -- 172.21.15.112:0/3266425438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff39015caf0 msgr2=0x7ff39015f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.092+0000 7ff39579a700 1 --2- 172.21.15.112:0/3266425438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff39015caf0 0x7ff39015f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.092+0000 7ff39579a700 1 -- 172.21.15.112:0/3266425438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff388009c40 con 0x7ff3900cd950 2023-09-12T16:06:35.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.092+0000 7fe0b7dff700 1 -- 172.21.15.112:0/3611705215 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b00c5a10 con 0x7fe0b00cd950 2023-09-12T16:06:35.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.092+0000 7fe0b7dff700 1 -- 172.21.15.112:0/3611705215 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b0159820 con 0x7fe0b00cd950 2023-09-12T16:06:35.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.094+0000 7fe0a67fc700 1 -- 172.21.15.112:0/3611705215 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe0ac003d40 con 0x7fe0b00cd950 2023-09-12T16:06:35.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.094+0000 7fe0a67fc700 1 -- 172.21.15.112:0/3611705215 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe0ac01c7c0 con 0x7fe0b00cd950 2023-09-12T16:06:35.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.094+0000 7ff39579a700 1 --2- 172.21.15.112:0/3266425438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3900cd950 0x7ff39015ee40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00c450 tx=0x7ff38c00c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:35.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.100+0000 7fb6ef9ff700 1 -- 172.21.15.112:0/38069709 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6e815caf0 msgr2=0x7fb6e813ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.100+0000 7fb6ef9ff700 1 --2- 172.21.15.112:0/38069709 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6e815caf0 0x7fb6e813ce80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb6e000b970 tx=0x7fb6e000bd30 comp rx=0 tx=0).stop 2023-09-12T16:06:35.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.101+0000 7f6f8a1ff700 1 -- 172.21.15.112:0/3185138157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f840c8370 msgr2=0x7f6f840cb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.101+0000 7f6f8a1ff700 1 --2- 172.21.15.112:0/3185138157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f840c8370 0x7f6f840cb740 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6f78013e70 tx=0x7f6f780097f0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.101+0000 7f6f8a1ff700 1 -- 172.21.15.112:0/3185138157 shutdown_connections 2023-09-12T16:06:35.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.101+0000 7f6f8a1ff700 1 --2- 172.21.15.112:0/3185138157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f840c8370 0x7f6f840cb740 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.101+0000 7f6f8a1ff700 1 -- 172.21.15.112:0/3185138157 >> 172.21.15.112:0/3185138157 conn(0x7f6f8406a020 msgr2=0x7f6f8406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:35.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.102+0000 7fe0b7dff700 1 -- 172.21.15.112:0/3611705215 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0980052f0 con 0x7fe0b00cd950 2023-09-12T16:06:35.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.103+0000 7fb6ef9ff700 1 -- 172.21.15.112:0/38069709 shutdown_connections 2023-09-12T16:06:35.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.103+0000 7fb6ef9ff700 1 --2- 172.21.15.112:0/38069709 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6e815caf0 0x7fb6e813ce80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.103+0000 7fb6ef9ff700 1 --2- 172.21.15.112:0/38069709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6e80cd570 0x7fb6e8201d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.103+0000 7fb6ef9ff700 1 --2- 172.21.15.112:0/38069709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6e80cd950 0x7fb6e813c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.103+0000 7fb6ef9ff700 1 -- 172.21.15.112:0/38069709 >> 172.21.15.112:0/38069709 conn(0x7fb6e806a020 msgr2=0x7fb6e80701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:35.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.103+0000 7fb6ef9ff700 1 -- 172.21.15.112:0/38069709 shutdown_connections 2023-09-12T16:06:35.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.104+0000 7fb6ef9ff700 1 -- 172.21.15.112:0/38069709 wait complete. 2023-09-12T16:06:35.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.103+0000 7f17169ff700 1 -- 172.21.15.112:0/3491114954 shutdown_connections 2023-09-12T16:06:35.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.104+0000 7ff3867fc700 1 -- 172.21.15.112:0/3266425438 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c011790 con 0x7ff3900cd950 2023-09-12T16:06:35.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.104+0000 7ff3867fc700 1 -- 172.21.15.112:0/3266425438 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff38c0118f0 con 0x7ff3900cd950 2023-09-12T16:06:35.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.104+0000 7ff3867fc700 1 -- 172.21.15.112:0/3266425438 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c011cc0 con 0x7ff3900cd950 2023-09-12T16:06:35.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.105+0000 7ff3981ff700 1 -- 172.21.15.112:0/3266425438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3900c53e0 con 0x7ff3900cd950 2023-09-12T16:06:35.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.105+0000 7ff3981ff700 1 -- 172.21.15.112:0/3266425438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3900c59a0 con 0x7ff3900cd950 2023-09-12T16:06:35.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.106+0000 7ff3867fc700 1 -- 172.21.15.112:0/3266425438 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff38c01c760 con 0x7ff3900cd950 2023-09-12T16:06:35.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.106+0000 7ff3867fc700 1 -- 172.21.15.112:0/3266425438 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff38c012710 con 0x7ff3900cd950 2023-09-12T16:06:35.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.107+0000 7ff3981ff700 1 -- 172.21.15.112:0/3266425438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3900c5bc0 con 0x7ff3900cd950 2023-09-12T16:06:35.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.104+0000 7f6f8a1ff700 1 -- 172.21.15.112:0/3185138157 shutdown_connections 2023-09-12T16:06:35.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.104+0000 7f6f8a1ff700 1 -- 172.21.15.112:0/3185138157 wait complete. 2023-09-12T16:06:35.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.106+0000 7f6f8a1ff700 1 Processor -- start 2023-09-12T16:06:35.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.107+0000 7f6f8a1ff700 1 -- start start 2023-09-12T16:06:35.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.108+0000 7f6f8a1ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6f840c7b60 0x7f6f8415d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.108+0000 7f6f8a1ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f840c8370 0x7f6f841577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.108+0000 7f6f8a1ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f840cd9b0 0x7f6f84157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.108+0000 7f6f8a1ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f84158350 con 0x7f6f840cd9b0 2023-09-12T16:06:35.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.108+0000 7f6f8a1ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f84158630 con 0x7f6f840c8370 2023-09-12T16:06:35.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.108+0000 7f6f8a1ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f84158910 con 0x7f6f840c7b60 2023-09-12T16:06:35.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.109+0000 7f6f837fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6f840c7b60 0x7f6f8415d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:35.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.109+0000 7f6f837fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6f840c7b60 0x7f6f8415d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.112:48804/0 (socket says 172.21.15.112:48804) 2023-09-12T16:06:35.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.109+0000 7f6f837fe700 1 -- 172.21.15.112:0/2290166921 learned_addr learned my addr 172.21.15.112:0/2290166921 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:35.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.109+0000 7f6f82ffd700 1 --2- 172.21.15.112:0/2290166921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f840c8370 0x7f6f841577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:35.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.110+0000 7f6f82ffd700 1 -- 172.21.15.112:0/2290166921 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6f840c7b60 msgr2=0x7f6f8415d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.110+0000 7f6f82ffd700 1 --2- 172.21.15.112:0/2290166921 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6f840c7b60 0x7f6f8415d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.110+0000 7f6f82ffd700 1 -- 172.21.15.112:0/2290166921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f840cd9b0 msgr2=0x7f6f84157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.110+0000 7f6f82ffd700 1 --2- 172.21.15.112:0/2290166921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f840cd9b0 0x7f6f84157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.110+0000 7f6f82ffd700 1 -- 172.21.15.112:0/2290166921 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f78013b50 con 0x7f6f840c8370 2023-09-12T16:06:35.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.110+0000 7f6f82ffd700 1 --2- 172.21.15.112:0/2290166921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f840c8370 0x7f6f841577e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400b390 tx=0x7f6f7400b6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:35.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.114+0000 7f6f6bfff700 1 -- 172.21.15.112:0/2290166921 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f74011830 con 0x7f6f840c8370 2023-09-12T16:06:35.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.115+0000 7f6f6bfff700 1 -- 172.21.15.112:0/2290166921 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6f74011a80 con 0x7f6f840c8370 2023-09-12T16:06:35.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.115+0000 7f6f6bfff700 1 -- 172.21.15.112:0/2290166921 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f74011e90 con 0x7f6f840c8370 2023-09-12T16:06:35.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.115+0000 7f6f8a1ff700 1 -- 172.21.15.112:0/2290166921 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f84158bf0 con 0x7f6f840c8370 2023-09-12T16:06:35.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.115+0000 7f6f8a1ff700 1 -- 172.21.15.112:0/2290166921 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f84158ed0 con 0x7f6f840c8370 2023-09-12T16:06:35.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.115+0000 7f6f6bfff700 1 -- 172.21.15.112:0/2290166921 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6f7401a700 con 0x7f6f840c8370 2023-09-12T16:06:35.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.115+0000 7f6f6bfff700 1 -- 172.21.15.112:0/2290166921 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6f740196b0 con 0x7f6f840c8370 2023-09-12T16:06:35.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.112+0000 7f17169ff700 1 -- 172.21.15.112:0/3491114954 wait complete. 2023-09-12T16:06:35.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.116+0000 7ff3867fc700 1 -- 172.21.15.112:0/3266425438 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7ff38c012920 con 0x7ff3900cd950 2023-09-12T16:06:35.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.118+0000 7fe0a67fc700 1 -- 172.21.15.112:0/3611705215 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fe0ac021060 con 0x7fe0b00cd950 2023-09-12T16:06:35.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.125+0000 7fc1789ff700 1 -- 172.21.15.112:0/1695910779 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) v1 -- 0x7fc158005160 con 0x7fc174088be0 2023-09-12T16:06:35.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.124+0000 7f6f8a1ff700 1 -- 172.21.15.112:0/2290166921 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f640052f0 con 0x7f6f840c8370 2023-09-12T16:06:35.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.137+0000 7f6f6bfff700 1 -- 172.21.15.112:0/2290166921 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f6f74039b20 con 0x7f6f840c8370 2023-09-12T16:06:35.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.144+0000 7fdfab3ff700 1 -- 172.21.15.112:0/3896398086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfa416bb20 msgr2=0x7fdfa40886a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.144+0000 7fdfab3ff700 1 --2- 172.21.15.112:0/3896398086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfa416bb20 0x7fdfa40886a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0007570 tx=0x7fdfa0007880 comp rx=0 tx=0).stop 2023-09-12T16:06:35.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.144+0000 7fdfab3ff700 1 -- 172.21.15.112:0/3896398086 shutdown_connections 2023-09-12T16:06:35.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.144+0000 7fdfab3ff700 1 --2- 172.21.15.112:0/3896398086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfa416bb20 0x7fdfa40886a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.144+0000 7fdfab3ff700 1 -- 172.21.15.112:0/3896398086 >> 172.21.15.112:0/3896398086 conn(0x7fdfa406a020 msgr2=0x7fdfa406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:35.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.146+0000 7fdfab3ff700 1 -- 172.21.15.112:0/3896398086 shutdown_connections 2023-09-12T16:06:35.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.146+0000 7fdfab3ff700 1 -- 172.21.15.112:0/3896398086 wait complete. 2023-09-12T16:06:35.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.149+0000 7fdfab3ff700 1 Processor -- start 2023-09-12T16:06:35.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.149+0000 7fdfab3ff700 1 -- start start 2023-09-12T16:06:35.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.150+0000 7fdfab3ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdfa4088be0 0x7fdfa4202f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.150+0000 7fdfab3ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfa40cd9e0 0x7fdfa4205660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.150+0000 7fdfab3ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfa416bb20 0x7fdfa4205ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.150+0000 7fdfab3ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa4204270 con 0x7fdfa416bb20 2023-09-12T16:06:35.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.150+0000 7fdfab3ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40b1230 con 0x7fdfa40cd9e0 2023-09-12T16:06:35.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.150+0000 7fdfab3ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa42060e0 con 0x7fdfa4088be0 2023-09-12T16:06:35.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.151+0000 7fdfa899a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfa40cd9e0 0x7fdfa4205660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:35.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.151+0000 7fdfa899a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfa40cd9e0 0x7fdfa4205660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.112:45310/0 (socket says 172.21.15.112:45310) 2023-09-12T16:06:35.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.151+0000 7fdfa899a700 1 -- 172.21.15.112:0/2420854477 learned_addr learned my addr 172.21.15.112:0/2420854477 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:35.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.151+0000 7fdfa999c700 1 --2- 172.21.15.112:0/2420854477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfa416bb20 0x7fdfa4205ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:35.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.151+0000 7fdfa919b700 1 --2- 172.21.15.112:0/2420854477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdfa4088be0 0x7fdfa4202f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:35.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.152+0000 7fdfa899a700 1 -- 172.21.15.112:0/2420854477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdfa4088be0 msgr2=0x7fdfa4202f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.152+0000 7fdfa899a700 1 --2- 172.21.15.112:0/2420854477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdfa4088be0 0x7fdfa4202f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.152+0000 7fdfa899a700 1 -- 172.21.15.112:0/2420854477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfa416bb20 msgr2=0x7fdfa4205ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.152+0000 7fdfa899a700 1 --2- 172.21.15.112:0/2420854477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfa416bb20 0x7fdfa4205ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.152+0000 7fdfa899a700 1 -- 172.21.15.112:0/2420854477 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa0007220 con 0x7fdfa40cd9e0 2023-09-12T16:06:35.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.152+0000 7fdfa899a700 1 --2- 172.21.15.112:0/2420854477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfa40cd9e0 0x7fdfa4205660 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdf9400c4a0 tx=0x7fdf9400c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:35.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.153+0000 7fdf99ffb700 1 -- 172.21.15.112:0/2420854477 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf940054e0 con 0x7fdfa40cd9e0 2023-09-12T16:06:35.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.153+0000 7fdf99ffb700 1 -- 172.21.15.112:0/2420854477 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdf94003680 con 0x7fdfa40cd9e0 2023-09-12T16:06:35.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.153+0000 7fdf99ffb700 1 -- 172.21.15.112:0/2420854477 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf94003a90 con 0x7fdfa40cd9e0 2023-09-12T16:06:35.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.153+0000 7fdfab3ff700 1 -- 172.21.15.112:0/2420854477 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa4203460 con 0x7fdfa40cd9e0 2023-09-12T16:06:35.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.153+0000 7fdfab3ff700 1 -- 172.21.15.112:0/2420854477 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa42039d0 con 0x7fdfa40cd9e0 2023-09-12T16:06:35.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.154+0000 7fdf99ffb700 1 -- 172.21.15.112:0/2420854477 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdf9401c440 con 0x7fdfa40cd9e0 2023-09-12T16:06:35.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.154+0000 7fdf99ffb700 1 -- 172.21.15.112:0/2420854477 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdf94012740 con 0x7fdfa40cd9e0 2023-09-12T16:06:35.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.154+0000 7fc5fcff9700 1 -- 172.21.15.112:0/3562897454 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v12)=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc5f0028020 con 0x7fc600152d70 2023-09-12T16:06:35.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.154+0000 7fe926dff700 1 -- 172.21.15.112:0/1326064599 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) v1 -- 0x7fe920073ea0 con 0x7fe92015caf0 2023-09-12T16:06:35.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.149+0000 7f1704fff700 1 -- 172.21.15.112:0/4236545108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17000cd950 msgr2=0x7f17000ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.149+0000 7f1704fff700 1 --2- 172.21.15.112:0/4236545108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17000cd950 0x7f17000ccb60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009f60 tx=0x7f16f8009f90 comp rx=0 tx=0).stop 2023-09-12T16:06:35.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.154+0000 7f1704fff700 1 -- 172.21.15.112:0/4236545108 shutdown_connections 2023-09-12T16:06:35.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.154+0000 7f1704fff700 1 --2- 172.21.15.112:0/4236545108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17000cd950 0x7f17000ccb60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.154+0000 7f1704fff700 1 -- 172.21.15.112:0/4236545108 >> 172.21.15.112:0/4236545108 conn(0x7f170006a020 msgr2=0x7f170006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:35.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.164+0000 7fc162ffd700 1 -- 172.21.15.112:0/1695910779 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v13)=0 v13) v1 ==== 116+0+0 (secure 0 0 0) 0x7fc164028020 con 0x7fc174088be0 2023-09-12T16:06:35.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.164+0000 7fdfab3ff700 1 -- 172.21.15.112:0/2420854477 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf840052f0 con 0x7fdfa40cd9e0 2023-09-12T16:06:35.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.164+0000 7f6914fff700 1 -- 172.21.15.112:0/43361556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691015caf0 msgr2=0x7f69100cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.164+0000 7f6914fff700 1 --2- 172.21.15.112:0/43361556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691015caf0 0x7f69100cb270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f691006af10 tx=0x7f6904009ba0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.165+0000 7f6914fff700 1 -- 172.21.15.112:0/43361556 shutdown_connections 2023-09-12T16:06:35.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.165+0000 7f6914fff700 1 --2- 172.21.15.112:0/43361556 >> v2:172.21.15.112:3300/0 conn(0x7f69100cd950 0x7f69100c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.165+0000 7f6914fff700 1 --2- 172.21.15.112:0/43361556 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69100cd570 0x7f69100ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.165+0000 7f6914fff700 1 --2- 172.21.15.112:0/43361556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691015caf0 0x7f69100cb270 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.165+0000 7f6914fff700 1 -- 172.21.15.112:0/43361556 >> 172.21.15.112:0/43361556 conn(0x7f691006a020 msgr2=0x7f691006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:35.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.165+0000 7f1704fff700 1 -- 172.21.15.112:0/4236545108 shutdown_connections 2023-09-12T16:06:35.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.166+0000 7fc1789ff700 1 -- 172.21.15.112:0/1695910779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc174088be0 msgr2=0x7fc1740b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.166+0000 7fc1789ff700 1 --2- 172.21.15.112:0/1695910779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc174088be0 0x7fc1740b0ae0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc16400b4a0 tx=0x7fc16400b860 comp rx=0 tx=0).stop 2023-09-12T16:06:35.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.167+0000 7fc6063ff700 1 -- 172.21.15.112:0/3562897454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc600152d70 msgr2=0x7fc600154120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.167+0000 7fc6063ff700 1 --2- 172.21.15.112:0/3562897454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc600152d70 0x7fc600154120 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000b390 tx=0x7fc5f000b750 comp rx=0 tx=0).stop 2023-09-12T16:06:35.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.167+0000 7fc6063ff700 1 -- 172.21.15.112:0/3562897454 shutdown_connections 2023-09-12T16:06:35.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.167+0000 7fc6063ff700 1 --2- 172.21.15.112:0/3562897454 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc600154660 0x7fc600154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.167+0000 7fc6063ff700 1 --2- 172.21.15.112:0/3562897454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e8003a30 0x7fc600152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.167+0000 7fc6063ff700 1 --2- 172.21.15.112:0/3562897454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc600152d70 0x7fc600154120 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.167+0000 7fc6063ff700 1 -- 172.21.15.112:0/3562897454 >> 172.21.15.112:0/3562897454 conn(0x7fc60006a020 msgr2=0x7fc6000cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:35.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.167+0000 7fc6063ff700 1 -- 172.21.15.112:0/3562897454 shutdown_connections 2023-09-12T16:06:35.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.167+0000 7fc6063ff700 1 -- 172.21.15.112:0/3562897454 wait complete. 2023-09-12T16:06:35.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.165+0000 7f1704fff700 1 -- 172.21.15.112:0/4236545108 wait complete. 2023-09-12T16:06:35.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.167+0000 7f1704fff700 1 Processor -- start 2023-09-12T16:06:35.177 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi112') 2023-09-12T16:06:35.178 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi112') 2023-09-12T16:06:35.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.165+0000 7f6914fff700 1 -- 172.21.15.112:0/43361556 shutdown_connections 2023-09-12T16:06:35.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.172+0000 7f6914fff700 1 -- 172.21.15.112:0/43361556 wait complete. 2023-09-12T16:06:35.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.174+0000 7f6914fff700 1 Processor -- start 2023-09-12T16:06:35.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.175+0000 7f6914fff700 1 -- start start 2023-09-12T16:06:35.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.176+0000 7f6914fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69100cd570 0x7f691013ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.176+0000 7f6914fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69100cd950 0x7f69100c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.176+0000 7f6914fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691015caf0 0x7f69100ad290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.176+0000 7f6914fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691013d3d0 con 0x7f69100cd950 2023-09-12T16:06:35.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.176+0000 7f6914fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69100c3200 con 0x7f691015caf0 2023-09-12T16:06:35.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.176+0000 7f6914fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69100c5660 con 0x7f69100cd570 2023-09-12T16:06:35.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.168+0000 7f1704fff700 1 -- start start 2023-09-12T16:06:35.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.169+0000 7f1704fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17000cd570 0x7f170013d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.169+0000 7f1704fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17000cd950 0x7f170015f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.169+0000 7f1704fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f170015caf0 0x7f170015f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.169+0000 7f1704fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17000b1590 con 0x7f170015caf0 2023-09-12T16:06:35.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.169+0000 7f1704fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1700157c50 con 0x7f17000cd950 2023-09-12T16:06:35.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.169+0000 7f1704fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1700158a20 con 0x7f17000cd570 2023-09-12T16:06:35.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.170+0000 7f16fe59c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17000cd570 0x7f170013d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:35.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.170+0000 7f16fe59c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17000cd570 0x7f170013d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.112:48824/0 (socket says 172.21.15.112:48824) 2023-09-12T16:06:35.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.170+0000 7f16fe59c700 1 -- 172.21.15.112:0/647918485 learned_addr learned my addr 172.21.15.112:0/647918485 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:35.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.170+0000 7f16fdd9b700 1 --2- 172.21.15.112:0/647918485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17000cd950 0x7f170015f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:35.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.171+0000 7f16fdd9b700 1 -- 172.21.15.112:0/647918485 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17000cd570 msgr2=0x7f170013d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.171+0000 7f16fdd9b700 1 --2- 172.21.15.112:0/647918485 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17000cd570 0x7f170013d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.171+0000 7f16fdd9b700 1 -- 172.21.15.112:0/647918485 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f170015caf0 msgr2=0x7f170015f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.171+0000 7f16fdd9b700 1 --2- 172.21.15.112:0/647918485 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f170015caf0 0x7f170015f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.171+0000 7f16fdd9b700 1 -- 172.21.15.112:0/647918485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f8009c40 con 0x7f17000cd950 2023-09-12T16:06:35.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.172+0000 7f16fdd9b700 1 --2- 172.21.15.112:0/647918485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17000cd950 0x7f170015f1e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f16f400c390 tx=0x7f16f400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:35.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.172+0000 7f16eeffd700 1 -- 172.21.15.112:0/647918485 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f4011790 con 0x7f17000cd950 2023-09-12T16:06:35.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.172+0000 7f16eeffd700 1 -- 172.21.15.112:0/647918485 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f16f40119e0 con 0x7f17000cd950 2023-09-12T16:06:35.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.172+0000 7f16eeffd700 1 -- 172.21.15.112:0/647918485 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f4011db0 con 0x7f17000cd950 2023-09-12T16:06:35.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.172+0000 7f1704fff700 1 -- 172.21.15.112:0/647918485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1700157ea0 con 0x7f17000cd950 2023-09-12T16:06:35.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.172+0000 7f1704fff700 1 -- 172.21.15.112:0/647918485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1700158460 con 0x7f17000cd950 2023-09-12T16:06:35.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.175+0000 7f16eeffd700 1 -- 172.21.15.112:0/647918485 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f16f401c760 con 0x7f17000cd950 2023-09-12T16:06:35.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.175+0000 7f16eeffd700 1 -- 172.21.15.112:0/647918485 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f16f4012710 con 0x7f17000cd950 2023-09-12T16:06:35.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.175+0000 7f1704fff700 1 -- 172.21.15.112:0/647918485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e0005320 con 0x7f17000cd950 2023-09-12T16:06:35.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.177+0000 7f690dd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69100cd950 0x7f69100c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:35.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.177+0000 7f690dd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69100cd950 0x7f69100c2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55362/0 (socket says 172.21.15.112:55362) 2023-09-12T16:06:35.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.177+0000 7f690dd9b700 1 -- 172.21.15.112:0/3681283836 learned_addr learned my addr 172.21.15.112:0/3681283836 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:35.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.177+0000 7f690ed9d700 1 --2- 172.21.15.112:0/3681283836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691015caf0 0x7f69100ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:35.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.178+0000 7fc1789ff700 1 -- 172.21.15.112:0/1695910779 shutdown_connections 2023-09-12T16:06:35.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.178+0000 7fc1789ff700 1 --2- 172.21.15.112:0/1695910779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc17416bb20 0x7fc1740b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.178+0000 7fc1789ff700 1 --2- 172.21.15.112:0/1695910779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc174088be0 0x7fc1740b0ae0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.178+0000 7fc1789ff700 1 --2- 172.21.15.112:0/1695910779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1740cd9e0 0x7fc1741648d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.178+0000 7fc1789ff700 1 -- 172.21.15.112:0/1695910779 >> 172.21.15.112:0/1695910779 conn(0x7fc17406a020 msgr2=0x7fc174071ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:35.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.177+0000 7f690ed9d700 1 -- 172.21.15.112:0/3681283836 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69100cd570 msgr2=0x7f691013ce90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-12T16:06:35.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.177+0000 7f690ed9d700 1 --2- 172.21.15.112:0/3681283836 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69100cd570 0x7f691013ce90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.177+0000 7f690ed9d700 1 -- 172.21.15.112:0/3681283836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69100cd950 msgr2=0x7f69100c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.177+0000 7f690ed9d700 1 --2- 172.21.15.112:0/3681283836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69100cd950 0x7f69100c2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.177+0000 7f690ed9d700 1 -- 172.21.15.112:0/3681283836 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6904009520 con 0x7f691015caf0 2023-09-12T16:06:35.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.178+0000 7f690ed9d700 1 --2- 172.21.15.112:0/3681283836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691015caf0 0x7f69100ad290 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f690800efc0 tx=0x7f690800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:35.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.178+0000 7f68feffd700 1 -- 172.21.15.112:0/3681283836 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908018070 con 0x7f691015caf0 2023-09-12T16:06:35.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.178+0000 7f68feffd700 1 -- 172.21.15.112:0/3681283836 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f690800f040 con 0x7f691015caf0 2023-09-12T16:06:35.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.178+0000 7f68feffd700 1 -- 172.21.15.112:0/3681283836 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908004bb0 con 0x7f691015caf0 2023-09-12T16:06:35.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.178+0000 7f6914fff700 1 -- 172.21.15.112:0/3681283836 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69100c5940 con 0x7f691015caf0 2023-09-12T16:06:35.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.178+0000 7f6914fff700 1 -- 172.21.15.112:0/3681283836 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69100c5f00 con 0x7f691015caf0 2023-09-12T16:06:35.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.179+0000 7f68feffd700 1 -- 172.21.15.112:0/3681283836 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6908003d00 con 0x7f691015caf0 2023-09-12T16:06:35.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.179+0000 7f68feffd700 1 -- 172.21.15.112:0/3681283836 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f69080045e0 con 0x7f691015caf0 2023-09-12T16:06:35.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.179+0000 7f16eeffd700 1 -- 172.21.15.112:0/647918485 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f16f4012920 con 0x7f17000cd950 2023-09-12T16:06:35.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.187+0000 7fc1789ff700 1 -- 172.21.15.112:0/1695910779 shutdown_connections 2023-09-12T16:06:35.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.187+0000 7fc1789ff700 1 -- 172.21.15.112:0/1695910779 wait complete. 2023-09-12T16:06:35.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.179+0000 7fdf99ffb700 1 -- 172.21.15.112:0/2420854477 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fdf94021060 con 0x7fdfa40cd9e0 2023-09-12T16:06:35.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.189+0000 7fe91d7fa700 1 -- 172.21.15.112:0/1326064599 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe91801be60 con 0x7fe92015caf0 2023-09-12T16:06:35.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.191+0000 7fe926dff700 1 -- 172.21.15.112:0/1326064599 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe92015caf0 msgr2=0x7fe92015a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.191+0000 7fe926dff700 1 --2- 172.21.15.112:0/1326064599 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe92015caf0 0x7fe92015a800 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe918004ac0 tx=0x7fe91800cde0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.192+0000 7fe926dff700 1 -- 172.21.15.112:0/1326064599 shutdown_connections 2023-09-12T16:06:35.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.192+0000 7fe926dff700 1 --2- 172.21.15.112:0/1326064599 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe92015caf0 0x7fe92015a800 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.192+0000 7fe926dff700 1 --2- 172.21.15.112:0/1326064599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9200cd570 0x7fe92013cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.192+0000 7fe926dff700 1 --2- 172.21.15.112:0/1326064599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9200cd950 0x7fe92015a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.192+0000 7fe926dff700 1 -- 172.21.15.112:0/1326064599 >> 172.21.15.112:0/1326064599 conn(0x7fe92006a020 msgr2=0x7fe9200ad820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:35.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.192+0000 7fe926dff700 1 -- 172.21.15.112:0/1326064599 shutdown_connections 2023-09-12T16:06:35.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.192+0000 7fe926dff700 1 -- 172.21.15.112:0/1326064599 wait complete. 2023-09-12T16:06:35.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.187+0000 7f6914fff700 1 -- 172.21.15.112:0/3681283836 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6910073ea0 con 0x7f691015caf0 2023-09-12T16:06:35.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.203+0000 7f159bdff700 1 -- 172.21.15.112:0/1714244130 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) v1 -- 0x7f15940c55e0 con 0x7f15940cd950 2023-09-12T16:06:35.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.204+0000 7f68feffd700 1 -- 172.21.15.112:0/3681283836 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f69080047f0 con 0x7f691015caf0 2023-09-12T16:06:35.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.222+0000 7f158a7fc700 1 -- 172.21.15.112:0/1714244130 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v15)=0 v15) v1 ==== 115+0+0 (secure 0 0 0) 0x7f15940c55e0 con 0x7f15940cd950 2023-09-12T16:06:35.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.219+0000 7f95309ff700 1 -- 172.21.15.112:0/1474789935 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) v1 -- 0x7f9510005160 con 0x7f952c0cd570 2023-09-12T16:06:35.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.224+0000 7f159bdff700 1 -- 172.21.15.112:0/1714244130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15940cd950 msgr2=0x7f159413db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.224+0000 7f159bdff700 1 --2- 172.21.15.112:0/1714244130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15940cd950 0x7f159413db10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1584026000 tx=0x7f1584004640 comp rx=0 tx=0).stop 2023-09-12T16:06:35.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.230+0000 7f159bdff700 1 -- 172.21.15.112:0/1714244130 shutdown_connections 2023-09-12T16:06:35.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.230+0000 7f159bdff700 1 --2- 172.21.15.112:0/1714244130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15940cd570 0x7f15940b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.230+0000 7f159bdff700 1 --2- 172.21.15.112:0/1714244130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f159415caf0 0x7f159413e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.230+0000 7f159bdff700 1 --2- 172.21.15.112:0/1714244130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15940cd950 0x7f159413db10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.230+0000 7f159bdff700 1 -- 172.21.15.112:0/1714244130 >> 172.21.15.112:0/1714244130 conn(0x7f159406a020 msgr2=0x7f15940ae650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:35.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.231+0000 7f159bdff700 1 -- 172.21.15.112:0/1714244130 shutdown_connections 2023-09-12T16:06:35.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.231+0000 7f159bdff700 1 -- 172.21.15.112:0/1714244130 wait complete. 2023-09-12T16:06:35.234 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi112') 2023-09-12T16:06:35.234 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi112') 2023-09-12T16:06:35.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.245+0000 7f951affd700 1 -- 172.21.15.112:0/1474789935 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v16)=0 v16) v1 ==== 121+0+0 (secure 0 0 0) 0x7f9520012ad0 con 0x7f952c0cd570 2023-09-12T16:06:35.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.247+0000 7f95309ff700 1 -- 172.21.15.112:0/1474789935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f952c0cd570 msgr2=0x7f952c1f6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.247+0000 7f95309ff700 1 --2- 172.21.15.112:0/1474789935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f952c0cd570 0x7f952c1f6250 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f952000c4d0 tx=0x7f952000c890 comp rx=0 tx=0).stop 2023-09-12T16:06:35.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.248+0000 7f95309ff700 1 -- 172.21.15.112:0/1474789935 shutdown_connections 2023-09-12T16:06:35.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.248+0000 7f95309ff700 1 --2- 172.21.15.112:0/1474789935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c15caf0 0x7f952c15fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.248+0000 7f95309ff700 1 --2- 172.21.15.112:0/1474789935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f952c0cd570 0x7f952c1f6250 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.248+0000 7f95309ff700 1 --2- 172.21.15.112:0/1474789935 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f952c0cd950 0x7f952c0c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.248+0000 7f95309ff700 1 -- 172.21.15.112:0/1474789935 >> 172.21.15.112:0/1474789935 conn(0x7f952c06a020 msgr2=0x7f952c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:35.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.248+0000 7f95309ff700 1 -- 172.21.15.112:0/1474789935 shutdown_connections 2023-09-12T16:06:35.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.248+0000 7f95309ff700 1 -- 172.21.15.112:0/1474789935 wait complete. 2023-09-12T16:06:35.269 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi112') 2023-09-12T16:06:35.270 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi112') 2023-09-12T16:06:35.277 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi112') 2023-09-12T16:06:35.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.276+0000 7ff3981ff700 1 -- 172.21.15.112:0/3266425438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) v1 -- 0x7ff39006a630 con 0x7ff3900cd950 2023-09-12T16:06:35.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.282+0000 7ff3867fc700 1 -- 172.21.15.112:0/3266425438 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v17)=0 v17) v1 ==== 119+0+0 (secure 0 0 0) 0x7ff38c01cba0 con 0x7ff3900cd950 2023-09-12T16:06:35.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.284+0000 7ff3981ff700 1 -- 172.21.15.112:0/3266425438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3900cd950 msgr2=0x7ff39015ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.284+0000 7ff3981ff700 1 --2- 172.21.15.112:0/3266425438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3900cd950 0x7ff39015ee40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00c450 tx=0x7ff38c00c760 comp rx=0 tx=0).stop 2023-09-12T16:06:35.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.284+0000 7ff3981ff700 1 -- 172.21.15.112:0/3266425438 shutdown_connections 2023-09-12T16:06:35.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.284+0000 7ff3981ff700 1 --2- 172.21.15.112:0/3266425438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3900cd570 0x7ff3900c36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.284+0000 7ff3981ff700 1 --2- 172.21.15.112:0/3266425438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff39015caf0 0x7ff39015f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.284+0000 7ff3981ff700 1 --2- 172.21.15.112:0/3266425438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3900cd950 0x7ff39015ee40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.284+0000 7ff3981ff700 1 -- 172.21.15.112:0/3266425438 >> 172.21.15.112:0/3266425438 conn(0x7ff39006a020 msgr2=0x7ff3900c9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:35.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.284+0000 7ff3981ff700 1 -- 172.21.15.112:0/3266425438 shutdown_connections 2023-09-12T16:06:35.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.284+0000 7ff3981ff700 1 -- 172.21.15.112:0/3266425438 wait complete. 2023-09-12T16:06:35.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.287+0000 7fe0b7dff700 1 -- 172.21.15.112:0/3611705215 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7fe098005160 con 0x7fe0b00cd950 2023-09-12T16:06:35.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.294+0000 7f6f8a1ff700 1 -- 172.21.15.112:0/2290166921 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7f6f64005160 con 0x7f6f840c8370 2023-09-12T16:06:35.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.298+0000 7fe0a67fc700 1 -- 172.21.15.112:0/3611705215 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v18)=0 v18) v1 ==== 120+0+0 (secure 0 0 0) 0x7fe0ac017070 con 0x7fe0b00cd950 2023-09-12T16:06:35.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.300+0000 7fe0b7dff700 1 -- 172.21.15.112:0/3611705215 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0b00cd950 msgr2=0x7fe0b00b2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.300+0000 7fe0b7dff700 1 --2- 172.21.15.112:0/3611705215 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0b00cd950 0x7fe0b00b2b50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac00c450 tx=0x7fe0ac00c810 comp rx=0 tx=0).stop 2023-09-12T16:06:35.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.300+0000 7fe0b7dff700 1 -- 172.21.15.112:0/3611705215 shutdown_connections 2023-09-12T16:06:35.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.300+0000 7fe0b7dff700 1 --2- 172.21.15.112:0/3611705215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0b015caf0 0x7fe0b01478e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.300+0000 7fe0b7dff700 1 --2- 172.21.15.112:0/3611705215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0b00cd570 0x7fe0b00b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.300+0000 7fe0b7dff700 1 --2- 172.21.15.112:0/3611705215 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0b00cd950 0x7fe0b00b2b50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.300+0000 7fe0b7dff700 1 -- 172.21.15.112:0/3611705215 >> 172.21.15.112:0/3611705215 conn(0x7fe0b006a020 msgr2=0x7fe0b006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:35.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.300+0000 7fe0b7dff700 1 -- 172.21.15.112:0/3611705215 shutdown_connections 2023-09-12T16:06:35.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.301+0000 7fe0b7dff700 1 -- 172.21.15.112:0/3611705215 wait complete. 2023-09-12T16:06:35.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.302+0000 7f1704fff700 1 -- 172.21.15.112:0/647918485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7f16e0005190 con 0x7f17000cd950 2023-09-12T16:06:35.308 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi112') 2023-09-12T16:06:35.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.314+0000 7f6f6bfff700 1 -- 172.21.15.112:0/2290166921 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v19)=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7f6f74028030 con 0x7f6f840c8370 2023-09-12T16:06:35.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.316+0000 7f6f8a1ff700 1 -- 172.21.15.112:0/2290166921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f840c8370 msgr2=0x7f6f841577e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.316+0000 7f6f8a1ff700 1 --2- 172.21.15.112:0/2290166921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f840c8370 0x7f6f841577e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400b390 tx=0x7f6f7400b6a0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.316+0000 7f6f8a1ff700 1 -- 172.21.15.112:0/2290166921 shutdown_connections 2023-09-12T16:06:35.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.316+0000 7f6f8a1ff700 1 --2- 172.21.15.112:0/2290166921 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6f840c7b60 0x7f6f8415d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.316+0000 7f6f8a1ff700 1 --2- 172.21.15.112:0/2290166921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f840cd9b0 0x7f6f84157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.316+0000 7f6f8a1ff700 1 --2- 172.21.15.112:0/2290166921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f840c8370 0x7f6f841577e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.316+0000 7f6f8a1ff700 1 -- 172.21.15.112:0/2290166921 >> 172.21.15.112:0/2290166921 conn(0x7f6f8406a020 msgr2=0x7f6f8406c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:35.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.316+0000 7f6f8a1ff700 1 -- 172.21.15.112:0/2290166921 shutdown_connections 2023-09-12T16:06:35.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.316+0000 7f6f8a1ff700 1 -- 172.21.15.112:0/2290166921 wait complete. 2023-09-12T16:06:35.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.320+0000 7f16eeffd700 1 -- 172.21.15.112:0/647918485 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v20)=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7f16f401cba0 con 0x7f17000cd950 2023-09-12T16:06:35.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.322+0000 7f1704fff700 1 -- 172.21.15.112:0/647918485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17000cd950 msgr2=0x7f170015f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.322+0000 7f1704fff700 1 --2- 172.21.15.112:0/647918485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17000cd950 0x7f170015f1e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f16f400c390 tx=0x7f16f400c6a0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.322+0000 7f1704fff700 1 -- 172.21.15.112:0/647918485 shutdown_connections 2023-09-12T16:06:35.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.322+0000 7f1704fff700 1 --2- 172.21.15.112:0/647918485 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17000cd570 0x7f170013d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.322+0000 7f1704fff700 1 --2- 172.21.15.112:0/647918485 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f170015caf0 0x7f170015f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.322+0000 7f1704fff700 1 --2- 172.21.15.112:0/647918485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17000cd950 0x7f170015f1e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.322+0000 7f1704fff700 1 -- 172.21.15.112:0/647918485 >> 172.21.15.112:0/647918485 conn(0x7f170006a020 msgr2=0x7f17000c9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:35.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.322+0000 7f1704fff700 1 -- 172.21.15.112:0/647918485 shutdown_connections 2023-09-12T16:06:35.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.322+0000 7f1704fff700 1 -- 172.21.15.112:0/647918485 wait complete. 2023-09-12T16:06:35.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.322+0000 7fdfab3ff700 1 -- 172.21.15.112:0/2420854477 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) v1 -- 0x7fdf84005160 con 0x7fdfa40cd9e0 2023-09-12T16:06:35.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.322+0000 7f6914fff700 1 -- 172.21.15.112:0/3681283836 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7f691015e490 con 0x7f691015caf0 2023-09-12T16:06:35.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.326+0000 7fdf99ffb700 1 -- 172.21.15.112:0/2420854477 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v21)=0 v21) v1 ==== 121+0+0 (secure 0 0 0) 0x7fdf94017070 con 0x7fdfa40cd9e0 2023-09-12T16:06:35.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.327+0000 7fdfab3ff700 1 -- 172.21.15.112:0/2420854477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfa40cd9e0 msgr2=0x7fdfa4205660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.327+0000 7fdfab3ff700 1 --2- 172.21.15.112:0/2420854477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfa40cd9e0 0x7fdfa4205660 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdf9400c4a0 tx=0x7fdf9400c860 comp rx=0 tx=0).stop 2023-09-12T16:06:35.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.327+0000 7fdfab3ff700 1 -- 172.21.15.112:0/2420854477 shutdown_connections 2023-09-12T16:06:35.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.327+0000 7fdfab3ff700 1 --2- 172.21.15.112:0/2420854477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdfa4088be0 0x7fdfa4202f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.327+0000 7fdfab3ff700 1 --2- 172.21.15.112:0/2420854477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfa416bb20 0x7fdfa4205ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.327+0000 7fdfab3ff700 1 --2- 172.21.15.112:0/2420854477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfa40cd9e0 0x7fdfa4205660 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.327+0000 7fdfab3ff700 1 -- 172.21.15.112:0/2420854477 >> 172.21.15.112:0/2420854477 conn(0x7fdfa406a020 msgr2=0x7fdfa40c78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:35.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.327+0000 7fdfab3ff700 1 -- 172.21.15.112:0/2420854477 shutdown_connections 2023-09-12T16:06:35.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.327+0000 7fdfab3ff700 1 -- 172.21.15.112:0/2420854477 wait complete. 2023-09-12T16:06:35.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.329+0000 7f68feffd700 1 -- 172.21.15.112:0/3681283836 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v22)=0 v22) v1 ==== 120+0+0 (secure 0 0 0) 0x7f690800c9f0 con 0x7f691015caf0 2023-09-12T16:06:35.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.330+0000 7f6914fff700 1 -- 172.21.15.112:0/3681283836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691015caf0 msgr2=0x7f69100ad290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.330+0000 7f6914fff700 1 --2- 172.21.15.112:0/3681283836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691015caf0 0x7f69100ad290 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f690800efc0 tx=0x7f690800c3a0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.330+0000 7f6914fff700 1 -- 172.21.15.112:0/3681283836 shutdown_connections 2023-09-12T16:06:35.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.330+0000 7f6914fff700 1 --2- 172.21.15.112:0/3681283836 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69100cd570 0x7f691013ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.330+0000 7f6914fff700 1 --2- 172.21.15.112:0/3681283836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691015caf0 0x7f69100ad290 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.330+0000 7f6914fff700 1 --2- 172.21.15.112:0/3681283836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69100cd950 0x7f69100c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.330+0000 7f6914fff700 1 -- 172.21.15.112:0/3681283836 >> 172.21.15.112:0/3681283836 conn(0x7f691006a020 msgr2=0x7f69100ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:35.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.330+0000 7f6914fff700 1 -- 172.21.15.112:0/3681283836 shutdown_connections 2023-09-12T16:06:35.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.330+0000 7f6914fff700 1 -- 172.21.15.112:0/3681283836 wait complete. 2023-09-12T16:06:35.343 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi112') 2023-09-12T16:06:35.344 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi112') 2023-09-12T16:06:35.351 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi112') 2023-09-12T16:06:35.352 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi112') 2023-09-12T16:06:35.352 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-09-12T16:06:35.352 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-09-12T16:06:35.353 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-09-12T16:06:35.395 INFO:tasks.ceph.mgr.y:Started 2023-09-12T16:06:35.396 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-12T16:06:35.396 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-12T16:06:35.401 INFO:tasks.ceph.mgr.x:Started 2023-09-12T16:06:35.401 INFO:tasks.ceph:Setting crush tunables to default 2023-09-12T16:06:35.401 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd crush tunables default 2023-09-12T16:06:35.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.597+0000 7f961b3ff700 1 -- 172.21.15.112:0/2999284063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96140cdfb0 msgr2=0x7f96140cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.597+0000 7f961b3ff700 1 --2- 172.21.15.112:0/2999284063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96140cdfb0 0x7f96140cc3b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f961408baa0 tx=0x7f9604009c70 comp rx=0 tx=0).stop 2023-09-12T16:06:35.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.597+0000 7f961b3ff700 1 -- 172.21.15.112:0/2999284063 shutdown_connections 2023-09-12T16:06:35.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.597+0000 7f961b3ff700 1 --2- 172.21.15.112:0/2999284063 >> v2:172.21.15.144:3300/0 conn(0x7f96140d0590 0x7f96140cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.597+0000 7f961b3ff700 1 --2- 172.21.15.112:0/2999284063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96140cdfb0 0x7f96140cc3b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.597+0000 7f961b3ff700 1 -- 172.21.15.112:0/2999284063 >> 172.21.15.112:0/2999284063 conn(0x7f96140d1930 msgr2=0x7f96140d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:35.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.598+0000 7f961b3ff700 1 -- 172.21.15.112:0/2999284063 shutdown_connections 2023-09-12T16:06:35.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.598+0000 7f961b3ff700 1 -- 172.21.15.112:0/2999284063 wait complete. 2023-09-12T16:06:35.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.599+0000 7f961b3ff700 1 Processor -- start 2023-09-12T16:06:35.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.599+0000 7f961b3ff700 1 -- start start 2023-09-12T16:06:35.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.600+0000 7f961b3ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96140cdfb0 0x7f96140c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.600+0000 7f961b3ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96140d0590 0x7f96140c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.600+0000 7f961b3ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f961415f480 0x7f9614150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:35.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.600+0000 7f961b3ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96141506d0 con 0x7f961415f480 2023-09-12T16:06:35.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.600+0000 7f961b3ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96140cb820 con 0x7f96140cdfb0 2023-09-12T16:06:35.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.600+0000 7f961b3ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96140ca780 con 0x7f96140d0590 2023-09-12T16:06:35.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.601+0000 7f961999c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f961415f480 0x7f9614150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:35.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.601+0000 7f961999c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f961415f480 0x7f9614150f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55406/0 (socket says 172.21.15.112:55406) 2023-09-12T16:06:35.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.601+0000 7f961919b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96140cdfb0 0x7f96140c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:35.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.601+0000 7f961999c700 1 -- 172.21.15.112:0/1048629337 learned_addr learned my addr 172.21.15.112:0/1048629337 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:35.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.601+0000 7f961899a700 1 --2- 172.21.15.112:0/1048629337 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96140d0590 0x7f96140c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:35.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.601+0000 7f961999c700 1 -- 172.21.15.112:0/1048629337 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96140d0590 msgr2=0x7f96140c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.601+0000 7f961999c700 1 --2- 172.21.15.112:0/1048629337 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96140d0590 0x7f96140c7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.601+0000 7f961999c700 1 -- 172.21.15.112:0/1048629337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96140cdfb0 msgr2=0x7f96140c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.601+0000 7f961999c700 1 --2- 172.21.15.112:0/1048629337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96140cdfb0 0x7f96140c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.601+0000 7f961999c700 1 -- 172.21.15.112:0/1048629337 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96040095f0 con 0x7f961415f480 2023-09-12T16:06:35.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.601+0000 7f961999c700 1 --2- 172.21.15.112:0/1048629337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f961415f480 0x7f9614150f80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f960c00ef90 tx=0x7f960c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:35.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.601+0000 7f9609ffb700 1 -- 172.21.15.112:0/1048629337 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c018070 con 0x7f961415f480 2023-09-12T16:06:35.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.601+0000 7f9609ffb700 1 -- 172.21.15.112:0/1048629337 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f960c00f040 con 0x7f961415f480 2023-09-12T16:06:35.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.601+0000 7f9609ffb700 1 -- 172.21.15.112:0/1048629337 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c009e70 con 0x7f961415f480 2023-09-12T16:06:35.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.602+0000 7f961b3ff700 1 -- 172.21.15.112:0/1048629337 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96140caa60 con 0x7f961415f480 2023-09-12T16:06:35.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.602+0000 7f961b3ff700 1 -- 172.21.15.112:0/1048629337 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96140cb020 con 0x7f961415f480 2023-09-12T16:06:35.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.602+0000 7f9609ffb700 1 -- 172.21.15.112:0/1048629337 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f960c003a00 con 0x7f961415f480 2023-09-12T16:06:35.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.602+0000 7f9609ffb700 1 -- 172.21.15.112:0/1048629337 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f960c004600 con 0x7f961415f480 2023-09-12T16:06:35.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.603+0000 7f961b3ff700 1 -- 172.21.15.112:0/1048629337 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961404e300 con 0x7f961415f480 2023-09-12T16:06:35.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.605+0000 7f9609ffb700 1 -- 172.21.15.112:0/1048629337 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f960c0047c0 con 0x7f961415f480 2023-09-12T16:06:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.683+0000 7f961b3ff700 1 -- 172.21.15.112:0/1048629337 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f96140b4300 con 0x7f961415f480 2023-09-12T16:06:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.685+0000 7f9609ffb700 1 -- 172.21.15.112:0/1048629337 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f960c00c9a0 con 0x7f961415f480 2023-09-12T16:06:35.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.686+0000 7f961b3ff700 1 -- 172.21.15.112:0/1048629337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f961415f480 msgr2=0x7f9614150f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:35.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.686+0000 7f961b3ff700 1 --2- 172.21.15.112:0/1048629337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f961415f480 0x7f9614150f80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f960c00ef90 tx=0x7f960c00c3a0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.686+0000 7f961b3ff700 1 -- 172.21.15.112:0/1048629337 shutdown_connections 2023-09-12T16:06:35.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.686+0000 7f961b3ff700 1 --2- 172.21.15.112:0/1048629337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f961415f480 0x7f9614150f80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.686+0000 7f961b3ff700 1 --2- 172.21.15.112:0/1048629337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96140cdfb0 0x7f96140c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.686+0000 7f961b3ff700 1 --2- 172.21.15.112:0/1048629337 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96140d0590 0x7f96140c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:35.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.686+0000 7f961b3ff700 1 -- 172.21.15.112:0/1048629337 >> 172.21.15.112:0/1048629337 conn(0x7f96140d1930 msgr2=0x7f9614153d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:35.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.686+0000 7f961b3ff700 1 -- 172.21.15.112:0/1048629337 shutdown_connections 2023-09-12T16:06:35.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:35.686+0000 7f961b3ff700 1 -- 172.21.15.112:0/1048629337 wait complete. 2023-09-12T16:06:35.688 INFO:teuthology.orchestra.run.smithi112.stderr:adjusted tunables profile to default 2023-09-12T16:06:35.694 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:35.693+0000 7fa71ef29240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-12T16:06:35.704 INFO:tasks.ceph:check_enable_crimson: False 2023-09-12T16:06:35.704 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-09-12T16:06:35.705 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:06:35.705 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-09-12T16:06:35.714 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:35.714+0000 7f3843b0f240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-12T16:06:35.774 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:06:35.775 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-09-12T16:06:35.891 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:35.890+0000 7fa71ef29240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-12T16:06:35.916 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:06:35.917 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-09-12T16:06:35.931 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:35.931+0000 7f3843b0f240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-12T16:06:35.987 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:06:35.987 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-09-12T16:06:36.097 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:06:36.097 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-09-12T16:06:36.166 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:06:36.167 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-09-12T16:06:36.274 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:06:36.275 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-09-12T16:06:36.350 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:36.349+0000 7fa71ef29240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-12T16:06:36.384 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:06:36.385 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-09-12T16:06:36.399 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:36.399+0000 7f3843b0f240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-12T16:06:36.493 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 26d92e63-11c1-4be7-84c0-b5973546558a 0 2023-09-12T16:06:36.731 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.730+0000 7f35f2bff700 1 -- 172.21.15.144:0/2529528074 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35ec06a020 msgr2=0x7f35ec06a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:36.731 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.730+0000 7f35f2bff700 1 --2- 172.21.15.144:0/2529528074 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35ec06a020 0x7f35ec06a4b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009f60 tx=0x7f35e4009f90 comp rx=0 tx=0).stop 2023-09-12T16:06:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.730+0000 7f35f2bff700 1 -- 172.21.15.144:0/2529528074 shutdown_connections 2023-09-12T16:06:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.730+0000 7f35f2bff700 1 --2- 172.21.15.144:0/2529528074 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35ec06a020 0x7f35ec06a4b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.730+0000 7f35f2bff700 1 --2- 172.21.15.144:0/2529528074 >> v2:172.21.15.112:3300/0 conn(0x7f35ec0b0c20 0x7f35ec0ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.730+0000 7f35f2bff700 1 -- 172.21.15.144:0/2529528074 >> 172.21.15.144:0/2529528074 conn(0x7f35ec06b760 msgr2=0x7f35ec06d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.730+0000 7f35f2bff700 1 -- 172.21.15.144:0/2529528074 shutdown_connections 2023-09-12T16:06:36.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.730+0000 7f35f2bff700 1 -- 172.21.15.144:0/2529528074 wait complete. 2023-09-12T16:06:36.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.732+0000 7f35f2bff700 1 Processor -- start 2023-09-12T16:06:36.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.732+0000 7f35f2bff700 1 -- start start 2023-09-12T16:06:36.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.733+0000 7f35f2bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35ec06a020 0x7f35ec0c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:36.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.733+0000 7f35f2bff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35ec0b0c20 0x7f35ec15d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:36.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.733+0000 7f35f2bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35ec15be30 0x7f35ec14f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:36.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.733+0000 7f35f2bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec15ee40 con 0x7f35ec06a020 2023-09-12T16:06:36.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.733+0000 7f35f2bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec15e230 con 0x7f35ec15be30 2023-09-12T16:06:36.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.733+0000 7f35f2bff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec15e510 con 0x7f35ec0b0c20 2023-09-12T16:06:36.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.733+0000 7f35ebfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35ec0b0c20 0x7f35ec15d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:36.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.733+0000 7f35f119c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35ec15be30 0x7f35ec14f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:36.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.733+0000 7f35f119c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35ec15be30 0x7f35ec14f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59036/0 (socket says 172.21.15.144:59036) 2023-09-12T16:06:36.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.733+0000 7f35f119c700 1 -- 172.21.15.144:0/3747147938 learned_addr learned my addr 172.21.15.144:0/3747147938 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-09-12T16:06:36.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.734+0000 7f35f099b700 1 --2- 172.21.15.144:0/3747147938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35ec06a020 0x7f35ec0c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:36.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.734+0000 7f35f119c700 1 -- 172.21.15.144:0/3747147938 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35ec0b0c20 msgr2=0x7f35ec15d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:36.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.734+0000 7f35f119c700 1 --2- 172.21.15.144:0/3747147938 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35ec0b0c20 0x7f35ec15d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:36.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.734+0000 7f35f119c700 1 -- 172.21.15.144:0/3747147938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35ec06a020 msgr2=0x7f35ec0c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:36.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.734+0000 7f35f119c700 1 --2- 172.21.15.144:0/3747147938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35ec06a020 0x7f35ec0c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:36.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.734+0000 7f35f119c700 1 -- 172.21.15.144:0/3747147938 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e4009c40 con 0x7f35ec15be30 2023-09-12T16:06:36.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.734+0000 7f35ebfff700 1 --2- 172.21.15.144:0/3747147938 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35ec0b0c20 0x7f35ec15d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-12T16:06:36.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.734+0000 7f35f119c700 1 --2- 172.21.15.144:0/3747147938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35ec15be30 0x7f35ec14f970 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f35e400b610 tx=0x7f35e4007f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:36.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.734+0000 7f35e97fa700 1 -- 172.21.15.144:0/3747147938 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e400e040 con 0x7f35ec15be30 2023-09-12T16:06:36.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.734+0000 7f35e97fa700 1 -- 172.21.15.144:0/3747147938 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f35e4003c00 con 0x7f35ec15be30 2023-09-12T16:06:36.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.734+0000 7f35e97fa700 1 -- 172.21.15.144:0/3747147938 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e4004030 con 0x7f35ec15be30 2023-09-12T16:06:36.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.734+0000 7f35f2bff700 1 -- 172.21.15.144:0/3747147938 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ec15e7f0 con 0x7f35ec15be30 2023-09-12T16:06:36.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.734+0000 7f35f2bff700 1 -- 172.21.15.144:0/3747147938 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ec15f2d0 con 0x7f35ec15be30 2023-09-12T16:06:36.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.735+0000 7f35e97fa700 1 -- 172.21.15.144:0/3747147938 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f35e40044b0 con 0x7f35ec15be30 2023-09-12T16:06:36.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.735+0000 7f35e97fa700 1 -- 172.21.15.144:0/3747147938 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f35e401dd50 con 0x7f35ec15be30 2023-09-12T16:06:36.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.735+0000 7f35f2bff700 1 -- 172.21.15.144:0/3747147938 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ec15efb0 con 0x7f35ec15be30 2023-09-12T16:06:36.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.738+0000 7f35e97fa700 1 -- 172.21.15.144:0/3747147938 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f35e401d480 con 0x7f35ec15be30 2023-09-12T16:06:36.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.823+0000 7f35f2bff700 1 -- 172.21.15.144:0/3747147938 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd new", "uuid": "26d92e63-11c1-4be7-84c0-b5973546558a", "id": 0} v 0) v1 -- 0x7f35ec0b45b0 con 0x7f35ec15be30 2023-09-12T16:06:36.827 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.827+0000 7f35e97fa700 1 -- 172.21.15.144:0/3747147938 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "26d92e63-11c1-4be7-84c0-b5973546558a", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f35e4026450 con 0x7f35ec15be30 2023-09-12T16:06:36.828 INFO:teuthology.orchestra.run.smithi144.stdout:0 2023-09-12T16:06:36.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.828+0000 7f35f2bff700 1 -- 172.21.15.144:0/3747147938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35ec15be30 msgr2=0x7f35ec14f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:36.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.828+0000 7f35f2bff700 1 --2- 172.21.15.144:0/3747147938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35ec15be30 0x7f35ec14f970 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f35e400b610 tx=0x7f35e4007f80 comp rx=0 tx=0).stop 2023-09-12T16:06:36.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.828+0000 7f35f2bff700 1 -- 172.21.15.144:0/3747147938 shutdown_connections 2023-09-12T16:06:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.828+0000 7f35f2bff700 1 --2- 172.21.15.144:0/3747147938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35ec15be30 0x7f35ec14f970 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.828+0000 7f35f2bff700 1 --2- 172.21.15.144:0/3747147938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35ec06a020 0x7f35ec0c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.828+0000 7f35f2bff700 1 --2- 172.21.15.144:0/3747147938 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35ec0b0c20 0x7f35ec15d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.829+0000 7f35f2bff700 1 -- 172.21.15.144:0/3747147938 >> 172.21.15.144:0/3747147938 conn(0x7f35ec06b760 msgr2=0x7f35ec0af820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:36.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.829+0000 7f35f2bff700 1 -- 172.21.15.144:0/3747147938 shutdown_connections 2023-09-12T16:06:36.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:36.829+0000 7f35f2bff700 1 -- 172.21.15.144:0/3747147938 wait complete. 2023-09-12T16:06:36.846 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 24385b53-0ebf-442a-9a0b-87541ddb2f73 1 2023-09-12T16:06:36.977 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:36.976+0000 7fa71ef29240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-12T16:06:36.983 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:36.983+0000 7f3843b0f240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-12T16:06:37.043 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.042+0000 7f47517ff700 1 -- 172.21.15.144:0/2525816985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f474c0cc780 msgr2=0x7f474c166a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:37.043 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.042+0000 7f47517ff700 1 --2- 172.21.15.144:0/2525816985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f474c0cc780 0x7f474c166a70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4744009f60 tx=0x7f4744009f90 comp rx=0 tx=0).stop 2023-09-12T16:06:37.043 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.042+0000 7f47517ff700 1 -- 172.21.15.144:0/2525816985 shutdown_connections 2023-09-12T16:06:37.043 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.042+0000 7f47517ff700 1 --2- 172.21.15.144:0/2525816985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f474c0cc780 0x7f474c166a70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:37.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.042+0000 7f47517ff700 1 -- 172.21.15.144:0/2525816985 >> 172.21.15.144:0/2525816985 conn(0x7f474c0cf6d0 msgr2=0x7f474c0cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:37.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.042+0000 7f47517ff700 1 -- 172.21.15.144:0/2525816985 shutdown_connections 2023-09-12T16:06:37.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.042+0000 7f47517ff700 1 -- 172.21.15.144:0/2525816985 wait complete. 2023-09-12T16:06:37.046 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.044+0000 7f47517ff700 1 Processor -- start 2023-09-12T16:06:37.046 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.044+0000 7f47517ff700 1 -- start start 2023-09-12T16:06:37.046 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.045+0000 7f47517ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f474c0b2520 0x7f474c0c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:37.047 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.045+0000 7f47517ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f474c0b51f0 0x7f474c1539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:37.047 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.045+0000 7f47517ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f474c0cc780 0x7f474c151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:37.047 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.045+0000 7f47517ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474c151900 con 0x7f474c0cc780 2023-09-12T16:06:37.047 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.045+0000 7f47517ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474c159d50 con 0x7f474c0b2520 2023-09-12T16:06:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.045+0000 7f47517ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474c159140 con 0x7f474c0b51f0 2023-09-12T16:06:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.045+0000 7f474affd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f474c0b2520 0x7f474c0c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.045+0000 7f474a7fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f474c0b51f0 0x7f474c1539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.045+0000 7f474affd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f474c0b2520 0x7f474c0c9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59060/0 (socket says 172.21.15.144:59060) 2023-09-12T16:06:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.045+0000 7f474affd700 1 -- 172.21.15.144:0/2530031879 learned_addr learned my addr 172.21.15.144:0/2530031879 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-09-12T16:06:37.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.045+0000 7f474b7fe700 1 --2- 172.21.15.144:0/2530031879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f474c0cc780 0x7f474c151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:37.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.045+0000 7f474affd700 1 -- 172.21.15.144:0/2530031879 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f474c0b51f0 msgr2=0x7f474c1539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:37.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.045+0000 7f474affd700 1 --2- 172.21.15.144:0/2530031879 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f474c0b51f0 0x7f474c1539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:37.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.045+0000 7f474affd700 1 -- 172.21.15.144:0/2530031879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f474c0cc780 msgr2=0x7f474c151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:37.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.045+0000 7f474affd700 1 --2- 172.21.15.144:0/2530031879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f474c0cc780 0x7f474c151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:37.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.045+0000 7f474affd700 1 -- 172.21.15.144:0/2530031879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4744009c40 con 0x7f474c0b2520 2023-09-12T16:06:37.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.046+0000 7f474a7fc700 1 --2- 172.21.15.144:0/2530031879 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f474c0b51f0 0x7f474c1539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-12T16:06:37.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.046+0000 7f474affd700 1 --2- 172.21.15.144:0/2530031879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f474c0b2520 0x7f474c0c9710 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f473c00c4d0 tx=0x7f473c00c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.046+0000 7f47337fe700 1 -- 172.21.15.144:0/2530031879 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c011790 con 0x7f474c0b2520 2023-09-12T16:06:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.046+0000 7f47337fe700 1 -- 172.21.15.144:0/2530031879 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f473c0119e0 con 0x7f474c0b2520 2023-09-12T16:06:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.046+0000 7f47517ff700 1 -- 172.21.15.144:0/2530031879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f474c159420 con 0x7f474c0b2520 2023-09-12T16:06:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.046+0000 7f47337fe700 1 -- 172.21.15.144:0/2530031879 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c011df0 con 0x7f474c0b2520 2023-09-12T16:06:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.046+0000 7f47517ff700 1 -- 172.21.15.144:0/2530031879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f474c1599e0 con 0x7f474c0b2520 2023-09-12T16:06:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.047+0000 7f47337fe700 1 -- 172.21.15.144:0/2530031879 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f473c01c760 con 0x7f474c0b2520 2023-09-12T16:06:37.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.047+0000 7f47337fe700 1 -- 172.21.15.144:0/2530031879 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f473c012720 con 0x7f474c0b2520 2023-09-12T16:06:37.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.047+0000 7f47517ff700 1 -- 172.21.15.144:0/2530031879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f474c066ec0 con 0x7f474c0b2520 2023-09-12T16:06:37.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.050+0000 7f47337fe700 1 -- 172.21.15.144:0/2530031879 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f473c01cba0 con 0x7f474c0b2520 2023-09-12T16:06:37.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.136+0000 7f47517ff700 1 -- 172.21.15.144:0/2530031879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd new", "uuid": "24385b53-0ebf-442a-9a0b-87541ddb2f73", "id": 1} v 0) v1 -- 0x7f474c159ba0 con 0x7f474c0b2520 2023-09-12T16:06:37.140 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.140+0000 7f47337fe700 1 -- 172.21.15.144:0/2530031879 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "24385b53-0ebf-442a-9a0b-87541ddb2f73", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f473c01cd40 con 0x7f474c0b2520 2023-09-12T16:06:37.141 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-09-12T16:06:37.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.141+0000 7f47517ff700 1 -- 172.21.15.144:0/2530031879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f474c0b2520 msgr2=0x7f474c0c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:37.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.141+0000 7f47517ff700 1 --2- 172.21.15.144:0/2530031879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f474c0b2520 0x7f474c0c9710 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f473c00c4d0 tx=0x7f473c00c7e0 comp rx=0 tx=0).stop 2023-09-12T16:06:37.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.141+0000 7f47517ff700 1 -- 172.21.15.144:0/2530031879 shutdown_connections 2023-09-12T16:06:37.143 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.141+0000 7f47517ff700 1 --2- 172.21.15.144:0/2530031879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f474c0cc780 0x7f474c151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:37.143 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.141+0000 7f47517ff700 1 --2- 172.21.15.144:0/2530031879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f474c0b2520 0x7f474c0c9710 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:37.143 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.141+0000 7f47517ff700 1 --2- 172.21.15.144:0/2530031879 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f474c0b51f0 0x7f474c1539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:37.143 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.141+0000 7f47517ff700 1 -- 172.21.15.144:0/2530031879 >> 172.21.15.144:0/2530031879 conn(0x7f474c0cf6d0 msgr2=0x7f474c0cc070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:37.143 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.141+0000 7f47517ff700 1 -- 172.21.15.144:0/2530031879 shutdown_connections 2023-09-12T16:06:37.144 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.141+0000 7f47517ff700 1 -- 172.21.15.144:0/2530031879 wait complete. 2023-09-12T16:06:37.160 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 1fd88ecf-11ea-4529-8850-b27f84ae1b99 2 2023-09-12T16:06:37.219 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:37.219+0000 7f3843b0f240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-12T16:06:37.226 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:37.226+0000 7fa71ef29240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-12T16:06:37.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.356+0000 7fab365ff700 1 -- 172.21.15.144:0/1827468704 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab301578d0 msgr2=0x7fab300c9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:37.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.356+0000 7fab365ff700 1 --2- 172.21.15.144:0/1827468704 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab301578d0 0x7fab300c9be0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fab20005fd0 tx=0x7fab20009c70 comp rx=0 tx=0).stop 2023-09-12T16:06:37.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.356+0000 7fab365ff700 1 -- 172.21.15.144:0/1827468704 shutdown_connections 2023-09-12T16:06:37.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.356+0000 7fab365ff700 1 --2- 172.21.15.144:0/1827468704 >> v2:172.21.15.144:3300/0 conn(0x7fab300c8c00 0x7fab300cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:37.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.356+0000 7fab365ff700 1 --2- 172.21.15.144:0/1827468704 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab301578d0 0x7fab300c9be0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:37.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.356+0000 7fab365ff700 1 -- 172.21.15.144:0/1827468704 >> 172.21.15.144:0/1827468704 conn(0x7fab3006a650 msgr2=0x7fab3006c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:37.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.356+0000 7fab365ff700 1 -- 172.21.15.144:0/1827468704 shutdown_connections 2023-09-12T16:06:37.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.357+0000 7fab365ff700 1 -- 172.21.15.144:0/1827468704 wait complete. 2023-09-12T16:06:37.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.358+0000 7fab365ff700 1 Processor -- start 2023-09-12T16:06:37.362 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.358+0000 7fab365ff700 1 -- start start 2023-09-12T16:06:37.362 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.359+0000 7fab365ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab300c8c00 0x7fab30159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:37.362 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.359+0000 7fab365ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab300ca120 0x7fab3015ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:37.363 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.359+0000 7fab365ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab301578d0 0x7fab30155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:37.363 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.359+0000 7fab365ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab301558d0 con 0x7fab300ca120 2023-09-12T16:06:37.363 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.359+0000 7fab365ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab301499c0 con 0x7fab300c8c00 2023-09-12T16:06:37.363 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.359+0000 7fab365ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3015a0a0 con 0x7fab301578d0 2023-09-12T16:06:37.364 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.359+0000 7fab2ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab300c8c00 0x7fab30159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:37.364 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.360+0000 7fab2ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab300c8c00 0x7fab30159ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59084/0 (socket says 172.21.15.144:59084) 2023-09-12T16:06:37.364 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.360+0000 7fab2ffff700 1 -- 172.21.15.144:0/711260731 learned_addr learned my addr 172.21.15.144:0/711260731 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-09-12T16:06:37.364 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.360+0000 7fab34b9c700 1 --2- 172.21.15.144:0/711260731 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab301578d0 0x7fab30155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:37.364 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.360+0000 7fab2f7fe700 1 --2- 172.21.15.144:0/711260731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab300ca120 0x7fab3015ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:37.365 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.360+0000 7fab2ffff700 1 -- 172.21.15.144:0/711260731 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab301578d0 msgr2=0x7fab30155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:37.365 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.360+0000 7fab2ffff700 1 --2- 172.21.15.144:0/711260731 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab301578d0 0x7fab30155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:37.365 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.360+0000 7fab2ffff700 1 -- 172.21.15.144:0/711260731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab300ca120 msgr2=0x7fab3015ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:37.365 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.360+0000 7fab2ffff700 1 --2- 172.21.15.144:0/711260731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab300ca120 0x7fab3015ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:37.365 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.360+0000 7fab2ffff700 1 -- 172.21.15.144:0/711260731 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab200095f0 con 0x7fab300c8c00 2023-09-12T16:06:37.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.360+0000 7fab2ffff700 1 --2- 172.21.15.144:0/711260731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab300c8c00 0x7fab30159ac0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fab200098e0 tx=0x7fab20003d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:37.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.360+0000 7fab2cff9700 1 -- 172.21.15.144:0/711260731 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2001d070 con 0x7fab300c8c00 2023-09-12T16:06:37.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.361+0000 7fab2cff9700 1 -- 172.21.15.144:0/711260731 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fab20004830 con 0x7fab300c8c00 2023-09-12T16:06:37.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.361+0000 7fab365ff700 1 -- 172.21.15.144:0/711260731 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab301548b0 con 0x7fab300c8c00 2023-09-12T16:06:37.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.361+0000 7fab2cff9700 1 -- 172.21.15.144:0/711260731 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab20004c40 con 0x7fab300c8c00 2023-09-12T16:06:37.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.361+0000 7fab365ff700 1 -- 172.21.15.144:0/711260731 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab30154e70 con 0x7fab300c8c00 2023-09-12T16:06:37.368 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.361+0000 7fab2cff9700 1 -- 172.21.15.144:0/711260731 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fab2000b820 con 0x7fab300c8c00 2023-09-12T16:06:37.369 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.361+0000 7fab2cff9700 1 -- 172.21.15.144:0/711260731 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fab20005020 con 0x7fab300c8c00 2023-09-12T16:06:37.369 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.362+0000 7fab365ff700 1 -- 172.21.15.144:0/711260731 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab30154710 con 0x7fab300c8c00 2023-09-12T16:06:37.369 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.364+0000 7fab2cff9700 1 -- 172.21.15.144:0/711260731 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fab30154710 con 0x7fab300c8c00 2023-09-12T16:06:37.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.467+0000 7fab365ff700 1 -- 172.21.15.144:0/711260731 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1fd88ecf-11ea-4529-8850-b27f84ae1b99", "id": 2} v 0) v1 -- 0x7fab3004e300 con 0x7fab300c8c00 2023-09-12T16:06:37.476 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.476+0000 7fab2cff9700 1 -- 172.21.15.144:0/711260731 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1fd88ecf-11ea-4529-8850-b27f84ae1b99", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fab2002f060 con 0x7fab300c8c00 2023-09-12T16:06:37.476 INFO:teuthology.orchestra.run.smithi144.stdout:2 2023-09-12T16:06:37.478 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.477+0000 7fab365ff700 1 -- 172.21.15.144:0/711260731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab300c8c00 msgr2=0x7fab30159ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:37.478 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.477+0000 7fab365ff700 1 --2- 172.21.15.144:0/711260731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab300c8c00 0x7fab30159ac0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fab200098e0 tx=0x7fab20003d00 comp rx=0 tx=0).stop 2023-09-12T16:06:37.478 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.477+0000 7fab365ff700 1 -- 172.21.15.144:0/711260731 shutdown_connections 2023-09-12T16:06:37.478 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.477+0000 7fab365ff700 1 --2- 172.21.15.144:0/711260731 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab301578d0 0x7fab30155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:37.478 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.477+0000 7fab365ff700 1 --2- 172.21.15.144:0/711260731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab300c8c00 0x7fab30159ac0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.477+0000 7fab365ff700 1 --2- 172.21.15.144:0/711260731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab300ca120 0x7fab3015ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.477+0000 7fab365ff700 1 -- 172.21.15.144:0/711260731 >> 172.21.15.144:0/711260731 conn(0x7fab3006a650 msgr2=0x7fab30153a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.477+0000 7fab365ff700 1 -- 172.21.15.144:0/711260731 shutdown_connections 2023-09-12T16:06:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.477+0000 7fab365ff700 1 -- 172.21.15.144:0/711260731 wait complete. 2023-09-12T16:06:37.495 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 4cf53ec1-9e6a-4054-9619-68a7d74fbabc 3 2023-09-12T16:06:37.661 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:37.659+0000 7f3843b0f240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-12T16:06:37.699 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.698+0000 7f5bf7fff700 1 -- 172.21.15.144:0/3221093067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf00d0410 msgr2=0x7f5bf00ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:37.699 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.698+0000 7f5bf7fff700 1 --2- 172.21.15.144:0/3221093067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf00d0410 0x7f5bf00ce090 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5bf00cbe10 tx=0x7f5be0009c70 comp rx=0 tx=0).stop 2023-09-12T16:06:37.699 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.698+0000 7f5bf7fff700 1 -- 172.21.15.144:0/3221093067 shutdown_connections 2023-09-12T16:06:37.699 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.698+0000 7f5bf7fff700 1 --2- 172.21.15.144:0/3221093067 >> v2:172.21.15.112:3300/0 conn(0x7f5bf00ce5d0 0x7f5bf00b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:37.700 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.698+0000 7f5bf7fff700 1 --2- 172.21.15.144:0/3221093067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf00d0410 0x7f5bf00ce090 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:37.700 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.698+0000 7f5bf7fff700 1 -- 172.21.15.144:0/3221093067 >> 172.21.15.144:0/3221093067 conn(0x7f5bf009abe0 msgr2=0x7f5bf00d1830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:37.700 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.698+0000 7f5bf7fff700 1 -- 172.21.15.144:0/3221093067 shutdown_connections 2023-09-12T16:06:37.700 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.698+0000 7f5bf7fff700 1 -- 172.21.15.144:0/3221093067 wait complete. 2023-09-12T16:06:37.703 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.700+0000 7f5bf7fff700 1 Processor -- start 2023-09-12T16:06:37.703 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.700+0000 7f5bf7fff700 1 -- start start 2023-09-12T16:06:37.703 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.701+0000 7f5bf7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bf00ce5d0 0x7f5bf015c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:37.703 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.701+0000 7f5bf7fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5bf00d0410 0x7f5bf006c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:37.703 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.701+0000 7f5bf7fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf015b920 0x7f5bf0149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:37.704 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.701+0000 7f5bf7fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf006cbb0 con 0x7f5bf00ce5d0 2023-09-12T16:06:37.704 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.701+0000 7f5bf7fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf015c610 con 0x7f5bf015b920 2023-09-12T16:06:37.704 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.701+0000 7f5bf7fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf015c8f0 con 0x7f5bf00d0410 2023-09-12T16:06:37.704 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.701+0000 7f5bf659c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf015b920 0x7f5bf0149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:37.705 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.701+0000 7f5bf659c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf015b920 0x7f5bf0149be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59104/0 (socket says 172.21.15.144:59104) 2023-09-12T16:06:37.705 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.701+0000 7f5bf659c700 1 -- 172.21.15.144:0/3577450431 learned_addr learned my addr 172.21.15.144:0/3577450431 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-09-12T16:06:37.705 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.701+0000 7f5bf5d9b700 1 --2- 172.21.15.144:0/3577450431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bf00ce5d0 0x7f5bf015c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:37.705 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.701+0000 7f5bf559a700 1 --2- 172.21.15.144:0/3577450431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5bf00d0410 0x7f5bf006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:37.705 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.701+0000 7f5bf659c700 1 -- 172.21.15.144:0/3577450431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5bf00d0410 msgr2=0x7f5bf006c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:37.706 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.701+0000 7f5bf659c700 1 --2- 172.21.15.144:0/3577450431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5bf00d0410 0x7f5bf006c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:37.706 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.701+0000 7f5bf659c700 1 -- 172.21.15.144:0/3577450431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bf00ce5d0 msgr2=0x7f5bf015c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:37.706 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.701+0000 7f5bf659c700 1 --2- 172.21.15.144:0/3577450431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bf00ce5d0 0x7f5bf015c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:37.706 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.701+0000 7f5bf659c700 1 -- 172.21.15.144:0/3577450431 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be00095f0 con 0x7f5bf015b920 2023-09-12T16:06:37.706 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.702+0000 7f5bf659c700 1 --2- 172.21.15.144:0/3577450431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf015b920 0x7f5bf0149be0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5be800ef30 tx=0x7f5be800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:37.707 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.702+0000 7f5be67fc700 1 -- 172.21.15.144:0/3577450431 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8018070 con 0x7f5bf015b920 2023-09-12T16:06:37.707 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.702+0000 7f5be67fc700 1 -- 172.21.15.144:0/3577450431 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5be800f040 con 0x7f5bf015b920 2023-09-12T16:06:37.707 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.702+0000 7f5bf7fff700 1 -- 172.21.15.144:0/3577450431 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf015cbd0 con 0x7f5bf015b920 2023-09-12T16:06:37.707 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.702+0000 7f5be67fc700 1 -- 172.21.15.144:0/3577450431 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8004bb0 con 0x7f5bf015b920 2023-09-12T16:06:37.707 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.702+0000 7f5bf7fff700 1 -- 172.21.15.144:0/3577450431 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf015d190 con 0x7f5bf015b920 2023-09-12T16:06:37.708 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.702+0000 7f5be67fc700 1 -- 172.21.15.144:0/3577450431 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5be8003d00 con 0x7f5bf015b920 2023-09-12T16:06:37.708 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.702+0000 7f5be67fc700 1 -- 172.21.15.144:0/3577450431 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f5be8004d10 con 0x7f5bf015b920 2023-09-12T16:06:37.708 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.703+0000 7f5bf7fff700 1 -- 172.21.15.144:0/3577450431 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf0072d90 con 0x7f5bf015b920 2023-09-12T16:06:37.709 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.705+0000 7f5be67fc700 1 -- 172.21.15.144:0/3577450431 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f5be800c9f0 con 0x7f5bf015b920 2023-09-12T16:06:37.723 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:37.723+0000 7fa71ef29240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-12T16:06:37.790 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.789+0000 7f5bf7fff700 1 -- 172.21.15.144:0/3577450431 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4cf53ec1-9e6a-4054-9619-68a7d74fbabc", "id": 3} v 0) v1 -- 0x7f5bf00d2740 con 0x7f5bf015b920 2023-09-12T16:06:37.801 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.801+0000 7f5be67fc700 1 -- 172.21.15.144:0/3577450431 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4cf53ec1-9e6a-4054-9619-68a7d74fbabc", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5be802b0b0 con 0x7f5bf015b920 2023-09-12T16:06:37.801 INFO:teuthology.orchestra.run.smithi144.stdout:3 2023-09-12T16:06:37.802 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.802+0000 7f5bf7fff700 1 -- 172.21.15.144:0/3577450431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf015b920 msgr2=0x7f5bf0149be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:37.802 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.802+0000 7f5bf7fff700 1 --2- 172.21.15.144:0/3577450431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf015b920 0x7f5bf0149be0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5be800ef30 tx=0x7f5be800c3a0 comp rx=0 tx=0).stop 2023-09-12T16:06:37.803 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.802+0000 7f5bf7fff700 1 -- 172.21.15.144:0/3577450431 shutdown_connections 2023-09-12T16:06:37.803 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.802+0000 7f5bf7fff700 1 --2- 172.21.15.144:0/3577450431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf015b920 0x7f5bf0149be0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:37.803 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.802+0000 7f5bf7fff700 1 --2- 172.21.15.144:0/3577450431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bf00ce5d0 0x7f5bf015c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:37.804 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.802+0000 7f5bf7fff700 1 --2- 172.21.15.144:0/3577450431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5bf00d0410 0x7f5bf006c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:37.804 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.802+0000 7f5bf7fff700 1 -- 172.21.15.144:0/3577450431 >> 172.21.15.144:0/3577450431 conn(0x7f5bf009abe0 msgr2=0x7f5bf00b5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:37.804 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.802+0000 7f5bf7fff700 1 -- 172.21.15.144:0/3577450431 shutdown_connections 2023-09-12T16:06:37.804 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:37.802+0000 7f5bf7fff700 1 -- 172.21.15.144:0/3577450431 wait complete. 2023-09-12T16:06:37.819 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new b77bd503-67d8-4f01-ba08-66933e090370 4 2023-09-12T16:06:38.015 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.014+0000 7fd07cfff700 1 -- 172.21.15.144:0/565707608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0780c9730 msgr2=0x7fd0780cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:38.016 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.014+0000 7fd07cfff700 1 --2- 172.21.15.144:0/565707608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0780c9730 0x7fd0780cb080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd06c005fd0 tx=0x7fd06c009c70 comp rx=0 tx=0).stop 2023-09-12T16:06:38.016 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.014+0000 7fd07cfff700 1 -- 172.21.15.144:0/565707608 shutdown_connections 2023-09-12T16:06:38.016 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.014+0000 7fd07cfff700 1 --2- 172.21.15.144:0/565707608 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd0780cb5c0 0x7fd078158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.014+0000 7fd07cfff700 1 --2- 172.21.15.144:0/565707608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0780c9730 0x7fd0780cb080 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.014+0000 7fd07cfff700 1 -- 172.21.15.144:0/565707608 >> 172.21.15.144:0/565707608 conn(0x7fd07806a650 msgr2=0x7fd07806c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:38.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.014+0000 7fd07cfff700 1 -- 172.21.15.144:0/565707608 shutdown_connections 2023-09-12T16:06:38.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.014+0000 7fd07cfff700 1 -- 172.21.15.144:0/565707608 wait complete. 2023-09-12T16:06:38.020 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.016+0000 7fd07cfff700 1 Processor -- start 2023-09-12T16:06:38.020 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.016+0000 7fd07cfff700 1 -- start start 2023-09-12T16:06:38.020 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.017+0000 7fd07cfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd0780c9730 0x7fd0780c7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:38.021 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.017+0000 7fd07cfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0780c9ec0 0x7fd078145150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:38.021 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.017+0000 7fd07cfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0780cb5c0 0x7fd0780c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:38.021 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.017+0000 7fd07cfff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0781e23e0 con 0x7fd0780c9ec0 2023-09-12T16:06:38.021 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.017+0000 7fd07cfff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0781e3980 con 0x7fd0780cb5c0 2023-09-12T16:06:38.021 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.017+0000 7fd07cfff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd078146060 con 0x7fd0780c9730 2023-09-12T16:06:38.022 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.017+0000 7fd07659c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd0780c9730 0x7fd0780c7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:38.022 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.017+0000 7fd07659c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd0780c9730 0x7fd0780c7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:51738/0 (socket says 172.21.15.144:51738) 2023-09-12T16:06:38.022 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.017+0000 7fd07659c700 1 -- 172.21.15.144:0/1932329226 learned_addr learned my addr 172.21.15.144:0/1932329226 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-09-12T16:06:38.022 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.018+0000 7fd076d9d700 1 --2- 172.21.15.144:0/1932329226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0780cb5c0 0x7fd0780c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:38.023 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.018+0000 7fd075d9b700 1 --2- 172.21.15.144:0/1932329226 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0780c9ec0 0x7fd078145150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:38.023 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.018+0000 7fd07659c700 1 -- 172.21.15.144:0/1932329226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0780cb5c0 msgr2=0x7fd0780c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:38.023 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.018+0000 7fd07659c700 1 --2- 172.21.15.144:0/1932329226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0780cb5c0 0x7fd0780c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.023 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.018+0000 7fd07659c700 1 -- 172.21.15.144:0/1932329226 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0780c9ec0 msgr2=0x7fd078145150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:38.023 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.018+0000 7fd07659c700 1 --2- 172.21.15.144:0/1932329226 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0780c9ec0 0x7fd078145150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.024 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.018+0000 7fd07659c700 1 -- 172.21.15.144:0/1932329226 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c0095f0 con 0x7fd0780c9730 2023-09-12T16:06:38.024 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.018+0000 7fd07659c700 1 --2- 172.21.15.144:0/1932329226 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd0780c9730 0x7fd0780c7770 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd0680011e0 tx=0x7fd06800ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:38.024 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.018+0000 7fd066ffd700 1 -- 172.21.15.144:0/1932329226 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0680054e0 con 0x7fd0780c9730 2023-09-12T16:06:38.024 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.018+0000 7fd066ffd700 1 -- 172.21.15.144:0/1932329226 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd068003680 con 0x7fd0780c9730 2023-09-12T16:06:38.024 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.018+0000 7fd066ffd700 1 -- 172.21.15.144:0/1932329226 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd068003a90 con 0x7fd0780c9730 2023-09-12T16:06:38.025 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.018+0000 7fd07cfff700 1 -- 172.21.15.144:0/1932329226 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0781457c0 con 0x7fd0780c9730 2023-09-12T16:06:38.025 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.019+0000 7fd07cfff700 1 -- 172.21.15.144:0/1932329226 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd078145d80 con 0x7fd0780c9730 2023-09-12T16:06:38.025 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.019+0000 7fd066ffd700 1 -- 172.21.15.144:0/1932329226 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd068012400 con 0x7fd0780c9730 2023-09-12T16:06:38.025 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.019+0000 7fd066ffd700 1 -- 172.21.15.144:0/1932329226 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fd0680126b0 con 0x7fd0780c9730 2023-09-12T16:06:38.025 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.020+0000 7fd07cfff700 1 -- 172.21.15.144:0/1932329226 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd07804e300 con 0x7fd0780c9730 2023-09-12T16:06:38.026 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.024+0000 7fd066ffd700 1 -- 172.21.15.144:0/1932329226 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fd068021060 con 0x7fd0780c9730 2023-09-12T16:06:38.110 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.110+0000 7fd07cfff700 1 -- 172.21.15.144:0/1932329226 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b77bd503-67d8-4f01-ba08-66933e090370", "id": 4} v 0) v1 -- 0x7fd078070130 con 0x7fd0780c9730 2023-09-12T16:06:38.114 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.114+0000 7fd066ffd700 1 -- 172.21.15.144:0/1932329226 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b77bd503-67d8-4f01-ba08-66933e090370", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd068017070 con 0x7fd0780c9730 2023-09-12T16:06:38.114 INFO:teuthology.orchestra.run.smithi144.stdout:4 2023-09-12T16:06:38.115 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.115+0000 7fd07cfff700 1 -- 172.21.15.144:0/1932329226 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd0780c9730 msgr2=0x7fd0780c7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:38.116 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.115+0000 7fd07cfff700 1 --2- 172.21.15.144:0/1932329226 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd0780c9730 0x7fd0780c7770 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd0680011e0 tx=0x7fd06800ca30 comp rx=0 tx=0).stop 2023-09-12T16:06:38.116 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.115+0000 7fd07cfff700 1 -- 172.21.15.144:0/1932329226 shutdown_connections 2023-09-12T16:06:38.116 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.115+0000 7fd07cfff700 1 --2- 172.21.15.144:0/1932329226 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd0780c9730 0x7fd0780c7770 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.116 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.115+0000 7fd07cfff700 1 --2- 172.21.15.144:0/1932329226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0780cb5c0 0x7fd0780c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.116 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.115+0000 7fd07cfff700 1 --2- 172.21.15.144:0/1932329226 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0780c9ec0 0x7fd078145150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.115+0000 7fd07cfff700 1 -- 172.21.15.144:0/1932329226 >> 172.21.15.144:0/1932329226 conn(0x7fd07806a650 msgr2=0x7fd07815b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:38.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.115+0000 7fd07cfff700 1 -- 172.21.15.144:0/1932329226 shutdown_connections 2023-09-12T16:06:38.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.115+0000 7fd07cfff700 1 -- 172.21.15.144:0/1932329226 wait complete. 2023-09-12T16:06:38.132 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 01c2b3dd-58b5-48f0-99d4-384140635112 5 2023-09-12T16:06:38.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.328+0000 7f741a9ff700 1 -- 172.21.15.144:0/661085605 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74140b2f70 msgr2=0x7f741415d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:38.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.328+0000 7f741a9ff700 1 --2- 172.21.15.144:0/661085605 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74140b2f70 0x7f741415d390 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0098f0 tx=0x7f73fc009c00 comp rx=0 tx=0).stop 2023-09-12T16:06:38.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.328+0000 7f741a9ff700 1 -- 172.21.15.144:0/661085605 shutdown_connections 2023-09-12T16:06:38.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.328+0000 7f741a9ff700 1 --2- 172.21.15.144:0/661085605 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74140b2f70 0x7f741415d390 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.328+0000 7f741a9ff700 1 -- 172.21.15.144:0/661085605 >> 172.21.15.144:0/661085605 conn(0x7f741406a650 msgr2=0x7f741406c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:38.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.328+0000 7f741a9ff700 1 -- 172.21.15.144:0/661085605 shutdown_connections 2023-09-12T16:06:38.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.328+0000 7f741a9ff700 1 -- 172.21.15.144:0/661085605 wait complete. 2023-09-12T16:06:38.331 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.330+0000 7f741a9ff700 1 Processor -- start 2023-09-12T16:06:38.331 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.330+0000 7f741a9ff700 1 -- start start 2023-09-12T16:06:38.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.332+0000 7f741a9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7414070be0 0x7f74140c1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:38.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.332+0000 7f741a9ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74140b2f70 0x7f74141e38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:38.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.332+0000 7f741a9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74140cd440 0x7f74141e3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:38.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.332+0000 7f741a9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74140c2bd0 con 0x7f74140cd440 2023-09-12T16:06:38.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.332+0000 7f741a9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74140b0b90 con 0x7f7414070be0 2023-09-12T16:06:38.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.332+0000 7f741a9ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74140b05d0 con 0x7f74140b2f70 2023-09-12T16:06:38.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.332+0000 7f740bfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74140b2f70 0x7f74141e38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:38.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.332+0000 7f7413fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7414070be0 0x7f74140c1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:38.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.332+0000 7f740bfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74140b2f70 0x7f74141e38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:51748/0 (socket says 172.21.15.144:51748) 2023-09-12T16:06:38.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.332+0000 7f740bfff700 1 -- 172.21.15.144:0/3740174097 learned_addr learned my addr 172.21.15.144:0/3740174097 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-09-12T16:06:38.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.332+0000 7f7418f9c700 1 --2- 172.21.15.144:0/3740174097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74140cd440 0x7f74141e3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:38.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.332+0000 7f7413fff700 1 -- 172.21.15.144:0/3740174097 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74140b2f70 msgr2=0x7f74141e38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:38.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.332+0000 7f7413fff700 1 --2- 172.21.15.144:0/3740174097 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74140b2f70 0x7f74141e38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.332+0000 7f7413fff700 1 -- 172.21.15.144:0/3740174097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74140cd440 msgr2=0x7f74141e3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:38.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.332+0000 7f7413fff700 1 --2- 172.21.15.144:0/3740174097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74140cd440 0x7f74141e3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.338 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.332+0000 7f7413fff700 1 -- 172.21.15.144:0/3740174097 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc009520 con 0x7f7414070be0 2023-09-12T16:06:38.338 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.332+0000 7f740bfff700 1 --2- 172.21.15.144:0/3740174097 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74140b2f70 0x7f74141e38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-12T16:06:38.338 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.333+0000 7f7413fff700 1 --2- 172.21.15.144:0/3740174097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7414070be0 0x7f74140c1c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7404000f60 tx=0x7f7404001960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:38.338 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.333+0000 7f74117fa700 1 -- 172.21.15.144:0/3740174097 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404013070 con 0x7f7414070be0 2023-09-12T16:06:38.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.333+0000 7f74117fa700 1 -- 172.21.15.144:0/3740174097 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f74040050d0 con 0x7f7414070be0 2023-09-12T16:06:38.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.333+0000 7f74117fa700 1 -- 172.21.15.144:0/3740174097 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404005500 con 0x7f7414070be0 2023-09-12T16:06:38.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.333+0000 7f741a9ff700 1 -- 172.21.15.144:0/3740174097 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74140b08b0 con 0x7f7414070be0 2023-09-12T16:06:38.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.333+0000 7f741a9ff700 1 -- 172.21.15.144:0/3740174097 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74140c21c0 con 0x7f7414070be0 2023-09-12T16:06:38.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.333+0000 7f74117fa700 1 -- 172.21.15.144:0/3740174097 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7404003680 con 0x7f7414070be0 2023-09-12T16:06:38.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.333+0000 7f74117fa700 1 -- 172.21.15.144:0/3740174097 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f740400c5e0 con 0x7f7414070be0 2023-09-12T16:06:38.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.334+0000 7f741a9ff700 1 -- 172.21.15.144:0/3740174097 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74140c2650 con 0x7f7414070be0 2023-09-12T16:06:38.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.336+0000 7f74117fa700 1 -- 172.21.15.144:0/3740174097 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f7404038b20 con 0x7f7414070be0 2023-09-12T16:06:38.421 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.421+0000 7f741a9ff700 1 -- 172.21.15.144:0/3740174097 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd new", "uuid": "01c2b3dd-58b5-48f0-99d4-384140635112", "id": 5} v 0) v1 -- 0x7f741404e300 con 0x7f7414070be0 2023-09-12T16:06:38.425 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.425+0000 7f74117fa700 1 -- 172.21.15.144:0/3740174097 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "01c2b3dd-58b5-48f0-99d4-384140635112", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7404027030 con 0x7f7414070be0 2023-09-12T16:06:38.426 INFO:teuthology.orchestra.run.smithi144.stdout:5 2023-09-12T16:06:38.427 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.426+0000 7f741a9ff700 1 -- 172.21.15.144:0/3740174097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7414070be0 msgr2=0x7f74140c1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:38.428 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.426+0000 7f741a9ff700 1 --2- 172.21.15.144:0/3740174097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7414070be0 0x7f74140c1c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7404000f60 tx=0x7f7404001960 comp rx=0 tx=0).stop 2023-09-12T16:06:38.428 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.426+0000 7f741a9ff700 1 -- 172.21.15.144:0/3740174097 shutdown_connections 2023-09-12T16:06:38.428 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.426+0000 7f741a9ff700 1 --2- 172.21.15.144:0/3740174097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74140cd440 0x7f74141e3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.428 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.426+0000 7f741a9ff700 1 --2- 172.21.15.144:0/3740174097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7414070be0 0x7f74140c1c80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.428 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.426+0000 7f741a9ff700 1 --2- 172.21.15.144:0/3740174097 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74140b2f70 0x7f74141e38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.429 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.426+0000 7f741a9ff700 1 -- 172.21.15.144:0/3740174097 >> 172.21.15.144:0/3740174097 conn(0x7f741406a650 msgr2=0x7f7414153930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:38.429 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.426+0000 7f741a9ff700 1 -- 172.21.15.144:0/3740174097 shutdown_connections 2023-09-12T16:06:38.429 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.426+0000 7f741a9ff700 1 -- 172.21.15.144:0/3740174097 wait complete. 2023-09-12T16:06:38.444 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f 6 2023-09-12T16:06:38.465 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:38.464+0000 7f3843b0f240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-12T16:06:38.557 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:38.556+0000 7f3843b0f240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-12T16:06:38.569 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:38.569+0000 7fa71ef29240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-12T16:06:38.640 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.639+0000 7f02691ff700 1 -- 172.21.15.144:0/1623414373 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02640ce5d0 msgr2=0x7f02640b4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:38.640 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.639+0000 7f02691ff700 1 --2- 172.21.15.144:0/1623414373 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02640ce5d0 0x7f02640b4680 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f025c009f60 tx=0x7f025c009f90 comp rx=0 tx=0).stop 2023-09-12T16:06:38.641 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.639+0000 7f02691ff700 1 -- 172.21.15.144:0/1623414373 shutdown_connections 2023-09-12T16:06:38.641 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.639+0000 7f02691ff700 1 --2- 172.21.15.144:0/1623414373 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02640ce5d0 0x7f02640b4680 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.641 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.639+0000 7f02691ff700 1 --2- 172.21.15.144:0/1623414373 >> v2:172.21.15.112:3300/0 conn(0x7f02640d0410 0x7f02640ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.641 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.639+0000 7f02691ff700 1 -- 172.21.15.144:0/1623414373 >> 172.21.15.144:0/1623414373 conn(0x7f026409abe0 msgr2=0x7f02640d1830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:38.641 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.639+0000 7f02691ff700 1 -- 172.21.15.144:0/1623414373 shutdown_connections 2023-09-12T16:06:38.642 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.639+0000 7f02691ff700 1 -- 172.21.15.144:0/1623414373 wait complete. 2023-09-12T16:06:38.642 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.641+0000 7f02691ff700 1 Processor -- start 2023-09-12T16:06:38.643 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.642+0000 7f02691ff700 1 -- start start 2023-09-12T16:06:38.644 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.643+0000 7f02691ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02640ce5d0 0x7f026415c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:38.645 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.643+0000 7f02691ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02640d0410 0x7f02640cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:38.645 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.643+0000 7f02691ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f026415b920 0x7f026414dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:38.645 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.643+0000 7f02691ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026415f1c0 con 0x7f02640ce5d0 2023-09-12T16:06:38.646 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.643+0000 7f02691ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02640cb970 con 0x7f026415b920 2023-09-12T16:06:38.646 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.643+0000 7f02691ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02641596e0 con 0x7f02640d0410 2023-09-12T16:06:38.646 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.643+0000 7f026259c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02640d0410 0x7f02640cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:38.646 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.643+0000 7f0262d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02640ce5d0 0x7f026415c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:38.646 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.643+0000 7f026259c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02640d0410 0x7f02640cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:51760/0 (socket says 172.21.15.144:51760) 2023-09-12T16:06:38.647 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.643+0000 7f026259c700 1 -- 172.21.15.144:0/1475128596 learned_addr learned my addr 172.21.15.144:0/1475128596 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-09-12T16:06:38.647 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.643+0000 7f026359e700 1 --2- 172.21.15.144:0/1475128596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f026415b920 0x7f026414dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:38.647 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.644+0000 7f026259c700 1 -- 172.21.15.144:0/1475128596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f026415b920 msgr2=0x7f026414dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:38.647 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.644+0000 7f026259c700 1 --2- 172.21.15.144:0/1475128596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f026415b920 0x7f026414dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.647 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.644+0000 7f026259c700 1 -- 172.21.15.144:0/1475128596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02640ce5d0 msgr2=0x7f026415c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:38.648 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.644+0000 7f026259c700 1 --2- 172.21.15.144:0/1475128596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02640ce5d0 0x7f026415c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.648 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.644+0000 7f026259c700 1 -- 172.21.15.144:0/1475128596 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c009c40 con 0x7f02640d0410 2023-09-12T16:06:38.648 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.644+0000 7f0262d9d700 1 --2- 172.21.15.144:0/1475128596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02640ce5d0 0x7f026415c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-12T16:06:38.648 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.644+0000 7f026359e700 1 --2- 172.21.15.144:0/1475128596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f026415b920 0x7f026414dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-12T16:06:38.649 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.644+0000 7f026259c700 1 --2- 172.21.15.144:0/1475128596 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02640d0410 0x7f02640cb430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f025800e9a0 tx=0x7f025800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:38.649 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.644+0000 7f024b7fe700 1 -- 172.21.15.144:0/1475128596 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258009790 con 0x7f02640d0410 2023-09-12T16:06:38.649 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.644+0000 7f024b7fe700 1 -- 172.21.15.144:0/1475128596 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f025800cb00 con 0x7f02640d0410 2023-09-12T16:06:38.649 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.644+0000 7f024b7fe700 1 -- 172.21.15.144:0/1475128596 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258010430 con 0x7f02640d0410 2023-09-12T16:06:38.650 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.644+0000 7f02691ff700 1 -- 172.21.15.144:0/1475128596 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026415e820 con 0x7f02640d0410 2023-09-12T16:06:38.650 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.644+0000 7f02691ff700 1 -- 172.21.15.144:0/1475128596 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026415ede0 con 0x7f02640d0410 2023-09-12T16:06:38.651 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.644+0000 7f024b7fe700 1 -- 172.21.15.144:0/1475128596 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0258010590 con 0x7f02640d0410 2023-09-12T16:06:38.651 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.645+0000 7f024b7fe700 1 -- 172.21.15.144:0/1475128596 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f0258014070 con 0x7f02640d0410 2023-09-12T16:06:38.651 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.646+0000 7f02691ff700 1 -- 172.21.15.144:0/1475128596 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0264072d90 con 0x7f02640d0410 2023-09-12T16:06:38.652 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.648+0000 7f024b7fe700 1 -- 172.21.15.144:0/1475128596 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f0258026060 con 0x7f02640d0410 2023-09-12T16:06:38.677 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:38.676+0000 7fa71ef29240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-12T16:06:38.727 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:38.726+0000 7f3843b0f240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-12T16:06:38.748 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.748+0000 7f02691ff700 1 -- 172.21.15.144:0/1475128596 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd new", "uuid": "87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f", "id": 6} v 0) v1 -- 0x7f02640cbcf0 con 0x7f02640d0410 2023-09-12T16:06:38.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.752+0000 7f024b7fe700 1 -- 172.21.15.144:0/1475128596 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0258018860 con 0x7f02640d0410 2023-09-12T16:06:38.752 INFO:teuthology.orchestra.run.smithi144.stdout:6 2023-09-12T16:06:38.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.753+0000 7f02691ff700 1 -- 172.21.15.144:0/1475128596 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02640d0410 msgr2=0x7f02640cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:38.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.753+0000 7f02691ff700 1 --2- 172.21.15.144:0/1475128596 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02640d0410 0x7f02640cb430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f025800e9a0 tx=0x7f025800ecb0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.753+0000 7f02691ff700 1 -- 172.21.15.144:0/1475128596 shutdown_connections 2023-09-12T16:06:38.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.753+0000 7f02691ff700 1 --2- 172.21.15.144:0/1475128596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f026415b920 0x7f026414dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.753+0000 7f02691ff700 1 --2- 172.21.15.144:0/1475128596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02640ce5d0 0x7f026415c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.753+0000 7f02691ff700 1 --2- 172.21.15.144:0/1475128596 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02640d0410 0x7f02640cb430 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.753+0000 7f02691ff700 1 -- 172.21.15.144:0/1475128596 >> 172.21.15.144:0/1475128596 conn(0x7f026409abe0 msgr2=0x7f02640b6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.753+0000 7f02691ff700 1 -- 172.21.15.144:0/1475128596 shutdown_connections 2023-09-12T16:06:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.753+0000 7f02691ff700 1 -- 172.21.15.144:0/1475128596 wait complete. 2023-09-12T16:06:38.771 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545 7 2023-09-12T16:06:38.816 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:38.815+0000 7f3843b0f240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-12T16:06:38.865 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:38.865+0000 7fa71ef29240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-12T16:06:38.960 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:38.960+0000 7fa71ef29240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-12T16:06:38.968 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.966+0000 7ff14f9ff700 1 -- 172.21.15.144:0/1737538220 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1480cdfb0 msgr2=0x7ff1480cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:38.968 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.966+0000 7ff14f9ff700 1 --2- 172.21.15.144:0/1737538220 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1480cdfb0 0x7ff1480cc3b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff1380098c0 tx=0x7ff138009bd0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.968 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.966+0000 7ff14f9ff700 1 -- 172.21.15.144:0/1737538220 shutdown_connections 2023-09-12T16:06:38.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.966+0000 7ff14f9ff700 1 --2- 172.21.15.144:0/1737538220 >> v2:172.21.15.144:3300/0 conn(0x7ff1480d0590 0x7ff1480cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.966+0000 7ff14f9ff700 1 --2- 172.21.15.144:0/1737538220 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1480cdfb0 0x7ff1480cc3b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.966+0000 7ff14f9ff700 1 -- 172.21.15.144:0/1737538220 >> 172.21.15.144:0/1737538220 conn(0x7ff1480d1930 msgr2=0x7ff1480d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:38.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.967+0000 7ff14f9ff700 1 -- 172.21.15.144:0/1737538220 shutdown_connections 2023-09-12T16:06:38.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.967+0000 7ff14f9ff700 1 -- 172.21.15.144:0/1737538220 wait complete. 2023-09-12T16:06:38.973 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.968+0000 7ff14f9ff700 1 Processor -- start 2023-09-12T16:06:38.974 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.968+0000 7ff14f9ff700 1 -- start start 2023-09-12T16:06:38.974 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.969+0000 7ff14f9ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1480cdfb0 0x7ff1481540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:38.974 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.969+0000 7ff14f9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1480d0590 0x7ff1481f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:38.974 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.969+0000 7ff14f9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff14815f480 0x7ff14806bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:38.974 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.969+0000 7ff14f9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1480b4520 con 0x7ff14815f480 2023-09-12T16:06:38.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.969+0000 7ff14f9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1480c9b90 con 0x7ff1480d0590 2023-09-12T16:06:38.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.969+0000 7ff14f9ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1481e5250 con 0x7ff1480cdfb0 2023-09-12T16:06:38.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.970+0000 7ff14cf9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1480d0590 0x7ff1481f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:38.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.970+0000 7ff14d79b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1480cdfb0 0x7ff1481540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:38.976 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.970+0000 7ff14cf9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1480d0590 0x7ff1481f5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59126/0 (socket says 172.21.15.144:59126) 2023-09-12T16:06:38.976 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.970+0000 7ff14cf9a700 1 -- 172.21.15.144:0/510297921 learned_addr learned my addr 172.21.15.144:0/510297921 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-09-12T16:06:38.976 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.970+0000 7ff14df9c700 1 --2- 172.21.15.144:0/510297921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff14815f480 0x7ff14806bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:38.976 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.970+0000 7ff14d79b700 1 -- 172.21.15.144:0/510297921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1480d0590 msgr2=0x7ff1481f5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:38.976 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.970+0000 7ff14d79b700 1 --2- 172.21.15.144:0/510297921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1480d0590 0x7ff1481f5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.976 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.970+0000 7ff14d79b700 1 -- 172.21.15.144:0/510297921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff14815f480 msgr2=0x7ff14806bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:38.977 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.970+0000 7ff14d79b700 1 --2- 172.21.15.144:0/510297921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff14815f480 0x7ff14806bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:38.977 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.970+0000 7ff14d79b700 1 -- 172.21.15.144:0/510297921 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff140009d00 con 0x7ff1480cdfb0 2023-09-12T16:06:38.977 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.970+0000 7ff14cf9a700 1 --2- 172.21.15.144:0/510297921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1480d0590 0x7ff1481f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-12T16:06:38.977 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.970+0000 7ff14d79b700 1 --2- 172.21.15.144:0/510297921 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1480cdfb0 0x7ff1481540f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff14400c370 tx=0x7ff14400c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:38.977 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.970+0000 7ff13dffb700 1 -- 172.21.15.144:0/510297921 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1440052d0 con 0x7ff1480cdfb0 2023-09-12T16:06:38.978 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.970+0000 7ff13dffb700 1 -- 172.21.15.144:0/510297921 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff144005540 con 0x7ff1480cdfb0 2023-09-12T16:06:38.978 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.970+0000 7ff13dffb700 1 -- 172.21.15.144:0/510297921 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff144003930 con 0x7ff1480cdfb0 2023-09-12T16:06:38.978 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.971+0000 7ff14f9ff700 1 -- 172.21.15.144:0/510297921 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff138009520 con 0x7ff1480cdfb0 2023-09-12T16:06:38.978 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.971+0000 7ff14f9ff700 1 -- 172.21.15.144:0/510297921 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1481f69c0 con 0x7ff1480cdfb0 2023-09-12T16:06:38.979 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.971+0000 7ff13dffb700 1 -- 172.21.15.144:0/510297921 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff144012420 con 0x7ff1480cdfb0 2023-09-12T16:06:38.979 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.971+0000 7ff13dffb700 1 -- 172.21.15.144:0/510297921 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7ff144012d30 con 0x7ff1480cdfb0 2023-09-12T16:06:38.979 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.972+0000 7ff14f9ff700 1 -- 172.21.15.144:0/510297921 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14806b910 con 0x7ff1480cdfb0 2023-09-12T16:06:38.979 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:38.976+0000 7ff13dffb700 1 -- 172.21.15.144:0/510297921 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7ff144021060 con 0x7ff1480cdfb0 2023-09-12T16:06:39.032 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:39.032+0000 7f3843b0f240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-12T16:06:39.064 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:39.063+0000 7ff14f9ff700 1 -- 172.21.15.144:0/510297921 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545", "id": 7} v 0) v1 -- 0x7ff14804e300 con 0x7ff1480cdfb0 2023-09-12T16:06:39.068 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:39.067+0000 7ff13dffb700 1 -- 172.21.15.144:0/510297921 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff144017070 con 0x7ff1480cdfb0 2023-09-12T16:06:39.068 INFO:teuthology.orchestra.run.smithi144.stdout:7 2023-09-12T16:06:39.069 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:39.068+0000 7ff14f9ff700 1 -- 172.21.15.144:0/510297921 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1480cdfb0 msgr2=0x7ff1481540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:39.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:39.069+0000 7ff14f9ff700 1 --2- 172.21.15.144:0/510297921 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1480cdfb0 0x7ff1481540f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff14400c370 tx=0x7ff14400c680 comp rx=0 tx=0).stop 2023-09-12T16:06:39.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:39.069+0000 7ff14f9ff700 1 -- 172.21.15.144:0/510297921 shutdown_connections 2023-09-12T16:06:39.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:39.069+0000 7ff14f9ff700 1 --2- 172.21.15.144:0/510297921 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1480cdfb0 0x7ff1481540f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:39.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:39.069+0000 7ff14f9ff700 1 --2- 172.21.15.144:0/510297921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff14815f480 0x7ff14806bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:39.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:39.069+0000 7ff14f9ff700 1 --2- 172.21.15.144:0/510297921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1480d0590 0x7ff1481f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:39.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:39.069+0000 7ff14f9ff700 1 -- 172.21.15.144:0/510297921 >> 172.21.15.144:0/510297921 conn(0x7ff1480d1930 msgr2=0x7ff14806b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:39.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:39.069+0000 7ff14f9ff700 1 -- 172.21.15.144:0/510297921 shutdown_connections 2023-09-12T16:06:39.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-09-12T16:06:39.069+0000 7ff14f9ff700 1 -- 172.21.15.144:0/510297921 wait complete. 2023-09-12T16:06:39.087 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-12T16:06:39.087 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-12T16:06:39.092 INFO:tasks.ceph.osd.0:Started 2023-09-12T16:06:39.092 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-12T16:06:39.092 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-12T16:06:39.097 INFO:tasks.ceph.osd.1:Started 2023-09-12T16:06:39.097 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-12T16:06:39.098 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-12T16:06:39.103 INFO:tasks.ceph.osd.2:Started 2023-09-12T16:06:39.104 INFO:tasks.ceph.osd.3:Restarting daemon 2023-09-12T16:06:39.104 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-09-12T16:06:39.111 INFO:tasks.ceph.osd.3:Started 2023-09-12T16:06:39.111 INFO:tasks.ceph.osd.4:Restarting daemon 2023-09-12T16:06:39.112 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-09-12T16:06:39.116 INFO:tasks.ceph.osd.4:Started 2023-09-12T16:06:39.117 INFO:tasks.ceph.osd.5:Restarting daemon 2023-09-12T16:06:39.117 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-09-12T16:06:39.122 INFO:tasks.ceph.osd.5:Started 2023-09-12T16:06:39.122 INFO:tasks.ceph.osd.6:Restarting daemon 2023-09-12T16:06:39.123 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-09-12T16:06:39.130 INFO:tasks.ceph.osd.6:Started 2023-09-12T16:06:39.130 INFO:tasks.ceph.osd.7:Restarting daemon 2023-09-12T16:06:39.131 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-09-12T16:06:39.136 INFO:tasks.ceph.osd.7:Started 2023-09-12T16:06:39.137 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:06:39.146 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:39.146+0000 7f3843b0f240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-12T16:06:39.210 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:39.209+0000 7fa71ef29240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-12T16:06:39.301 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:39.301+0000 7f3843b0f240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-12T16:06:39.337 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:39.337+0000 7fa71ef29240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-12T16:06:39.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.393+0000 7f5415fff700 1 -- 172.21.15.112:0/60317493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54100d21f0 msgr2=0x7f54100b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:39.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.393+0000 7f5415fff700 1 --2- 172.21.15.112:0/60317493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54100d21f0 0x7f54100b5330 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f541008ad10 tx=0x7f540800b380 comp rx=0 tx=0).stop 2023-09-12T16:06:39.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.393+0000 7f5415fff700 1 -- 172.21.15.112:0/60317493 shutdown_connections 2023-09-12T16:06:39.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.393+0000 7f5415fff700 1 --2- 172.21.15.112:0/60317493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54100d21f0 0x7f54100b5330 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:39.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.393+0000 7f5415fff700 1 --2- 172.21.15.112:0/60317493 >> v2:172.21.15.144:3300/0 conn(0x7f54100b3a60 0x7f54100cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:39.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.393+0000 7f5415fff700 1 -- 172.21.15.112:0/60317493 >> 172.21.15.112:0/60317493 conn(0x7f541009abe0 msgr2=0x7f54100d18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:39.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.393+0000 7f5415fff700 1 -- 172.21.15.112:0/60317493 shutdown_connections 2023-09-12T16:06:39.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.394+0000 7f5415fff700 1 -- 172.21.15.112:0/60317493 wait complete. 2023-09-12T16:06:39.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.395+0000 7f5415fff700 1 Processor -- start 2023-09-12T16:06:39.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.395+0000 7f5415fff700 1 -- start start 2023-09-12T16:06:39.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.396+0000 7f5415fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f54100b3a60 0x7f541015c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:39.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.396+0000 7f5415fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54100d21f0 0x7f5410156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:39.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.396+0000 7f5415fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f541015f0d0 0x7f54100cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:39.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.396+0000 7f5415fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5410157780 con 0x7f541015f0d0 2023-09-12T16:06:39.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.396+0000 7f5415fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541015cca0 con 0x7f54100d21f0 2023-09-12T16:06:39.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.396+0000 7f5415fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541015cf80 con 0x7f54100b3a60 2023-09-12T16:06:39.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.396+0000 7f540ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f541015f0d0 0x7f54100cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:39.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.396+0000 7f540ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f541015f0d0 0x7f54100cb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40566/0 (socket says 172.21.15.112:40566) 2023-09-12T16:06:39.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.396+0000 7f540ffff700 1 -- 172.21.15.112:0/2249925890 learned_addr learned my addr 172.21.15.112:0/2249925890 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:39.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.396+0000 7f5407fff700 1 --2- 172.21.15.112:0/2249925890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54100d21f0 0x7f5410156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:39.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.397+0000 7f540f7fe700 1 --2- 172.21.15.112:0/2249925890 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f54100b3a60 0x7f541015c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:39.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.397+0000 7f540ffff700 1 -- 172.21.15.112:0/2249925890 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f54100b3a60 msgr2=0x7f541015c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:39.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.397+0000 7f540ffff700 1 --2- 172.21.15.112:0/2249925890 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f54100b3a60 0x7f541015c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:39.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.397+0000 7f540ffff700 1 -- 172.21.15.112:0/2249925890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54100d21f0 msgr2=0x7f5410156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:39.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.397+0000 7f540ffff700 1 --2- 172.21.15.112:0/2249925890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54100d21f0 0x7f5410156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:39.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.397+0000 7f540ffff700 1 -- 172.21.15.112:0/2249925890 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5408009d00 con 0x7f541015f0d0 2023-09-12T16:06:39.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.397+0000 7f540ffff700 1 --2- 172.21.15.112:0/2249925890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f541015f0d0 0x7f54100cb4d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f540800b070 tx=0x7f5408007b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:39.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.397+0000 7f540cff9700 1 -- 172.21.15.112:0/2249925890 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540800e040 con 0x7f541015f0d0 2023-09-12T16:06:39.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.397+0000 7f540cff9700 1 -- 172.21.15.112:0/2249925890 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f540801d680 con 0x7f541015f0d0 2023-09-12T16:06:39.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.397+0000 7f540cff9700 1 -- 172.21.15.112:0/2249925890 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540800bea0 con 0x7f541015f0d0 2023-09-12T16:06:39.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.397+0000 7f5415fff700 1 -- 172.21.15.112:0/2249925890 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541015d260 con 0x7f541015f0d0 2023-09-12T16:06:39.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.398+0000 7f5415fff700 1 -- 172.21.15.112:0/2249925890 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54100cafb0 con 0x7f541015f0d0 2023-09-12T16:06:39.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.398+0000 7f540cff9700 1 -- 172.21.15.112:0/2249925890 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f540801b450 con 0x7f541015f0d0 2023-09-12T16:06:39.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.398+0000 7f540cff9700 1 -- 172.21.15.112:0/2249925890 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f540801bdd0 con 0x7f541015f0d0 2023-09-12T16:06:39.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.399+0000 7f5415fff700 1 -- 172.21.15.112:0/2249925890 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54100cab30 con 0x7f541015f0d0 2023-09-12T16:06:39.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.401+0000 7f540cff9700 1 -- 172.21.15.112:0/2249925890 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f54100cab30 con 0x7f541015f0d0 2023-09-12T16:06:39.422 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:39.421+0000 7f3843b0f240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-12T16:06:39.436 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:39.436+0000 7fa71ef29240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-12T16:06:39.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.473+0000 7f5415fff700 1 -- 172.21.15.112:0/2249925890 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f541004e300 con 0x7f541015f0d0 2023-09-12T16:06:39.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.474+0000 7f540cff9700 1 -- 172.21.15.112:0/2249925890 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f5408021020 con 0x7f541015f0d0 2023-09-12T16:06:39.475 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:06:39.475 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":10,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:06:39.066319+0000","last_up_change":"0.000000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:06:39.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.475+0000 7f5415fff700 1 -- 172.21.15.112:0/2249925890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f541015f0d0 msgr2=0x7f54100cb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:39.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.475+0000 7f5415fff700 1 --2- 172.21.15.112:0/2249925890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f541015f0d0 0x7f54100cb4d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f540800b070 tx=0x7f5408007b80 comp rx=0 tx=0).stop 2023-09-12T16:06:39.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.475+0000 7f5415fff700 1 -- 172.21.15.112:0/2249925890 shutdown_connections 2023-09-12T16:06:39.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.475+0000 7f5415fff700 1 --2- 172.21.15.112:0/2249925890 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f54100b3a60 0x7f541015c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:39.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.475+0000 7f5415fff700 1 --2- 172.21.15.112:0/2249925890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f541015f0d0 0x7f54100cb4d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:39.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.475+0000 7f5415fff700 1 --2- 172.21.15.112:0/2249925890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54100d21f0 0x7f5410156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:39.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.475+0000 7f5415fff700 1 -- 172.21.15.112:0/2249925890 >> 172.21.15.112:0/2249925890 conn(0x7f541009abe0 msgr2=0x7f541006bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:39.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.475+0000 7f5415fff700 1 -- 172.21.15.112:0/2249925890 shutdown_connections 2023-09-12T16:06:39.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:39.475+0000 7f5415fff700 1 -- 172.21.15.112:0/2249925890 wait complete. 2023-09-12T16:06:39.494 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-09-12T16:06:39.494 INFO:tasks.ceph:Waiting for OSDs to come up 2023-09-12T16:06:39.549 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:39.548+0000 7fa71ef29240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-12T16:06:39.570 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T16:06:39.569+0000 7f49d5d9f680 -1 Falling back to public interface 2023-09-12T16:06:39.658 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:39.657+0000 7f3843b0f240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-12T16:06:39.778 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:39.777+0000 7fa71ef29240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-12T16:06:39.819 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T16:06:39.818+0000 7f196b13a680 -1 Falling back to public interface 2023-09-12T16:06:39.827 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T16:06:39.827+0000 7fd0feee9680 -1 Falling back to public interface 2023-09-12T16:06:39.828 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T16:06:39.827+0000 7fed1eab0680 -1 Falling back to public interface 2023-09-12T16:06:39.828 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T16:06:39.828+0000 7f05d5639680 -1 Falling back to public interface 2023-09-12T16:06:39.838 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T16:06:39.837+0000 7f2634158680 -1 Falling back to public interface 2023-09-12T16:06:39.854 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T16:06:39.853+0000 7fb92327b680 -1 Falling back to public interface 2023-09-12T16:06:39.858 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T16:06:39.858+0000 7f859dd70680 -1 Falling back to public interface 2023-09-12T16:06:39.927 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:39.926+0000 7f3843b0f240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-12T16:06:40.043 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:40.043+0000 7fa71ef29240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-12T16:06:40.123 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:40.122+0000 7f3843b0f240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-12T16:06:40.214 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:40.213+0000 7f3843b0f240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-12T16:06:40.239 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:40.238+0000 7fa71ef29240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-12T16:06:40.299 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-12T16:06:40.329 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:40.329+0000 7fa71ef29240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-12T16:06:40.478 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.476+0000 7f9ec55ff700 1 -- 172.21.15.112:0/2442732754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ec00cdb50 msgr2=0x7f9ec00c8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:40.478 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.476+0000 7f9ec55ff700 1 --2- 172.21.15.112:0/2442732754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ec00cdb50 0x7f9ec00c8820 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8009f60 tx=0x7f9eb8009f90 comp rx=0 tx=0).stop 2023-09-12T16:06:40.478 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.477+0000 7f9ec55ff700 1 -- 172.21.15.112:0/2442732754 shutdown_connections 2023-09-12T16:06:40.479 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.477+0000 7f9ec55ff700 1 --2- 172.21.15.112:0/2442732754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ec00cdb50 0x7f9ec00c8820 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:40.479 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.477+0000 7f9ec55ff700 1 -- 172.21.15.112:0/2442732754 >> 172.21.15.112:0/2442732754 conn(0x7f9ec006a650 msgr2=0x7f9ec006c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:40.479 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.477+0000 7f9ec55ff700 1 -- 172.21.15.112:0/2442732754 shutdown_connections 2023-09-12T16:06:40.479 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.477+0000 7f9ec55ff700 1 -- 172.21.15.112:0/2442732754 wait complete. 2023-09-12T16:06:40.480 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.478+0000 7f9ec55ff700 1 Processor -- start 2023-09-12T16:06:40.480 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.479+0000 7f9ec55ff700 1 -- start start 2023-09-12T16:06:40.482 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.479+0000 7f9ec55ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ec00cdb50 0x7f9ec00b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:40.482 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.479+0000 7f9ec55ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec0159af0 0x7f9ec00c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:40.482 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.480+0000 7f9ec55ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ec00c93c0 0x7f9ec0154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:40.483 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.480+0000 7f9ec55ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec0147d80 con 0x7f9ec00c93c0 2023-09-12T16:06:40.483 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.480+0000 7f9ec55ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00c9850 con 0x7f9ec0159af0 2023-09-12T16:06:40.483 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.480+0000 7f9ec55ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec0156850 con 0x7f9ec00cdb50 2023-09-12T16:06:40.483 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.480+0000 7f9ebf7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ec00c93c0 0x7f9ec0154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:40.483 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.480+0000 7f9ebe7fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec0159af0 0x7f9ec00c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:40.484 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.480+0000 7f9ebf7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ec00c93c0 0x7f9ec0154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40584/0 (socket says 172.21.15.112:40584) 2023-09-12T16:06:40.484 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.480+0000 7f9ebe7fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec0159af0 0x7f9ec00c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.112:51904/0 (socket says 172.21.15.112:51904) 2023-09-12T16:06:40.484 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.480+0000 7f9ebf7fe700 1 -- 172.21.15.112:0/1485184884 learned_addr learned my addr 172.21.15.112:0/1485184884 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:40.484 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.480+0000 7f9ebeffd700 1 --2- 172.21.15.112:0/1485184884 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ec00cdb50 0x7f9ec00b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:40.485 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.480+0000 7f9ebf7fe700 1 -- 172.21.15.112:0/1485184884 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ec00cdb50 msgr2=0x7f9ec00b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:40.485 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.480+0000 7f9ebf7fe700 1 --2- 172.21.15.112:0/1485184884 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ec00cdb50 0x7f9ec00b1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:40.485 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.480+0000 7f9ebf7fe700 1 -- 172.21.15.112:0/1485184884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec0159af0 msgr2=0x7f9ec00c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:40.485 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.480+0000 7f9ebf7fe700 1 --2- 172.21.15.112:0/1485184884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec0159af0 0x7f9ec00c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:40.485 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.480+0000 7f9ebf7fe700 1 -- 172.21.15.112:0/1485184884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb8009c40 con 0x7f9ec00c93c0 2023-09-12T16:06:40.486 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.480+0000 7f9ebf7fe700 1 --2- 172.21.15.112:0/1485184884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ec00c93c0 0x7f9ec0154940 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800b6c0 tx=0x7f9eb8007aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:40.486 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.481+0000 7f9ea77fe700 1 -- 172.21.15.112:0/1485184884 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb800e040 con 0x7f9ec00c93c0 2023-09-12T16:06:40.486 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.481+0000 7f9ea77fe700 1 -- 172.21.15.112:0/1485184884 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9eb801d680 con 0x7f9ec00c93c0 2023-09-12T16:06:40.486 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.481+0000 7f9ec55ff700 1 -- 172.21.15.112:0/1485184884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec0156a80 con 0x7f9ec00c93c0 2023-09-12T16:06:40.486 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.481+0000 7f9ea77fe700 1 -- 172.21.15.112:0/1485184884 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb801da50 con 0x7f9ec00c93c0 2023-09-12T16:06:40.487 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.481+0000 7f9ec55ff700 1 -- 172.21.15.112:0/1485184884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec0157040 con 0x7f9ec00c93c0 2023-09-12T16:06:40.487 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.481+0000 7f9ea77fe700 1 -- 172.21.15.112:0/1485184884 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9eb801b450 con 0x7f9ec00c93c0 2023-09-12T16:06:40.487 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.481+0000 7f9ea77fe700 1 -- 172.21.15.112:0/1485184884 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9eb8026ae0 con 0x7f9ec00c93c0 2023-09-12T16:06:40.488 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.482+0000 7f9ec55ff700 1 -- 172.21.15.112:0/1485184884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec004e300 con 0x7f9ec00c93c0 2023-09-12T16:06:40.488 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.484+0000 7f9ea77fe700 1 -- 172.21.15.112:0/1485184884 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f9eb8021020 con 0x7f9ec00c93c0 2023-09-12T16:06:40.556 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.555+0000 7f9ec55ff700 1 -- 172.21.15.112:0/1485184884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ec00c4d70 con 0x7f9ec00c93c0 2023-09-12T16:06:40.557 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.555+0000 7f9ea77fe700 1 -- 172.21.15.112:0/1485184884 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9eb8026df0 con 0x7f9ec00c93c0 2023-09-12T16:06:40.557 INFO:teuthology.misc.health.smithi112.stdout: 2023-09-12T16:06:40.558 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":10,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:06:39.066319+0000","last_up_change":"0.000000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:06:40.559 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.556+0000 7f9ec55ff700 1 -- 172.21.15.112:0/1485184884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ec00c93c0 msgr2=0x7f9ec0154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:40.559 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.556+0000 7f9ec55ff700 1 --2- 172.21.15.112:0/1485184884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ec00c93c0 0x7f9ec0154940 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800b6c0 tx=0x7f9eb8007aa0 comp rx=0 tx=0).stop 2023-09-12T16:06:40.559 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.557+0000 7f9ec55ff700 1 -- 172.21.15.112:0/1485184884 shutdown_connections 2023-09-12T16:06:40.559 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.557+0000 7f9ec55ff700 1 --2- 172.21.15.112:0/1485184884 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ec00cdb50 0x7f9ec00b1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:40.560 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.557+0000 7f9ec55ff700 1 --2- 172.21.15.112:0/1485184884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ec00c93c0 0x7f9ec0154940 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:40.560 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.557+0000 7f9ec55ff700 1 --2- 172.21.15.112:0/1485184884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec0159af0 0x7f9ec00c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:40.560 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.557+0000 7f9ec55ff700 1 -- 172.21.15.112:0/1485184884 >> 172.21.15.112:0/1485184884 conn(0x7f9ec006a650 msgr2=0x7f9ec00c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:40.560 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.557+0000 7f9ec55ff700 1 -- 172.21.15.112:0/1485184884 shutdown_connections 2023-09-12T16:06:40.561 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:40.557+0000 7f9ec55ff700 1 -- 172.21.15.112:0/1485184884 wait complete. 2023-09-12T16:06:40.572 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-09-12T16:06:40.860 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:40.859+0000 7f3843b0f240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-12T16:06:40.957 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:40.956+0000 7fa71ef29240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-12T16:06:41.250 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:41.249+0000 7f3843b0f240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-12T16:06:41.341 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:41.341+0000 7fa71ef29240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-12T16:06:41.433 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:41.432+0000 7f3843b0f240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-12T16:06:41.528 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:41.528+0000 7fa71ef29240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-12T16:06:41.926 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:41.925+0000 7f3843b0f240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-12T16:06:42.011 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:42.011+0000 7fa71ef29240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-12T16:06:42.124 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:42.123+0000 7f3843b0f240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-12T16:06:42.199 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:42.198+0000 7fa71ef29240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-12T16:06:42.319 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:42.318+0000 7f3843b0f240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-12T16:06:42.416 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:42.415+0000 7fa71ef29240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-12T16:06:42.798 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:42.797+0000 7f3843b0f240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-12T16:06:42.832 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-09-12T16:06:42.832+0000 7fa71ef29240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-12T16:06:43.144 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T16:06:43.143+0000 7f49d5d9f680 -1 osd.1 0 log_to_monitors true 2023-09-12T16:06:43.346 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T16:06:43.345+0000 7f196b13a680 -1 osd.0 0 log_to_monitors true 2023-09-12T16:06:43.403 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T16:06:43.403+0000 7f05d5639680 -1 osd.4 0 log_to_monitors true 2023-09-12T16:06:43.404 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T16:06:43.403+0000 7fd0feee9680 -1 osd.5 0 log_to_monitors true 2023-09-12T16:06:43.409 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T16:06:43.408+0000 7fed1eab0680 -1 osd.2 0 log_to_monitors true 2023-09-12T16:06:43.636 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T16:06:43.636+0000 7f2634158680 -1 osd.7 0 log_to_monitors true 2023-09-12T16:06:43.661 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T16:06:43.660+0000 7f859dd70680 -1 osd.6 0 log_to_monitors true 2023-09-12T16:06:43.670 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T16:06:43.670+0000 7fb92327b680 -1 osd.3 0 log_to_monitors true 2023-09-12T16:06:43.817 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:43.817+0000 7f37fd3fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-12T16:06:43.818 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-09-12T16:06:43.818+0000 7f37fd3fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-12T16:06:47.044 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T16:06:47.041+0000 7fd0eddf7700 -1 osd.5 0 waiting for initial osdmap 2023-09-12T16:06:47.059 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T16:06:47.058+0000 7fd0e55fa700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-12T16:06:47.060 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T16:06:47.057+0000 7fed0d9f7700 -1 osd.2 0 waiting for initial osdmap 2023-09-12T16:06:47.071 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T16:06:47.070+0000 7f858cbf7700 -1 osd.6 0 waiting for initial osdmap 2023-09-12T16:06:47.079 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T16:06:47.079+0000 7fed051fa700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-12T16:06:47.080 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T16:06:47.079+0000 7f1959ff7700 -1 osd.0 0 waiting for initial osdmap 2023-09-12T16:06:47.089 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T16:06:47.088+0000 7fb9129f8700 -1 osd.3 0 waiting for initial osdmap 2023-09-12T16:06:47.103 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T16:06:47.103+0000 7f19517fa700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-12T16:06:47.105 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T16:06:47.104+0000 7f05c45f7700 -1 osd.4 0 waiting for initial osdmap 2023-09-12T16:06:47.107 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T16:06:47.106+0000 7f85843fa700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-12T16:06:47.108 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T16:06:47.108+0000 7fb9099fa700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-12T16:06:47.115 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T16:06:47.115+0000 7f49c4bf7700 -1 osd.1 0 waiting for initial osdmap 2023-09-12T16:06:47.135 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T16:06:47.135+0000 7f49bc3fa700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-12T16:06:47.142 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T16:06:47.142+0000 7f05bbdfa700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-12T16:06:47.379 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-12T16:06:47.554 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.554+0000 7f37ad9ff700 1 -- 172.21.15.112:0/3165080525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a80c9ac0 msgr2=0x7f37a80cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:47.555 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.554+0000 7f37ad9ff700 1 --2- 172.21.15.112:0/3165080525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a80c9ac0 0x7f37a80cd980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f37a80cd360 tx=0x7f379c009ba0 comp rx=0 tx=0).stop 2023-09-12T16:06:47.555 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.554+0000 7f37ad9ff700 1 -- 172.21.15.112:0/3165080525 shutdown_connections 2023-09-12T16:06:47.555 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.554+0000 7f37ad9ff700 1 --2- 172.21.15.112:0/3165080525 >> v2:172.21.15.144:3300/0 conn(0x7f37a8159af0 0x7f37a80cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:47.555 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.554+0000 7f37ad9ff700 1 --2- 172.21.15.112:0/3165080525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a80c9ac0 0x7f37a80cd980 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:47.556 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.554+0000 7f37ad9ff700 1 -- 172.21.15.112:0/3165080525 >> 172.21.15.112:0/3165080525 conn(0x7f37a806a650 msgr2=0x7f37a806c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:47.556 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.554+0000 7f37ad9ff700 1 -- 172.21.15.112:0/3165080525 shutdown_connections 2023-09-12T16:06:47.556 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.554+0000 7f37ad9ff700 1 -- 172.21.15.112:0/3165080525 wait complete. 2023-09-12T16:06:47.558 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.556+0000 7f37ad9ff700 1 Processor -- start 2023-09-12T16:06:47.559 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.556+0000 7f37ad9ff700 1 -- start start 2023-09-12T16:06:47.559 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.557+0000 7f37ad9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a8070e00 0x7f37a80b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:47.559 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.557+0000 7f37ad9ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37a8159af0 0x7f37a8153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:47.559 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.557+0000 7f37ad9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37a80af250 0x7f37a80c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:47.559 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.557+0000 7f37ad9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a80b23d0 con 0x7f37a8070e00 2023-09-12T16:06:47.560 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.557+0000 7f37ad9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a80b1c00 con 0x7f37a80af250 2023-09-12T16:06:47.560 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.557+0000 7f37ad9ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a80b1e10 con 0x7f37a8159af0 2023-09-12T16:06:47.560 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.557+0000 7f37a6ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a8070e00 0x7f37a80b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:47.561 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.557+0000 7f37a6ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a8070e00 0x7f37a80b05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54560/0 (socket says 172.21.15.112:54560) 2023-09-12T16:06:47.561 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.557+0000 7f37a6ffd700 1 -- 172.21.15.112:0/3814284796 learned_addr learned my addr 172.21.15.112:0/3814284796 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:47.561 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.557+0000 7f37a67fc700 1 --2- 172.21.15.112:0/3814284796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37a8159af0 0x7f37a8153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:47.561 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.557+0000 7f37a77fe700 1 --2- 172.21.15.112:0/3814284796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37a80af250 0x7f37a80c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:47.562 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.557+0000 7f37a6ffd700 1 -- 172.21.15.112:0/3814284796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37a8159af0 msgr2=0x7f37a8153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:47.562 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.557+0000 7f37a6ffd700 1 --2- 172.21.15.112:0/3814284796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37a8159af0 0x7f37a8153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:47.562 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.557+0000 7f37a6ffd700 1 -- 172.21.15.112:0/3814284796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37a80af250 msgr2=0x7f37a80c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:47.562 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.557+0000 7f37a6ffd700 1 --2- 172.21.15.112:0/3814284796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37a80af250 0x7f37a80c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:47.563 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.558+0000 7f37a6ffd700 1 -- 172.21.15.112:0/3814284796 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379c009520 con 0x7f37a8070e00 2023-09-12T16:06:47.563 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.558+0000 7f37a77fe700 1 --2- 172.21.15.112:0/3814284796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37a80af250 0x7f37a80c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:06:47.563 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.558+0000 7f37a6ffd700 1 --2- 172.21.15.112:0/3814284796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a8070e00 0x7f37a80b05f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f379800e9a0 tx=0x7f379800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:47.563 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.558+0000 7f378ffff700 1 -- 172.21.15.112:0/3814284796 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3798009790 con 0x7f37a8070e00 2023-09-12T16:06:47.563 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.558+0000 7f378ffff700 1 -- 172.21.15.112:0/3814284796 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f379800ccc0 con 0x7f37a8070e00 2023-09-12T16:06:47.563 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.558+0000 7f378ffff700 1 -- 172.21.15.112:0/3814284796 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3798010690 con 0x7f37a8070e00 2023-09-12T16:06:47.564 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.558+0000 7f37ad9ff700 1 -- 172.21.15.112:0/3814284796 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a80b20f0 con 0x7f37a8070e00 2023-09-12T16:06:47.564 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.558+0000 7f37ad9ff700 1 -- 172.21.15.112:0/3814284796 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a80b0b30 con 0x7f37a8070e00 2023-09-12T16:06:47.565 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.559+0000 7f37ad9ff700 1 -- 172.21.15.112:0/3814284796 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a804e300 con 0x7f37a8070e00 2023-09-12T16:06:47.565 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.560+0000 7f378ffff700 1 -- 172.21.15.112:0/3814284796 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 88677+0+0 (secure 0 0 0) 0x7f37980107f0 con 0x7f37a8070e00 2023-09-12T16:06:47.565 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.561+0000 7f378ffff700 1 --2- 172.21.15.112:0/3814284796 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f379406a4f0 0x7f379406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:47.566 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.561+0000 7f378ffff700 1 -- 172.21.15.112:0/3814284796 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f3798014070 con 0x7f37a8070e00 2023-09-12T16:06:47.566 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.561+0000 7f37a67fc700 1 --2- 172.21.15.112:0/3814284796 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f379406a4f0 0x7f379406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:47.566 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.562+0000 7f37a67fc700 1 --2- 172.21.15.112:0/3814284796 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f379406a4f0 0x7f379406c9b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f379c009230 tx=0x7f379c019040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:47.566 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.565+0000 7f378ffff700 1 -- 172.21.15.112:0/3814284796 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f37980519b0 con 0x7f37a8070e00 2023-09-12T16:06:47.653 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T16:06:47.652+0000 7f2622ff7700 -1 osd.7 0 waiting for initial osdmap 2023-09-12T16:06:47.666 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T16:06:47.666+0000 7f261a7fa700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-12T16:06:47.770 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.770+0000 7f37ad9ff700 1 -- 172.21.15.112:0/3814284796 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37a806d0d0 con 0x7f37a8070e00 2023-09-12T16:06:47.771 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.771+0000 7f378ffff700 1 -- 172.21.15.112:0/3814284796 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3798058430 con 0x7f37a8070e00 2023-09-12T16:06:47.771 INFO:teuthology.misc.health.smithi112.stdout: 2023-09-12T16:06:47.771 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":12,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:06:44.869912+0000","last_up_change":"0.000000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:06:47.773 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.773+0000 7f37ad9ff700 1 -- 172.21.15.112:0/3814284796 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f379406a4f0 msgr2=0x7f379406c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:47.773 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.773+0000 7f37ad9ff700 1 --2- 172.21.15.112:0/3814284796 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f379406a4f0 0x7f379406c9b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f379c009230 tx=0x7f379c019040 comp rx=0 tx=0).stop 2023-09-12T16:06:47.773 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.773+0000 7f37ad9ff700 1 -- 172.21.15.112:0/3814284796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a8070e00 msgr2=0x7f37a80b05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:47.774 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.773+0000 7f37ad9ff700 1 --2- 172.21.15.112:0/3814284796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a8070e00 0x7f37a80b05f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f379800e9a0 tx=0x7f379800ecb0 comp rx=0 tx=0).stop 2023-09-12T16:06:47.774 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.773+0000 7f37ad9ff700 1 -- 172.21.15.112:0/3814284796 shutdown_connections 2023-09-12T16:06:47.774 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.773+0000 7f37ad9ff700 1 --2- 172.21.15.112:0/3814284796 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f379406a4f0 0x7f379406c9b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:47.774 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.773+0000 7f37ad9ff700 1 --2- 172.21.15.112:0/3814284796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37a80af250 0x7f37a80c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:47.775 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.773+0000 7f37ad9ff700 1 --2- 172.21.15.112:0/3814284796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a8070e00 0x7f37a80b05f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:47.775 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.773+0000 7f37ad9ff700 1 --2- 172.21.15.112:0/3814284796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37a8159af0 0x7f37a8153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:47.775 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.773+0000 7f37ad9ff700 1 -- 172.21.15.112:0/3814284796 >> 172.21.15.112:0/3814284796 conn(0x7f37a806a650 msgr2=0x7f37a8158dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:47.775 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.773+0000 7f37ad9ff700 1 -- 172.21.15.112:0/3814284796 shutdown_connections 2023-09-12T16:06:47.775 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:47.773+0000 7f37ad9ff700 1 -- 172.21.15.112:0/3814284796 wait complete. 2023-09-12T16:06:47.788 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-09-12T16:06:53.027 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:06:53.032 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:06:54.595 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-12T16:06:54.781 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.781+0000 7f122e1ff700 1 -- 172.21.15.112:0/1150638182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f122815f480 msgr2=0x7f12280cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:54.781 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.781+0000 7f122e1ff700 1 --2- 172.21.15.112:0/1150638182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f122815f480 0x7f12280cfe80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1228089340 tx=0x7f1218009c50 comp rx=0 tx=0).stop 2023-09-12T16:06:54.782 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.781+0000 7f122e1ff700 1 -- 172.21.15.112:0/1150638182 shutdown_connections 2023-09-12T16:06:54.782 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.781+0000 7f122e1ff700 1 --2- 172.21.15.112:0/1150638182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f122815f480 0x7f12280cfe80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:54.782 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.781+0000 7f122e1ff700 1 --2- 172.21.15.112:0/1150638182 >> v2:172.21.15.144:3300/0 conn(0x7f12280cdfb0 0x7f12280d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:54.782 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.781+0000 7f122e1ff700 1 -- 172.21.15.112:0/1150638182 >> 172.21.15.112:0/1150638182 conn(0x7f12280d1930 msgr2=0x7f12280d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:54.783 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.781+0000 7f122e1ff700 1 -- 172.21.15.112:0/1150638182 shutdown_connections 2023-09-12T16:06:54.783 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.781+0000 7f122e1ff700 1 -- 172.21.15.112:0/1150638182 wait complete. 2023-09-12T16:06:54.783 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.783+0000 7f122e1ff700 1 Processor -- start 2023-09-12T16:06:54.784 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.784+0000 7f122e1ff700 1 -- start start 2023-09-12T16:06:54.786 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.785+0000 7f122e1ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12280b28f0 0x7f12281e4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:54.786 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.785+0000 7f122e1ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12280cdfb0 0x7f12280b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:54.786 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.785+0000 7f122e1ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f122815f480 0x7f12280ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:54.787 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.785+0000 7f122e1ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12280cb370 con 0x7f122815f480 2023-09-12T16:06:54.787 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.785+0000 7f122e1ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12281e58f0 con 0x7f12280cdfb0 2023-09-12T16:06:54.787 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.785+0000 7f122e1ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12280b1ed0 con 0x7f12280b28f0 2023-09-12T16:06:54.789 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.785+0000 7f1227fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f122815f480 0x7f12280ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:54.789 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.785+0000 7f1227fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f122815f480 0x7f12280ca2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54610/0 (socket says 172.21.15.112:54610) 2023-09-12T16:06:54.789 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.785+0000 7f1227fff700 1 -- 172.21.15.112:0/1040266764 learned_addr learned my addr 172.21.15.112:0/1040266764 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:54.790 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.785+0000 7f1226ffd700 1 --2- 172.21.15.112:0/1040266764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12280cdfb0 0x7f12280b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:54.790 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.785+0000 7f1227fff700 1 -- 172.21.15.112:0/1040266764 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12280b28f0 msgr2=0x7f12281e4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:54.790 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.785+0000 7f1227fff700 1 --2- 172.21.15.112:0/1040266764 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12280b28f0 0x7f12281e4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:54.790 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.785+0000 7f1227fff700 1 -- 172.21.15.112:0/1040266764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12280cdfb0 msgr2=0x7f12280b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:54.791 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.785+0000 7f1227fff700 1 --2- 172.21.15.112:0/1040266764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12280cdfb0 0x7f12280b1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:54.791 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.785+0000 7f1227fff700 1 -- 172.21.15.112:0/1040266764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1218009580 con 0x7f122815f480 2023-09-12T16:06:54.791 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.786+0000 7f1227fff700 1 --2- 172.21.15.112:0/1040266764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f122815f480 0x7f12280ca2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f122000cbc0 tx=0x7f122000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:54.792 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.786+0000 7f120ffff700 1 -- 172.21.15.112:0/1040266764 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1220003c00 con 0x7f122815f480 2023-09-12T16:06:54.792 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.786+0000 7f120ffff700 1 -- 172.21.15.112:0/1040266764 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1220003d60 con 0x7f122815f480 2023-09-12T16:06:54.792 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.786+0000 7f120ffff700 1 -- 172.21.15.112:0/1040266764 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122000ac10 con 0x7f122815f480 2023-09-12T16:06:54.792 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.786+0000 7f122e1ff700 1 -- 172.21.15.112:0/1040266764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12280ca830 con 0x7f122815f480 2023-09-12T16:06:54.792 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.786+0000 7f122e1ff700 1 -- 172.21.15.112:0/1040266764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12280cadb0 con 0x7f122815f480 2023-09-12T16:06:54.793 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.787+0000 7f122e1ff700 1 -- 172.21.15.112:0/1040266764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12281e5650 con 0x7f122815f480 2023-09-12T16:06:54.794 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.788+0000 7f120ffff700 1 -- 172.21.15.112:0/1040266764 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f12200050d0 con 0x7f122815f480 2023-09-12T16:06:54.794 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.789+0000 7f120ffff700 1 --2- 172.21.15.112:0/1040266764 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f121406a580 0x7f121406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:54.794 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.789+0000 7f120ffff700 1 -- 172.21.15.112:0/1040266764 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1220088860 con 0x7f122815f480 2023-09-12T16:06:54.794 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.789+0000 7f12277fe700 1 --2- 172.21.15.112:0/1040266764 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f121406a580 0x7f121406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:54.795 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.790+0000 7f12277fe700 1 --2- 172.21.15.112:0/1040266764 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f121406a580 0x7f121406ca40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1218000c00 tx=0x7f1218004750 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:54.795 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.794+0000 7f120ffff700 1 -- 172.21.15.112:0/1040266764 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f12281e5650 con 0x7f122815f480 2023-09-12T16:06:54.997 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.996+0000 7f122e1ff700 1 -- 172.21.15.112:0/1040266764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12281e5650 con 0x7f122815f480 2023-09-12T16:06:54.998 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.997+0000 7f120ffff700 1 -- 172.21.15.112:0/1040266764 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12886 (secure 0 0 0) 0x7f12281e5650 con 0x7f122815f480 2023-09-12T16:06:54.998 INFO:teuthology.misc.health.smithi112.stdout: 2023-09-12T16:06:54.998 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":16,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:06:51.088391+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:06:55.000 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.999+0000 7f122e1ff700 1 -- 172.21.15.112:0/1040266764 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f121406a580 msgr2=0x7f121406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:55.000 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.999+0000 7f122e1ff700 1 --2- 172.21.15.112:0/1040266764 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f121406a580 0x7f121406ca40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1218000c00 tx=0x7f1218004750 comp rx=0 tx=0).stop 2023-09-12T16:06:55.000 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.999+0000 7f122e1ff700 1 -- 172.21.15.112:0/1040266764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f122815f480 msgr2=0x7f12280ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:55.001 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.999+0000 7f122e1ff700 1 --2- 172.21.15.112:0/1040266764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f122815f480 0x7f12280ca2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f122000cbc0 tx=0x7f122000cf80 comp rx=0 tx=0).stop 2023-09-12T16:06:55.001 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.999+0000 7f122e1ff700 1 -- 172.21.15.112:0/1040266764 shutdown_connections 2023-09-12T16:06:55.001 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.999+0000 7f122e1ff700 1 --2- 172.21.15.112:0/1040266764 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f121406a580 0x7f121406ca40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:55.001 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.999+0000 7f122e1ff700 1 --2- 172.21.15.112:0/1040266764 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12280b28f0 0x7f12281e4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:55.002 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.999+0000 7f122e1ff700 1 --2- 172.21.15.112:0/1040266764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f122815f480 0x7f12280ca2f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:55.002 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.999+0000 7f122e1ff700 1 --2- 172.21.15.112:0/1040266764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12280cdfb0 0x7f12280b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:55.002 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.999+0000 7f122e1ff700 1 -- 172.21.15.112:0/1040266764 >> 172.21.15.112:0/1040266764 conn(0x7f12280d1930 msgr2=0x7f122815c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:55.002 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.999+0000 7f122e1ff700 1 -- 172.21.15.112:0/1040266764 shutdown_connections 2023-09-12T16:06:55.003 INFO:teuthology.misc.health.smithi112.stderr:2023-09-12T16:06:54.999+0000 7f122e1ff700 1 -- 172.21.15.112:0/1040266764 wait complete. 2023-09-12T16:06:55.015 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-09-12T16:06:55.015 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-09-12T16:06:55.016 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-12T16:06:55.016 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-12T16:06:55.021 INFO:tasks.ceph.mds.a:Started 2023-09-12T16:06:55.021 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-12T16:06:55.022 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-12T16:06:55.026 INFO:tasks.ceph.mds.c:Started 2023-09-12T16:06:55.026 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-12T16:06:55.026 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-12T16:06:55.031 INFO:tasks.ceph.mds.b:Started 2023-09-12T16:06:55.031 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-12T16:06:55.032 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-12T16:06:55.036 INFO:tasks.ceph.mds.d:Started 2023-09-12T16:06:55.037 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-09-12T16:06:55.037 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:06:55.173 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2023-09-12T16:06:55.174 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2023-09-12T16:06:55.188 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-09-12T16:06:55.189 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-09-12T16:06:55.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.252+0000 7f6cf5fff700 1 -- 172.21.15.112:0/3962334392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cf00d0590 msgr2=0x7f6cf00cc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:55.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.252+0000 7f6cf5fff700 1 --2- 172.21.15.112:0/3962334392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cf00d0590 0x7f6cf00cc8f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0089340 tx=0x7f6ce800b380 comp rx=0 tx=0).stop 2023-09-12T16:06:55.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.252+0000 7f6cf5fff700 1 -- 172.21.15.112:0/3962334392 shutdown_connections 2023-09-12T16:06:55.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.252+0000 7f6cf5fff700 1 --2- 172.21.15.112:0/3962334392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cf00d0590 0x7f6cf00cc8f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:55.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.252+0000 7f6cf5fff700 1 --2- 172.21.15.112:0/3962334392 >> v2:172.21.15.144:3300/0 conn(0x7f6cf00cdfb0 0x7f6cf00cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:55.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.252+0000 7f6cf5fff700 1 -- 172.21.15.112:0/3962334392 >> 172.21.15.112:0/3962334392 conn(0x7f6cf00d1930 msgr2=0x7f6cf00d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:55.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.252+0000 7f6cf5fff700 1 -- 172.21.15.112:0/3962334392 shutdown_connections 2023-09-12T16:06:55.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.252+0000 7f6cf5fff700 1 -- 172.21.15.112:0/3962334392 wait complete. 2023-09-12T16:06:55.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.254+0000 7f6cf5fff700 1 Processor -- start 2023-09-12T16:06:55.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.254+0000 7f6cf5fff700 1 -- start start 2023-09-12T16:06:55.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.255+0000 7f6cf5fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cf00cdfb0 0x7f6cf0153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:55.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.255+0000 7f6cf5fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cf00d0590 0x7f6cf01f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:55.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.255+0000 7f6cf5fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6cf015f480 0x7f6cf01f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:55.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.255+0000 7f6cf5fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf0153cb0 con 0x7f6cf00cdfb0 2023-09-12T16:06:55.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.255+0000 7f6cf5fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf00c90f0 con 0x7f6cf00d0590 2023-09-12T16:06:55.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.255+0000 7f6cf5fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf00ca7b0 con 0x7f6cf015f480 2023-09-12T16:06:55.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.255+0000 7f6cef7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cf00cdfb0 0x7f6cf0153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:55.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.255+0000 7f6cef7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cf00cdfb0 0x7f6cf0153770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54660/0 (socket says 172.21.15.112:54660) 2023-09-12T16:06:55.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.255+0000 7f6cef7fe700 1 -- 172.21.15.112:0/4057025677 learned_addr learned my addr 172.21.15.112:0/4057025677 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:55.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.255+0000 7f6ceeffd700 1 --2- 172.21.15.112:0/4057025677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cf00d0590 0x7f6cf01f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:55.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.255+0000 7f6ceffff700 1 --2- 172.21.15.112:0/4057025677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6cf015f480 0x7f6cf01f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:55.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.256+0000 7f6cef7fe700 1 -- 172.21.15.112:0/4057025677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6cf015f480 msgr2=0x7f6cf01f5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:55.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.256+0000 7f6cef7fe700 1 --2- 172.21.15.112:0/4057025677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6cf015f480 0x7f6cf01f5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:55.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.256+0000 7f6cef7fe700 1 -- 172.21.15.112:0/4057025677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cf00d0590 msgr2=0x7f6cf01f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:55.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.256+0000 7f6cef7fe700 1 --2- 172.21.15.112:0/4057025677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cf00d0590 0x7f6cf01f5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:55.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.256+0000 7f6cef7fe700 1 -- 172.21.15.112:0/4057025677 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce8009d00 con 0x7f6cf00cdfb0 2023-09-12T16:06:55.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.256+0000 7f6cef7fe700 1 --2- 172.21.15.112:0/4057025677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cf00cdfb0 0x7f6cf0153770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000c4d0 tx=0x7f6ce000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:55.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.256+0000 7f6cd7fff700 1 -- 172.21.15.112:0/4057025677 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce00052d0 con 0x7f6cf00cdfb0 2023-09-12T16:06:55.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.256+0000 7f6cd7fff700 1 -- 172.21.15.112:0/4057025677 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6ce0005520 con 0x7f6cf00cdfb0 2023-09-12T16:06:55.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.256+0000 7f6cd7fff700 1 -- 172.21.15.112:0/4057025677 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0003930 con 0x7f6cf00cdfb0 2023-09-12T16:06:55.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.256+0000 7f6cf5fff700 1 -- 172.21.15.112:0/4057025677 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf0154600 con 0x7f6cf00cdfb0 2023-09-12T16:06:55.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.256+0000 7f6cf5fff700 1 -- 172.21.15.112:0/4057025677 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf00cad30 con 0x7f6cf00cdfb0 2023-09-12T16:06:55.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.257+0000 7f6cf5fff700 1 -- 172.21.15.112:0/4057025677 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf004e300 con 0x7f6cf00cdfb0 2023-09-12T16:06:55.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.258+0000 7f6cd7fff700 1 -- 172.21.15.112:0/4057025677 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f6ce0003a90 con 0x7f6cf00cdfb0 2023-09-12T16:06:55.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.259+0000 7f6cd7fff700 1 --2- 172.21.15.112:0/4057025677 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6cdc06a580 0x7f6cdc06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:55.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.259+0000 7f6cd7fff700 1 -- 172.21.15.112:0/4057025677 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6ce0087d00 con 0x7f6cf00cdfb0 2023-09-12T16:06:55.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.259+0000 7f6ceeffd700 1 --2- 172.21.15.112:0/4057025677 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6cdc06a580 0x7f6cdc06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:55.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.260+0000 7f6ceeffd700 1 --2- 172.21.15.112:0/4057025677 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6cdc06a580 0x7f6cdc06ca40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4009c60 tx=0x7f6ce4009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:55.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.263+0000 7f6cd7fff700 1 -- 172.21.15.112:0/4057025677 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6ce00535c0 con 0x7f6cf00cdfb0 2023-09-12T16:06:55.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.461+0000 7f6cf5fff700 1 -- 172.21.15.112:0/4057025677 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6cf00b4300 con 0x7f6cf00cdfb0 2023-09-12T16:06:55.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.462+0000 7f6cd7fff700 1 -- 172.21.15.112:0/4057025677 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12886 (secure 0 0 0) 0x7f6ce0056be0 con 0x7f6cf00cdfb0 2023-09-12T16:06:55.462 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:06:55.462 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":16,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:06:51.088391+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:06:55.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.464+0000 7f6cf5fff700 1 -- 172.21.15.112:0/4057025677 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6cdc06a580 msgr2=0x7f6cdc06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:55.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.464+0000 7f6cf5fff700 1 --2- 172.21.15.112:0/4057025677 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6cdc06a580 0x7f6cdc06ca40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4009c60 tx=0x7f6ce4009260 comp rx=0 tx=0).stop 2023-09-12T16:06:55.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.464+0000 7f6cf5fff700 1 -- 172.21.15.112:0/4057025677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cf00cdfb0 msgr2=0x7f6cf0153770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:55.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.464+0000 7f6cf5fff700 1 --2- 172.21.15.112:0/4057025677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cf00cdfb0 0x7f6cf0153770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000c4d0 tx=0x7f6ce000c7e0 comp rx=0 tx=0).stop 2023-09-12T16:06:55.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.464+0000 7f6cf5fff700 1 -- 172.21.15.112:0/4057025677 shutdown_connections 2023-09-12T16:06:55.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.464+0000 7f6cf5fff700 1 --2- 172.21.15.112:0/4057025677 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6cdc06a580 0x7f6cdc06ca40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:55.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.464+0000 7f6cf5fff700 1 --2- 172.21.15.112:0/4057025677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6cf015f480 0x7f6cf01f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:55.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.464+0000 7f6cf5fff700 1 --2- 172.21.15.112:0/4057025677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cf00cdfb0 0x7f6cf0153770 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:55.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.464+0000 7f6cf5fff700 1 --2- 172.21.15.112:0/4057025677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cf00d0590 0x7f6cf01f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:55.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.464+0000 7f6cf5fff700 1 -- 172.21.15.112:0/4057025677 >> 172.21.15.112:0/4057025677 conn(0x7f6cf00d1930 msgr2=0x7f6cf00c7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:55.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.464+0000 7f6cf5fff700 1 -- 172.21.15.112:0/4057025677 shutdown_connections 2023-09-12T16:06:55.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.464+0000 7f6cf5fff700 1 -- 172.21.15.112:0/4057025677 wait complete. 2023-09-12T16:06:55.482 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-12T16:06:48.871680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-12T16:06:55.483 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-12T16:06:55.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.685+0000 7fa0da1ff700 1 -- 172.21.15.112:0/3472242343 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0d415bca0 msgr2=0x7fa0d415cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:55.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.685+0000 7fa0da1ff700 1 --2- 172.21.15.112:0/3472242343 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0d415bca0 0x7fa0d415cb90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4005fd0 tx=0x7fa0c4009c70 comp rx=0 tx=0).stop 2023-09-12T16:06:55.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.685+0000 7fa0da1ff700 1 -- 172.21.15.112:0/3472242343 shutdown_connections 2023-09-12T16:06:55.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.685+0000 7fa0da1ff700 1 --2- 172.21.15.112:0/3472242343 >> v2:172.21.15.144:3300/0 conn(0x7fa0d40cfdb0 0x7fa0d40d0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:55.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.685+0000 7fa0da1ff700 1 --2- 172.21.15.112:0/3472242343 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0d415bca0 0x7fa0d415cb90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:55.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.685+0000 7fa0da1ff700 1 -- 172.21.15.112:0/3472242343 >> 172.21.15.112:0/3472242343 conn(0x7fa0d40d17d0 msgr2=0x7fa0d40d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:55.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.685+0000 7fa0da1ff700 1 -- 172.21.15.112:0/3472242343 shutdown_connections 2023-09-12T16:06:55.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.685+0000 7fa0da1ff700 1 -- 172.21.15.112:0/3472242343 wait complete. 2023-09-12T16:06:55.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.687+0000 7fa0da1ff700 1 Processor -- start 2023-09-12T16:06:55.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.687+0000 7fa0da1ff700 1 -- start start 2023-09-12T16:06:55.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.688+0000 7fa0da1ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d40cfdb0 0x7fa0d414dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:55.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.688+0000 7fa0da1ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0d415bca0 0x7fa0d40c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:55.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.688+0000 7fa0da1ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0d40c5300 0x7fa0d41f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:55.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.688+0000 7fa0da1ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d41e5a50 con 0x7fa0d415bca0 2023-09-12T16:06:55.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.688+0000 7fa0da1ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d40c5a70 con 0x7fa0d40cfdb0 2023-09-12T16:06:55.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.688+0000 7fa0da1ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d40c57b0 con 0x7fa0d40c5300 2023-09-12T16:06:55.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.688+0000 7fa0d2ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0d415bca0 0x7fa0d40c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:55.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.688+0000 7fa0d2ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0d415bca0 0x7fa0d40c82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54666/0 (socket says 172.21.15.112:54666) 2023-09-12T16:06:55.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.688+0000 7fa0d2ffd700 1 -- 172.21.15.112:0/2363973169 learned_addr learned my addr 172.21.15.112:0/2363973169 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:55.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.688+0000 7fa0d37fe700 1 --2- 172.21.15.112:0/2363973169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d40cfdb0 0x7fa0d414dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:55.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.688+0000 7fa0d3fff700 1 --2- 172.21.15.112:0/2363973169 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0d40c5300 0x7fa0d41f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:55.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.688+0000 7fa0d2ffd700 1 -- 172.21.15.112:0/2363973169 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0d40c5300 msgr2=0x7fa0d41f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:55.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.688+0000 7fa0d2ffd700 1 --2- 172.21.15.112:0/2363973169 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0d40c5300 0x7fa0d41f5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:55.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.688+0000 7fa0d2ffd700 1 -- 172.21.15.112:0/2363973169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d40cfdb0 msgr2=0x7fa0d414dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:55.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.688+0000 7fa0d2ffd700 1 --2- 172.21.15.112:0/2363973169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d40cfdb0 0x7fa0d414dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:55.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.688+0000 7fa0d2ffd700 1 -- 172.21.15.112:0/2363973169 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c40095f0 con 0x7fa0d415bca0 2023-09-12T16:06:55.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.688+0000 7fa0d37fe700 1 --2- 172.21.15.112:0/2363973169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d40cfdb0 0x7fa0d414dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-12T16:06:55.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.689+0000 7fa0d2ffd700 1 --2- 172.21.15.112:0/2363973169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0d415bca0 0x7fa0d40c82b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800c4e0 tx=0x7fa0c800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:55.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.689+0000 7fa0bbfff700 1 -- 172.21.15.112:0/2363973169 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c80052d0 con 0x7fa0d415bca0 2023-09-12T16:06:55.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.689+0000 7fa0bbfff700 1 -- 172.21.15.112:0/2363973169 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa0c8005520 con 0x7fa0d415bca0 2023-09-12T16:06:55.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.689+0000 7fa0da1ff700 1 -- 172.21.15.112:0/2363973169 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d41e50b0 con 0x7fa0d415bca0 2023-09-12T16:06:55.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.689+0000 7fa0bbfff700 1 -- 172.21.15.112:0/2363973169 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c80038e0 con 0x7fa0d415bca0 2023-09-12T16:06:55.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.689+0000 7fa0da1ff700 1 -- 172.21.15.112:0/2363973169 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d41e5670 con 0x7fa0d415bca0 2023-09-12T16:06:55.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.690+0000 7fa0da1ff700 1 -- 172.21.15.112:0/2363973169 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d4073ea0 con 0x7fa0d415bca0 2023-09-12T16:06:55.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.691+0000 7fa0bbfff700 1 -- 172.21.15.112:0/2363973169 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fa0c8003a40 con 0x7fa0d415bca0 2023-09-12T16:06:55.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.692+0000 7fa0bbfff700 1 --2- 172.21.15.112:0/2363973169 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa0c006a580 0x7fa0c006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:55.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.692+0000 7fa0bbfff700 1 -- 172.21.15.112:0/2363973169 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa0c8087bf0 con 0x7fa0d415bca0 2023-09-12T16:06:55.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.692+0000 7fa0d37fe700 1 --2- 172.21.15.112:0/2363973169 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa0c006a580 0x7fa0c006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:55.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.693+0000 7fa0d37fe700 1 --2- 172.21.15.112:0/2363973169 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa0c006a580 0x7fa0c006ca40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40098e0 tx=0x7fa0c4019040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:55.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.696+0000 7fa0bbfff700 1 -- 172.21.15.112:0/2363973169 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fa0c80534b0 con 0x7fa0d415bca0 2023-09-12T16:06:55.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.893+0000 7fa0da1ff700 1 -- 172.21.15.112:0/2363973169 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa0d40d0740 con 0x7fa0d415bca0 2023-09-12T16:06:55.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.894+0000 7fa0bbfff700 1 -- 172.21.15.112:0/2363973169 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa0c8017020 con 0x7fa0d415bca0 2023-09-12T16:06:55.894 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-09-12T16:06:55.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.896+0000 7fa0da1ff700 1 -- 172.21.15.112:0/2363973169 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa0c006a580 msgr2=0x7fa0c006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:55.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.896+0000 7fa0da1ff700 1 --2- 172.21.15.112:0/2363973169 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa0c006a580 0x7fa0c006ca40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40098e0 tx=0x7fa0c4019040 comp rx=0 tx=0).stop 2023-09-12T16:06:55.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.896+0000 7fa0da1ff700 1 -- 172.21.15.112:0/2363973169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0d415bca0 msgr2=0x7fa0d40c82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:55.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.896+0000 7fa0da1ff700 1 --2- 172.21.15.112:0/2363973169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0d415bca0 0x7fa0d40c82b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800c4e0 tx=0x7fa0c800c7f0 comp rx=0 tx=0).stop 2023-09-12T16:06:55.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.896+0000 7fa0da1ff700 1 -- 172.21.15.112:0/2363973169 shutdown_connections 2023-09-12T16:06:55.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.896+0000 7fa0da1ff700 1 --2- 172.21.15.112:0/2363973169 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa0c006a580 0x7fa0c006ca40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:55.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.896+0000 7fa0da1ff700 1 --2- 172.21.15.112:0/2363973169 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0d40c5300 0x7fa0d41f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:55.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.896+0000 7fa0da1ff700 1 --2- 172.21.15.112:0/2363973169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d40cfdb0 0x7fa0d414dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:55.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.896+0000 7fa0da1ff700 1 --2- 172.21.15.112:0/2363973169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0d415bca0 0x7fa0d40c82b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:55.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.896+0000 7fa0da1ff700 1 -- 172.21.15.112:0/2363973169 >> 172.21.15.112:0/2363973169 conn(0x7fa0d40d17d0 msgr2=0x7fa0d40afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:55.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.896+0000 7fa0da1ff700 1 -- 172.21.15.112:0/2363973169 shutdown_connections 2023-09-12T16:06:55.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:55.896+0000 7fa0da1ff700 1 -- 172.21.15.112:0/2363973169 wait complete. 2023-09-12T16:06:55.914 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-12T16:06:56.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.112+0000 7f605b1ff700 1 -- 172.21.15.112:0/242851289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60540cdfb0 msgr2=0x7f60540cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:56.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.112+0000 7f605b1ff700 1 --2- 172.21.15.112:0/242851289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60540cdfb0 0x7f60540cc3b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6040005fd0 tx=0x7f6040009c70 comp rx=0 tx=0).stop 2023-09-12T16:06:56.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.112+0000 7f605b1ff700 1 -- 172.21.15.112:0/242851289 shutdown_connections 2023-09-12T16:06:56.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.112+0000 7f605b1ff700 1 --2- 172.21.15.112:0/242851289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60540d0590 0x7f60540cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:56.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.112+0000 7f605b1ff700 1 --2- 172.21.15.112:0/242851289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60540cdfb0 0x7f60540cc3b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:56.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.112+0000 7f605b1ff700 1 -- 172.21.15.112:0/242851289 >> 172.21.15.112:0/242851289 conn(0x7f60540d1930 msgr2=0x7f60540d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:56.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.112+0000 7f605b1ff700 1 -- 172.21.15.112:0/242851289 shutdown_connections 2023-09-12T16:06:56.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.112+0000 7f605b1ff700 1 -- 172.21.15.112:0/242851289 wait complete. 2023-09-12T16:06:56.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.114+0000 7f605b1ff700 1 Processor -- start 2023-09-12T16:06:56.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.115+0000 7f605b1ff700 1 -- start start 2023-09-12T16:06:56.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.116+0000 7f605b1ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60540cdfb0 0x7f60540b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:56.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.116+0000 7f605b1ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60540d0590 0x7f605415ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:56.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.116+0000 7f605b1ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605415f480 0x7f60541f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:56.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.116+0000 7f605b1ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60540ae530 con 0x7f60540cdfb0 2023-09-12T16:06:56.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.116+0000 7f605b1ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60541f6330 con 0x7f605415f480 2023-09-12T16:06:56.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.116+0000 7f605b1ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60540b45c0 con 0x7f60540d0590 2023-09-12T16:06:56.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.116+0000 7f6058f9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60540cdfb0 0x7f60540b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:56.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.116+0000 7f6058f9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60540cdfb0 0x7f60540b50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55770/0 (socket says 172.21.15.112:55770) 2023-09-12T16:06:56.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.116+0000 7f6058f9b700 1 -- 172.21.15.112:0/1438548256 learned_addr learned my addr 172.21.15.112:0/1438548256 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:56.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.116+0000 7f6053fff700 1 --2- 172.21.15.112:0/1438548256 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60540d0590 0x7f605415ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:56.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.116+0000 7f605979c700 1 --2- 172.21.15.112:0/1438548256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605415f480 0x7f60541f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:56.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.116+0000 7f6058f9b700 1 -- 172.21.15.112:0/1438548256 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60540d0590 msgr2=0x7f605415ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:56.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.116+0000 7f6058f9b700 1 --2- 172.21.15.112:0/1438548256 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60540d0590 0x7f605415ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:56.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.116+0000 7f6058f9b700 1 -- 172.21.15.112:0/1438548256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605415f480 msgr2=0x7f60541f57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:56.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.116+0000 7f6058f9b700 1 --2- 172.21.15.112:0/1438548256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605415f480 0x7f60541f57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:56.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.116+0000 7f6058f9b700 1 -- 172.21.15.112:0/1438548256 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60400095f0 con 0x7f60540cdfb0 2023-09-12T16:06:56.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.117+0000 7f6058f9b700 1 --2- 172.21.15.112:0/1438548256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60540cdfb0 0x7f60540b50a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f604800c480 tx=0x7f604800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:56.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.117+0000 7f60517fa700 1 -- 172.21.15.112:0/1438548256 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60480054e0 con 0x7f60540cdfb0 2023-09-12T16:06:56.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.117+0000 7f60517fa700 1 -- 172.21.15.112:0/1438548256 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6048003680 con 0x7f60540cdfb0 2023-09-12T16:06:56.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.117+0000 7f605b1ff700 1 -- 172.21.15.112:0/1438548256 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60540b2ba0 con 0x7f60540cdfb0 2023-09-12T16:06:56.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.117+0000 7f60517fa700 1 -- 172.21.15.112:0/1438548256 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6048003a90 con 0x7f60540cdfb0 2023-09-12T16:06:56.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.117+0000 7f605b1ff700 1 -- 172.21.15.112:0/1438548256 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60540b4950 con 0x7f60540cdfb0 2023-09-12T16:06:56.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.118+0000 7f605b1ff700 1 -- 172.21.15.112:0/1438548256 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60540b4ef0 con 0x7f60540cdfb0 2023-09-12T16:06:56.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.119+0000 7f60517fa700 1 -- 172.21.15.112:0/1438548256 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f6048003bf0 con 0x7f60540cdfb0 2023-09-12T16:06:56.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.120+0000 7f60517fa700 1 --2- 172.21.15.112:0/1438548256 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f603806a580 0x7f603806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:56.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.120+0000 7f60517fa700 1 -- 172.21.15.112:0/1438548256 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6048087df0 con 0x7f60540cdfb0 2023-09-12T16:06:56.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.120+0000 7f6053fff700 1 --2- 172.21.15.112:0/1438548256 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f603806a580 0x7f603806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:56.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.121+0000 7f6053fff700 1 --2- 172.21.15.112:0/1438548256 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f603806a580 0x7f603806ca40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f60400098e0 tx=0x7f60400047c0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:56.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.124+0000 7f60517fa700 1 -- 172.21.15.112:0/1438548256 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6048053630 con 0x7f60540cdfb0 2023-09-12T16:06:56.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.369+0000 7f605b1ff700 1 -- 172.21.15.112:0/1438548256 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f605404e300 con 0x7f60540cdfb0 2023-09-12T16:06:56.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.369+0000 7f60517fa700 1 -- 172.21.15.112:0/1438548256 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3706 (secure 0 0 0) 0x7f6048017030 con 0x7f60540cdfb0 2023-09-12T16:06:56.370 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:06:56.370 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3995117138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3995117138},{"type":"v1","addr":"172.21.15.112:6836","nonce":3995117138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3233826602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3233826602},{"type":"v1","addr":"172.21.15.112:6837","nonce":3233826602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1854265710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1854265710},{"type":"v1","addr":"172.21.15.144:6834","nonce":1854265710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4396,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2785398652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2785398652},{"type":"v1","addr":"172.21.15.144:6835","nonce":2785398652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-09-12T16:06:56.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.372+0000 7f605b1ff700 1 -- 172.21.15.112:0/1438548256 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f603806a580 msgr2=0x7f603806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:56.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.372+0000 7f605b1ff700 1 --2- 172.21.15.112:0/1438548256 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f603806a580 0x7f603806ca40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f60400098e0 tx=0x7f60400047c0 comp rx=0 tx=0).stop 2023-09-12T16:06:56.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.372+0000 7f605b1ff700 1 -- 172.21.15.112:0/1438548256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60540cdfb0 msgr2=0x7f60540b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:56.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.372+0000 7f605b1ff700 1 --2- 172.21.15.112:0/1438548256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60540cdfb0 0x7f60540b50a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f604800c480 tx=0x7f604800c840 comp rx=0 tx=0).stop 2023-09-12T16:06:56.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.372+0000 7f605b1ff700 1 -- 172.21.15.112:0/1438548256 shutdown_connections 2023-09-12T16:06:56.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.372+0000 7f605b1ff700 1 --2- 172.21.15.112:0/1438548256 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f603806a580 0x7f603806ca40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:56.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.372+0000 7f605b1ff700 1 --2- 172.21.15.112:0/1438548256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605415f480 0x7f60541f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:56.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.372+0000 7f605b1ff700 1 --2- 172.21.15.112:0/1438548256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60540cdfb0 0x7f60540b50a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:56.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.372+0000 7f605b1ff700 1 --2- 172.21.15.112:0/1438548256 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60540d0590 0x7f605415ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:56.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.372+0000 7f605b1ff700 1 -- 172.21.15.112:0/1438548256 >> 172.21.15.112:0/1438548256 conn(0x7f60540d1930 msgr2=0x7f60541e66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:56.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.372+0000 7f605b1ff700 1 -- 172.21.15.112:0/1438548256 shutdown_connections 2023-09-12T16:06:56.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.372+0000 7f605b1ff700 1 -- 172.21.15.112:0/1438548256 wait complete. 2023-09-12T16:06:56.374 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 3 2023-09-12T16:06:56.390 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:06:56.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.589+0000 7fb16b5ff700 1 -- 172.21.15.112:0/2053616827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb150003a00 msgr2=0x7fb150003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:56.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.589+0000 7fb16b5ff700 1 --2- 172.21.15.112:0/2053616827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb150003a00 0x7fb150003e20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb160009bd0 tx=0x7fb150005880 comp rx=0 tx=0).stop 2023-09-12T16:06:56.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.589+0000 7fb169b9c700 1 -- 172.21.15.112:0/2053616827 reap_dead start 2023-09-12T16:06:56.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.589+0000 7fb16b5ff700 1 -- 172.21.15.112:0/2053616827 shutdown_connections 2023-09-12T16:06:56.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.589+0000 7fb16b5ff700 1 -- 172.21.15.112:0/2053616827 >> 172.21.15.112:0/2053616827 conn(0x7fb1640d1930 msgr2=0x7fb1640d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:56.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.589+0000 7fb16b5ff700 1 -- 172.21.15.112:0/2053616827 shutdown_connections 2023-09-12T16:06:56.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.589+0000 7fb16b5ff700 1 -- 172.21.15.112:0/2053616827 wait complete. 2023-09-12T16:06:56.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.591+0000 7fb16b5ff700 1 Processor -- start 2023-09-12T16:06:56.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.592+0000 7fb16b5ff700 1 -- start start 2023-09-12T16:06:56.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.593+0000 7fb16b5ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb150003a00 0x7fb1641570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:56.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.593+0000 7fb16b5ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb164155570 0x7fb1640b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:56.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.593+0000 7fb16b5ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb164158960 0x7fb164158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:56.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.593+0000 7fb16b5ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb164159350 con 0x7fb164158960 2023-09-12T16:06:56.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.593+0000 7fb16b5ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb164156470 con 0x7fb150003a00 2023-09-12T16:06:56.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.593+0000 7fb16b5ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640b7840 con 0x7fb164155570 2023-09-12T16:06:56.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.593+0000 7fb169b9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb164158960 0x7fb164158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:56.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.593+0000 7fb169b9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb164158960 0x7fb164158e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55784/0 (socket says 172.21.15.112:55784) 2023-09-12T16:06:56.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.593+0000 7fb169b9c700 1 -- 172.21.15.112:0/2069445919 learned_addr learned my addr 172.21.15.112:0/2069445919 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:56.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.593+0000 7fb168b9a700 1 --2- 172.21.15.112:0/2069445919 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb164155570 0x7fb1640b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:56.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.593+0000 7fb16939b700 1 --2- 172.21.15.112:0/2069445919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb150003a00 0x7fb1641570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:56.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.593+0000 7fb169b9c700 1 -- 172.21.15.112:0/2069445919 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb164155570 msgr2=0x7fb1640b7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:56.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.593+0000 7fb169b9c700 1 --2- 172.21.15.112:0/2069445919 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb164155570 0x7fb1640b7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:56.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.593+0000 7fb169b9c700 1 -- 172.21.15.112:0/2069445919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb150003a00 msgr2=0x7fb1641570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:56.597 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.593+0000 7fb169b9c700 1 --2- 172.21.15.112:0/2069445919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb150003a00 0x7fb1641570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:56.597 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.593+0000 7fb169b9c700 1 -- 172.21.15.112:0/2069445919 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1641559f0 con 0x7fb164158960 2023-09-12T16:06:56.597 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.594+0000 7fb169b9c700 1 --2- 172.21.15.112:0/2069445919 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb164158960 0x7fb164158e10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb16408bbe0 tx=0x7fb15c0104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:56.597 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.594+0000 7fb159ffb700 1 -- 172.21.15.112:0/2069445919 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c00e070 con 0x7fb164158960 2023-09-12T16:06:56.597 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.594+0000 7fb159ffb700 1 -- 172.21.15.112:0/2069445919 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb15c00f040 con 0x7fb164158960 2023-09-12T16:06:56.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.594+0000 7fb159ffb700 1 -- 172.21.15.112:0/2069445919 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c010c90 con 0x7fb164158960 2023-09-12T16:06:56.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.594+0000 7fb16b5ff700 1 -- 172.21.15.112:0/2069445919 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1641576d0 con 0x7fb164158960 2023-09-12T16:06:56.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.594+0000 7fb16b5ff700 1 -- 172.21.15.112:0/2069445919 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb164157c90 con 0x7fb164158960 2023-09-12T16:06:56.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.595+0000 7fb16b5ff700 1 -- 172.21.15.112:0/2069445919 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb16404e300 con 0x7fb164158960 2023-09-12T16:06:56.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.596+0000 7fb159ffb700 1 -- 172.21.15.112:0/2069445919 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fb15c004030 con 0x7fb164158960 2023-09-12T16:06:56.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.597+0000 7fb159ffb700 1 --2- 172.21.15.112:0/2069445919 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb14806a580 0x7fb14806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:56.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.597+0000 7fb159ffb700 1 -- 172.21.15.112:0/2069445919 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb15c0884c0 con 0x7fb164158960 2023-09-12T16:06:56.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.597+0000 7fb16939b700 1 --2- 172.21.15.112:0/2069445919 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb14806a580 0x7fb14806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:56.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.598+0000 7fb16939b700 1 --2- 172.21.15.112:0/2069445919 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb14806a580 0x7fb14806ca40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb1641f5210 tx=0x7fb160004750 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:56.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.601+0000 7fb159ffb700 1 -- 172.21.15.112:0/2069445919 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb15c053d90 con 0x7fb164158960 2023-09-12T16:06:56.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.798+0000 7fb16b5ff700 1 -- 172.21.15.112:0/2069445919 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1640b4300 con 0x7fb164158960 2023-09-12T16:06:56.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.799+0000 7fb159ffb700 1 -- 172.21.15.112:0/2069445919 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12886 (secure 0 0 0) 0x7fb15c0573b0 con 0x7fb164158960 2023-09-12T16:06:56.799 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:06:56.799 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":16,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:06:51.088391+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:06:56.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.801+0000 7fb16b5ff700 1 -- 172.21.15.112:0/2069445919 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb14806a580 msgr2=0x7fb14806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:56.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.801+0000 7fb16b5ff700 1 --2- 172.21.15.112:0/2069445919 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb14806a580 0x7fb14806ca40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb1641f5210 tx=0x7fb160004750 comp rx=0 tx=0).stop 2023-09-12T16:06:56.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.801+0000 7fb16b5ff700 1 -- 172.21.15.112:0/2069445919 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb164158960 msgr2=0x7fb164158e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:56.803 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.801+0000 7fb16b5ff700 1 --2- 172.21.15.112:0/2069445919 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb164158960 0x7fb164158e10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb16408bbe0 tx=0x7fb15c0104a0 comp rx=0 tx=0).stop 2023-09-12T16:06:56.803 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.801+0000 7fb16b5ff700 1 -- 172.21.15.112:0/2069445919 shutdown_connections 2023-09-12T16:06:56.803 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.801+0000 7fb16b5ff700 1 --2- 172.21.15.112:0/2069445919 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb14806a580 0x7fb14806ca40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:56.803 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.801+0000 7fb16b5ff700 1 --2- 172.21.15.112:0/2069445919 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb164158960 0x7fb164158e10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:56.803 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.801+0000 7fb16b5ff700 1 --2- 172.21.15.112:0/2069445919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb150003a00 0x7fb1641570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:56.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.801+0000 7fb16b5ff700 1 --2- 172.21.15.112:0/2069445919 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb164155570 0x7fb1640b7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:56.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.801+0000 7fb16b5ff700 1 -- 172.21.15.112:0/2069445919 >> 172.21.15.112:0/2069445919 conn(0x7fb1640d1930 msgr2=0x7fb16415cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:56.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.802+0000 7fb16b5ff700 1 -- 172.21.15.112:0/2069445919 shutdown_connections 2023-09-12T16:06:56.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:56.802+0000 7fb16b5ff700 1 -- 172.21.15.112:0/2069445919 wait complete. 2023-09-12T16:06:56.819 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-12T16:06:48.871680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-12T16:06:56.820 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-12T16:06:57.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.019+0000 7fbcd6bff700 1 -- 172.21.15.112:0/15099066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcd00cfdb0 msgr2=0x7fbcd00d0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:57.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.019+0000 7fbcd6bff700 1 --2- 172.21.15.112:0/15099066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcd00cfdb0 0x7fbcd00d0200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009f60 tx=0x7fbcc8009f90 comp rx=0 tx=0).stop 2023-09-12T16:06:57.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.019+0000 7fbcd6bff700 1 -- 172.21.15.112:0/15099066 shutdown_connections 2023-09-12T16:06:57.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.019+0000 7fbcd6bff700 1 --2- 172.21.15.112:0/15099066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcd00cfdb0 0x7fbcd00d0200 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:57.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.019+0000 7fbcd6bff700 1 --2- 172.21.15.112:0/15099066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcd015bca0 0x7fbcd015cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:57.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.019+0000 7fbcd6bff700 1 -- 172.21.15.112:0/15099066 >> 172.21.15.112:0/15099066 conn(0x7fbcd00d17d0 msgr2=0x7fbcd00d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:57.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.019+0000 7fbcd6bff700 1 -- 172.21.15.112:0/15099066 shutdown_connections 2023-09-12T16:06:57.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.020+0000 7fbcd6bff700 1 -- 172.21.15.112:0/15099066 wait complete. 2023-09-12T16:06:57.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.021+0000 7fbcd6bff700 1 Processor -- start 2023-09-12T16:06:57.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.021+0000 7fbcd6bff700 1 -- start start 2023-09-12T16:06:57.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.022+0000 7fbcd6bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcd00cfdb0 0x7fbcd00c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:57.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.022+0000 7fbcd6bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbcd015bca0 0x7fbcd015aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:57.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.022+0000 7fbcd6bff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcd00b3c10 0x7fbcd01e2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:57.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.022+0000 7fbcd6bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd00c9c80 con 0x7fbcd00cfdb0 2023-09-12T16:06:57.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.022+0000 7fbcd6bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd00c6860 con 0x7fbcd015bca0 2023-09-12T16:06:57.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.022+0000 7fbcd6bff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd00c62a0 con 0x7fbcd00b3c10 2023-09-12T16:06:57.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.022+0000 7fbcd499b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcd00cfdb0 0x7fbcd00c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:57.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.022+0000 7fbcd499b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcd00cfdb0 0x7fbcd00c5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55808/0 (socket says 172.21.15.112:55808) 2023-09-12T16:06:57.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.022+0000 7fbcd499b700 1 -- 172.21.15.112:0/1780964405 learned_addr learned my addr 172.21.15.112:0/1780964405 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:57.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.023+0000 7fbcd519c700 1 --2- 172.21.15.112:0/1780964405 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcd00b3c10 0x7fbcd01e2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:57.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.023+0000 7fbccffff700 1 --2- 172.21.15.112:0/1780964405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbcd015bca0 0x7fbcd015aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:57.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.023+0000 7fbcd499b700 1 -- 172.21.15.112:0/1780964405 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcd00b3c10 msgr2=0x7fbcd01e2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:57.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.023+0000 7fbcd499b700 1 --2- 172.21.15.112:0/1780964405 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcd00b3c10 0x7fbcd01e2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:57.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.023+0000 7fbcd499b700 1 -- 172.21.15.112:0/1780964405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbcd015bca0 msgr2=0x7fbcd015aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:57.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.023+0000 7fbcd499b700 1 --2- 172.21.15.112:0/1780964405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbcd015bca0 0x7fbcd015aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:57.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.023+0000 7fbcd499b700 1 -- 172.21.15.112:0/1780964405 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc8009c40 con 0x7fbcd00cfdb0 2023-09-12T16:06:57.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.023+0000 7fbcd499b700 1 --2- 172.21.15.112:0/1780964405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcd00cfdb0 0x7fbcd00c5c10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400c920 tx=0x7fbcc400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:57.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.023+0000 7fbccd7fa700 1 -- 172.21.15.112:0/1780964405 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4007b00 con 0x7fbcd00cfdb0 2023-09-12T16:06:57.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.023+0000 7fbccd7fa700 1 -- 172.21.15.112:0/1780964405 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbcc4007d50 con 0x7fbcd00cfdb0 2023-09-12T16:06:57.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.023+0000 7fbcd6bff700 1 -- 172.21.15.112:0/1780964405 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd00c6580 con 0x7fbcd00cfdb0 2023-09-12T16:06:57.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.023+0000 7fbccd7fa700 1 -- 172.21.15.112:0/1780964405 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc40186e0 con 0x7fbcd00cfdb0 2023-09-12T16:06:57.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.023+0000 7fbcd6bff700 1 -- 172.21.15.112:0/1780964405 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd00b40c0 con 0x7fbcd00cfdb0 2023-09-12T16:06:57.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.024+0000 7fbcd6bff700 1 -- 172.21.15.112:0/1780964405 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd00c9ae0 con 0x7fbcd00cfdb0 2023-09-12T16:06:57.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.025+0000 7fbccd7fa700 1 -- 172.21.15.112:0/1780964405 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fbcc4018840 con 0x7fbcd00cfdb0 2023-09-12T16:06:57.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.026+0000 7fbccd7fa700 1 --2- 172.21.15.112:0/1780964405 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbcb406a580 0x7fbcb406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:57.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.026+0000 7fbccd7fa700 1 -- 172.21.15.112:0/1780964405 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbcc4013070 con 0x7fbcd00cfdb0 2023-09-12T16:06:57.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.027+0000 7fbccffff700 1 --2- 172.21.15.112:0/1780964405 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbcb406a580 0x7fbcb406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:57.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.027+0000 7fbccffff700 1 --2- 172.21.15.112:0/1780964405 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbcb406a580 0x7fbcb406ca40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc007fd0 tx=0x7fbcbc009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:57.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.030+0000 7fbccd7fa700 1 -- 172.21.15.112:0/1780964405 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fbcd00c9ae0 con 0x7fbcd00cfdb0 2023-09-12T16:06:57.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.226+0000 7fbcd6bff700 1 -- 172.21.15.112:0/1780964405 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbcd00c9ae0 con 0x7fbcd00cfdb0 2023-09-12T16:06:57.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.227+0000 7fbccd7fa700 1 -- 172.21.15.112:0/1780964405 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbcd00c9ae0 con 0x7fbcd00cfdb0 2023-09-12T16:06:57.228 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-09-12T16:06:57.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.229+0000 7fbcd6bff700 1 -- 172.21.15.112:0/1780964405 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbcb406a580 msgr2=0x7fbcb406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:57.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.229+0000 7fbcd6bff700 1 --2- 172.21.15.112:0/1780964405 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbcb406a580 0x7fbcb406ca40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc007fd0 tx=0x7fbcbc009040 comp rx=0 tx=0).stop 2023-09-12T16:06:57.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.229+0000 7fbcd6bff700 1 -- 172.21.15.112:0/1780964405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcd00cfdb0 msgr2=0x7fbcd00c5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:57.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.229+0000 7fbcd6bff700 1 --2- 172.21.15.112:0/1780964405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcd00cfdb0 0x7fbcd00c5c10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400c920 tx=0x7fbcc400cce0 comp rx=0 tx=0).stop 2023-09-12T16:06:57.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.230+0000 7fbcd6bff700 1 -- 172.21.15.112:0/1780964405 shutdown_connections 2023-09-12T16:06:57.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.230+0000 7fbcd6bff700 1 --2- 172.21.15.112:0/1780964405 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbcb406a580 0x7fbcb406ca40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:57.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.230+0000 7fbcd6bff700 1 --2- 172.21.15.112:0/1780964405 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcd00b3c10 0x7fbcd01e2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:57.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.230+0000 7fbcd6bff700 1 --2- 172.21.15.112:0/1780964405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcd00cfdb0 0x7fbcd00c5c10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:57.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.230+0000 7fbcd6bff700 1 --2- 172.21.15.112:0/1780964405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbcd015bca0 0x7fbcd015aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:57.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.230+0000 7fbcd6bff700 1 -- 172.21.15.112:0/1780964405 >> 172.21.15.112:0/1780964405 conn(0x7fbcd00d17d0 msgr2=0x7fbcd00b5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:57.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.230+0000 7fbcd6bff700 1 -- 172.21.15.112:0/1780964405 shutdown_connections 2023-09-12T16:06:57.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.230+0000 7fbcd6bff700 1 -- 172.21.15.112:0/1780964405 wait complete. 2023-09-12T16:06:57.250 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-12T16:06:57.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.451+0000 7f00a4d9d700 1 -- 172.21.15.112:0/3153747676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0088004d90 msgr2=0x7f0088005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:57.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.451+0000 7f00a4d9d700 1 --2- 172.21.15.112:0/3153747676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0088004d90 0x7f0088005210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f00a00b43e0 tx=0x7f0088005880 comp rx=0 tx=0).stop 2023-09-12T16:06:57.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.451+0000 7f009ffff700 1 -- 172.21.15.112:0/3153747676 reap_dead start 2023-09-12T16:06:57.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.451+0000 7f00a4d9d700 1 -- 172.21.15.112:0/3153747676 shutdown_connections 2023-09-12T16:06:57.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.451+0000 7f00a4d9d700 1 -- 172.21.15.112:0/3153747676 >> 172.21.15.112:0/3153747676 conn(0x7f00a0071d80 msgr2=0x7f00a00d1500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:57.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.451+0000 7f00a4d9d700 1 -- 172.21.15.112:0/3153747676 shutdown_connections 2023-09-12T16:06:57.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.451+0000 7f00a4d9d700 1 -- 172.21.15.112:0/3153747676 wait complete. 2023-09-12T16:06:57.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.453+0000 7f00a4d9d700 1 Processor -- start 2023-09-12T16:06:57.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.453+0000 7f00a4d9d700 1 -- start start 2023-09-12T16:06:57.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.454+0000 7f00a4d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0088004d90 0x7f00a00c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:57.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.454+0000 7f00a4d9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00a00b18e0 0x7f00a00b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:57.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.454+0000 7f00a4d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00a00c90f0 0x7f00a014d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:57.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.454+0000 7f00a4d9d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a00c5a30 con 0x7f00a00c90f0 2023-09-12T16:06:57.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.454+0000 7f00a4d9d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a00c50d0 con 0x7f0088004d90 2023-09-12T16:06:57.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.454+0000 7f00a4d9d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a00c5370 con 0x7f00a00b18e0 2023-09-12T16:06:57.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.454+0000 7f009ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00a00c90f0 0x7f00a014d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:57.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.454+0000 7f009ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00a00c90f0 0x7f00a014d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55818/0 (socket says 172.21.15.112:55818) 2023-09-12T16:06:57.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.454+0000 7f009ffff700 1 -- 172.21.15.112:0/2098369255 learned_addr learned my addr 172.21.15.112:0/2098369255 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:57.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.454+0000 7f009effd700 1 --2- 172.21.15.112:0/2098369255 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00a00b18e0 0x7f00a00b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:57.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.454+0000 7f009f7fe700 1 --2- 172.21.15.112:0/2098369255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0088004d90 0x7f00a00c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:57.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.454+0000 7f009ffff700 1 -- 172.21.15.112:0/2098369255 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00a00b18e0 msgr2=0x7f00a00b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:57.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.454+0000 7f009ffff700 1 --2- 172.21.15.112:0/2098369255 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00a00b18e0 0x7f00a00b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:57.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.454+0000 7f009ffff700 1 -- 172.21.15.112:0/2098369255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0088004d90 msgr2=0x7f00a00c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:57.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.454+0000 7f009ffff700 1 --2- 172.21.15.112:0/2098369255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0088004d90 0x7f00a00c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:57.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.454+0000 7f009ffff700 1 -- 172.21.15.112:0/2098369255 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a00c5650 con 0x7f00a00c90f0 2023-09-12T16:06:57.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.455+0000 7f009ffff700 1 --2- 172.21.15.112:0/2098369255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00a00c90f0 0x7f00a014d3a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0098000f80 tx=0x7f0098006e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:57.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.455+0000 7f0087fff700 1 -- 172.21.15.112:0/2098369255 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00980062d0 con 0x7f00a00c90f0 2023-09-12T16:06:57.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.455+0000 7f0087fff700 1 -- 172.21.15.112:0/2098369255 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0098006520 con 0x7f00a00c90f0 2023-09-12T16:06:57.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.455+0000 7f00a4d9d700 1 -- 172.21.15.112:0/2098369255 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a00b1de0 con 0x7f00a00c90f0 2023-09-12T16:06:57.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.455+0000 7f0087fff700 1 -- 172.21.15.112:0/2098369255 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0098006930 con 0x7f00a00c90f0 2023-09-12T16:06:57.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.455+0000 7f00a4d9d700 1 -- 172.21.15.112:0/2098369255 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a00b5000 con 0x7f00a00c90f0 2023-09-12T16:06:57.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.456+0000 7f00a4d9d700 1 -- 172.21.15.112:0/2098369255 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a00c5b70 con 0x7f00a00c90f0 2023-09-12T16:06:57.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.457+0000 7f0087fff700 1 -- 172.21.15.112:0/2098369255 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f0098022070 con 0x7f00a00c90f0 2023-09-12T16:06:57.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.458+0000 7f0087fff700 1 --2- 172.21.15.112:0/2098369255 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f008c06a580 0x7f008c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:57.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.458+0000 7f0087fff700 1 -- 172.21.15.112:0/2098369255 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f009808a4a0 con 0x7f00a00c90f0 2023-09-12T16:06:57.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.458+0000 7f009f7fe700 1 --2- 172.21.15.112:0/2098369255 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f008c06a580 0x7f008c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:57.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.459+0000 7f009f7fe700 1 --2- 172.21.15.112:0/2098369255 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f008c06a580 0x7f008c06ca40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0090009d40 tx=0x7f0090009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:57.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.463+0000 7f0087fff700 1 -- 172.21.15.112:0/2098369255 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f00a00c5b70 con 0x7f00a00c90f0 2023-09-12T16:06:57.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.662+0000 7f00a4d9d700 1 -- 172.21.15.112:0/2098369255 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f00a00b5000 con 0x7f00a00c90f0 2023-09-12T16:06:57.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.662+0000 7f0087fff700 1 -- 172.21.15.112:0/2098369255 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f00a00b5000 con 0x7f00a00c90f0 2023-09-12T16:06:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:06:57.663 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2023-09-12T16:06:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:06:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2023-09-12T16:06:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2023-09-12T16:06:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:06:57.664 INFO:teuthology.orchestra.run.smithi112.stdout:] 2023-09-12T16:06:57.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.664+0000 7f00a4d9d700 1 -- 172.21.15.112:0/2098369255 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f008c06a580 msgr2=0x7f008c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:57.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.664+0000 7f00a4d9d700 1 --2- 172.21.15.112:0/2098369255 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f008c06a580 0x7f008c06ca40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0090009d40 tx=0x7f0090009260 comp rx=0 tx=0).stop 2023-09-12T16:06:57.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.664+0000 7f00a4d9d700 1 -- 172.21.15.112:0/2098369255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00a00c90f0 msgr2=0x7f00a014d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:57.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.664+0000 7f00a4d9d700 1 --2- 172.21.15.112:0/2098369255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00a00c90f0 0x7f00a014d3a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0098000f80 tx=0x7f0098006e50 comp rx=0 tx=0).stop 2023-09-12T16:06:57.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.664+0000 7f00a4d9d700 1 -- 172.21.15.112:0/2098369255 shutdown_connections 2023-09-12T16:06:57.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.664+0000 7f00a4d9d700 1 --2- 172.21.15.112:0/2098369255 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f008c06a580 0x7f008c06ca40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:57.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.664+0000 7f00a4d9d700 1 --2- 172.21.15.112:0/2098369255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00a00c90f0 0x7f00a014d3a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:57.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.664+0000 7f00a4d9d700 1 --2- 172.21.15.112:0/2098369255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0088004d90 0x7f00a00c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:57.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.664+0000 7f00a4d9d700 1 --2- 172.21.15.112:0/2098369255 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00a00b18e0 0x7f00a00b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:57.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.664+0000 7f00a4d9d700 1 -- 172.21.15.112:0/2098369255 >> 172.21.15.112:0/2098369255 conn(0x7f00a0071d80 msgr2=0x7f00a015df30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:57.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.664+0000 7f00a4d9d700 1 -- 172.21.15.112:0/2098369255 shutdown_connections 2023-09-12T16:06:57.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.664+0000 7f00a4d9d700 1 -- 172.21.15.112:0/2098369255 wait complete. 2023-09-12T16:06:57.682 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-12T16:06:57.682 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-12T16:06:57.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.885+0000 7f675e1ff700 1 -- 172.21.15.112:0/957495553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67580cf5b0 msgr2=0x7f67580cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:57.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.885+0000 7f675e1ff700 1 --2- 172.21.15.112:0/957495553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67580cf5b0 0x7f67580cebc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f674c005fd0 tx=0x7f674c009c70 comp rx=0 tx=0).stop 2023-09-12T16:06:57.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.885+0000 7f675e1ff700 1 -- 172.21.15.112:0/957495553 shutdown_connections 2023-09-12T16:06:57.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.885+0000 7f675e1ff700 1 --2- 172.21.15.112:0/957495553 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f67580cfdb0 0x7f67580d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:57.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.885+0000 7f675e1ff700 1 --2- 172.21.15.112:0/957495553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67580cf5b0 0x7f67580cebc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:57.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.885+0000 7f675e1ff700 1 -- 172.21.15.112:0/957495553 >> 172.21.15.112:0/957495553 conn(0x7f67580d17d0 msgr2=0x7f67580d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:57.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.886+0000 7f675e1ff700 1 -- 172.21.15.112:0/957495553 shutdown_connections 2023-09-12T16:06:57.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.886+0000 7f675e1ff700 1 -- 172.21.15.112:0/957495553 wait complete. 2023-09-12T16:06:57.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.888+0000 7f675e1ff700 1 Processor -- start 2023-09-12T16:06:57.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.888+0000 7f675e1ff700 1 -- start start 2023-09-12T16:06:57.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.889+0000 7f675e1ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f67580cfdb0 0x7f67580c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:57.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.889+0000 7f675e1ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f675815bca0 0x7f67581f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:57.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.889+0000 7f675e1ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67581f2f50 0x7f67581f5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:57.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.889+0000 7f675e1ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67581f33d0 con 0x7f675815bca0 2023-09-12T16:06:57.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.889+0000 7f675e1ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67580b2b20 con 0x7f67581f2f50 2023-09-12T16:06:57.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.889+0000 7f675e1ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67580b2e00 con 0x7f67580cfdb0 2023-09-12T16:06:57.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.890+0000 7f6756ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f675815bca0 0x7f67581f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:57.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.890+0000 7f6756ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f675815bca0 0x7f67581f2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55834/0 (socket says 172.21.15.112:55834) 2023-09-12T16:06:57.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.890+0000 7f6756ffd700 1 -- 172.21.15.112:0/577293624 learned_addr learned my addr 172.21.15.112:0/577293624 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:57.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.890+0000 7f67577fe700 1 --2- 172.21.15.112:0/577293624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f67580cfdb0 0x7f67580c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:57.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.890+0000 7f6757fff700 1 --2- 172.21.15.112:0/577293624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67581f2f50 0x7f67581f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:57.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.890+0000 7f6756ffd700 1 -- 172.21.15.112:0/577293624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f67580cfdb0 msgr2=0x7f67580c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:57.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.890+0000 7f6756ffd700 1 --2- 172.21.15.112:0/577293624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f67580cfdb0 0x7f67580c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:57.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.890+0000 7f6756ffd700 1 -- 172.21.15.112:0/577293624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67581f2f50 msgr2=0x7f67581f5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:57.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.890+0000 7f6756ffd700 1 --2- 172.21.15.112:0/577293624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67581f2f50 0x7f67581f5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:57.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.890+0000 7f6756ffd700 1 -- 172.21.15.112:0/577293624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674c0095f0 con 0x7f675815bca0 2023-09-12T16:06:57.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.890+0000 7f67577fe700 1 --2- 172.21.15.112:0/577293624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f67580cfdb0 0x7f67580c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-12T16:06:57.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.890+0000 7f6756ffd700 1 --2- 172.21.15.112:0/577293624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f675815bca0 0x7f67581f2a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f674c0098e0 tx=0x7f674c003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:57.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.890+0000 7f673ffff700 1 -- 172.21.15.112:0/577293624 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c01d070 con 0x7f675815bca0 2023-09-12T16:06:57.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.891+0000 7f673ffff700 1 -- 172.21.15.112:0/577293624 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f674c00b820 con 0x7f675815bca0 2023-09-12T16:06:57.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.891+0000 7f675e1ff700 1 -- 172.21.15.112:0/577293624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67580b30e0 con 0x7f675815bca0 2023-09-12T16:06:57.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.891+0000 7f673ffff700 1 -- 172.21.15.112:0/577293624 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c0045f0 con 0x7f675815bca0 2023-09-12T16:06:57.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.891+0000 7f675e1ff700 1 -- 172.21.15.112:0/577293624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67580b36a0 con 0x7f675815bca0 2023-09-12T16:06:57.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.892+0000 7f675e1ff700 1 -- 172.21.15.112:0/577293624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67580cf0e0 con 0x7f675815bca0 2023-09-12T16:06:57.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.893+0000 7f673ffff700 1 -- 172.21.15.112:0/577293624 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f674c00bc10 con 0x7f675815bca0 2023-09-12T16:06:57.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.893+0000 7f673ffff700 1 --2- 172.21.15.112:0/577293624 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f674406a580 0x7f674406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:57.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.894+0000 7f673ffff700 1 -- 172.21.15.112:0/577293624 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f674c089d70 con 0x7f675815bca0 2023-09-12T16:06:57.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.894+0000 7f67577fe700 1 --2- 172.21.15.112:0/577293624 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f674406a580 0x7f674406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:57.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.894+0000 7f67577fe700 1 --2- 172.21.15.112:0/577293624 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f674406a580 0x7f674406ca40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6748007fd0 tx=0x7f6748009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:57.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:57.898+0000 7f673ffff700 1 -- 172.21.15.112:0/577293624 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f67580cf0e0 con 0x7f675815bca0 2023-09-12T16:06:58.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.097+0000 7f675e1ff700 1 -- 172.21.15.112:0/577293624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f67580cf0e0 con 0x7f675815bca0 2023-09-12T16:06:58.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.200+0000 7f673ffff700 1 -- 172.21.15.112:0/577293624 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f67580cf0e0 con 0x7f675815bca0 2023-09-12T16:06:58.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.207+0000 7f675e1ff700 1 -- 172.21.15.112:0/577293624 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f674406a580 msgr2=0x7f674406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:58.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.207+0000 7f675e1ff700 1 --2- 172.21.15.112:0/577293624 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f674406a580 0x7f674406ca40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6748007fd0 tx=0x7f6748009040 comp rx=0 tx=0).stop 2023-09-12T16:06:58.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.207+0000 7f675e1ff700 1 -- 172.21.15.112:0/577293624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f675815bca0 msgr2=0x7f67581f2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:58.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.207+0000 7f675e1ff700 1 --2- 172.21.15.112:0/577293624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f675815bca0 0x7f67581f2a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f674c0098e0 tx=0x7f674c003d00 comp rx=0 tx=0).stop 2023-09-12T16:06:58.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.207+0000 7f675e1ff700 1 -- 172.21.15.112:0/577293624 shutdown_connections 2023-09-12T16:06:58.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.207+0000 7f675e1ff700 1 --2- 172.21.15.112:0/577293624 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f674406a580 0x7f674406ca40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:58.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.207+0000 7f675e1ff700 1 --2- 172.21.15.112:0/577293624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f67580cfdb0 0x7f67580c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:58.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.207+0000 7f675e1ff700 1 --2- 172.21.15.112:0/577293624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67581f2f50 0x7f67581f5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:58.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.207+0000 7f675e1ff700 1 --2- 172.21.15.112:0/577293624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f675815bca0 0x7f67581f2a10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:58.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.207+0000 7f675e1ff700 1 -- 172.21.15.112:0/577293624 >> 172.21.15.112:0/577293624 conn(0x7f67580d17d0 msgr2=0x7f675815fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:58.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.209+0000 7f675e1ff700 1 -- 172.21.15.112:0/577293624 shutdown_connections 2023-09-12T16:06:58.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.209+0000 7f675e1ff700 1 -- 172.21.15.112:0/577293624 wait complete. 2023-09-12T16:06:58.213 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2023-09-12T16:06:58.229 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-09-12T16:06:58.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.435+0000 7fdf1c3ff700 1 -- 172.21.15.112:0/3192221146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf140cfac0 msgr2=0x7fdf140cff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:58.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.435+0000 7fdf1c3ff700 1 --2- 172.21.15.112:0/3192221146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf140cfac0 0x7fdf140cff40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdf1408b8e0 tx=0x7fdf04009ba0 comp rx=0 tx=0).stop 2023-09-12T16:06:58.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.435+0000 7fdf1c3ff700 1 -- 172.21.15.112:0/3192221146 shutdown_connections 2023-09-12T16:06:58.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.435+0000 7fdf1c3ff700 1 --2- 172.21.15.112:0/3192221146 >> v2:172.21.15.144:3300/0 conn(0x7fdf140af680 0x7fdf140afab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:58.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.435+0000 7fdf1c3ff700 1 --2- 172.21.15.112:0/3192221146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf140cfac0 0x7fdf140cff40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:58.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.435+0000 7fdf1c3ff700 1 -- 172.21.15.112:0/3192221146 >> 172.21.15.112:0/3192221146 conn(0x7fdf1408b0a0 msgr2=0x7fdf1409a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:58.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.435+0000 7fdf1c3ff700 1 -- 172.21.15.112:0/3192221146 shutdown_connections 2023-09-12T16:06:58.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.435+0000 7fdf1c3ff700 1 -- 172.21.15.112:0/3192221146 wait complete. 2023-09-12T16:06:58.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.437+0000 7fdf1c3ff700 1 Processor -- start 2023-09-12T16:06:58.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.437+0000 7fdf1c3ff700 1 -- start start 2023-09-12T16:06:58.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.438+0000 7fdf1c3ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf140af680 0x7fdf140c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:58.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.438+0000 7fdf1c3ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf140cfac0 0x7fdf14158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:58.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.438+0000 7fdf1c3ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf1415ba90 0x7fdf1415c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:58.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.438+0000 7fdf1c3ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf140c5d50 con 0x7fdf140af680 2023-09-12T16:06:58.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.438+0000 7fdf1c3ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf140b4330 con 0x7fdf1415ba90 2023-09-12T16:06:58.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.438+0000 7fdf1c3ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf140b4610 con 0x7fdf140cfac0 2023-09-12T16:06:58.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.438+0000 7fdf1a19b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf140af680 0x7fdf140c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:58.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.438+0000 7fdf1a19b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf140af680 0x7fdf140c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55852/0 (socket says 172.21.15.112:55852) 2023-09-12T16:06:58.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.438+0000 7fdf1a19b700 1 -- 172.21.15.112:0/1113914620 learned_addr learned my addr 172.21.15.112:0/1113914620 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:58.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.438+0000 7fdf1999a700 1 --2- 172.21.15.112:0/1113914620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf140cfac0 0x7fdf14158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:58.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.438+0000 7fdf1a99c700 1 --2- 172.21.15.112:0/1113914620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf1415ba90 0x7fdf1415c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:58.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.439+0000 7fdf1a19b700 1 -- 172.21.15.112:0/1113914620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf140cfac0 msgr2=0x7fdf14158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:58.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.439+0000 7fdf1a19b700 1 --2- 172.21.15.112:0/1113914620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf140cfac0 0x7fdf14158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:58.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.439+0000 7fdf1a19b700 1 -- 172.21.15.112:0/1113914620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf1415ba90 msgr2=0x7fdf1415c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:58.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.439+0000 7fdf1a19b700 1 --2- 172.21.15.112:0/1113914620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf1415ba90 0x7fdf1415c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:58.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.439+0000 7fdf1a19b700 1 -- 172.21.15.112:0/1113914620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf04009520 con 0x7fdf140af680 2023-09-12T16:06:58.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.439+0000 7fdf1a19b700 1 --2- 172.21.15.112:0/1113914620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf140af680 0x7fdf140c5810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000c450 tx=0x7fdf1000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:58.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.439+0000 7fdf0affd700 1 -- 172.21.15.112:0/1113914620 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf10011790 con 0x7fdf140af680 2023-09-12T16:06:58.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.439+0000 7fdf0affd700 1 -- 172.21.15.112:0/1113914620 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdf100119e0 con 0x7fdf140af680 2023-09-12T16:06:58.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.439+0000 7fdf1c3ff700 1 -- 172.21.15.112:0/1113914620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf140af210 con 0x7fdf140af680 2023-09-12T16:06:58.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.439+0000 7fdf0affd700 1 -- 172.21.15.112:0/1113914620 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf10011dd0 con 0x7fdf140af680 2023-09-12T16:06:58.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.439+0000 7fdf1c3ff700 1 -- 172.21.15.112:0/1113914620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf140b4bd0 con 0x7fdf140af680 2023-09-12T16:06:58.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.440+0000 7fdf1c3ff700 1 -- 172.21.15.112:0/1113914620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf14073ea0 con 0x7fdf140af680 2023-09-12T16:06:58.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.441+0000 7fdf0affd700 1 -- 172.21.15.112:0/1113914620 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fdf1001c460 con 0x7fdf140af680 2023-09-12T16:06:58.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.442+0000 7fdf0affd700 1 --2- 172.21.15.112:0/1113914620 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdef806a580 0x7fdef806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:58.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.442+0000 7fdf0affd700 1 -- 172.21.15.112:0/1113914620 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fdf100886b0 con 0x7fdf140af680 2023-09-12T16:06:58.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.442+0000 7fdf1999a700 1 --2- 172.21.15.112:0/1113914620 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdef806a580 0x7fdef806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:58.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.443+0000 7fdf1999a700 1 --2- 172.21.15.112:0/1113914620 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdef806a580 0x7fdef806ca40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdf04009810 tx=0x7fdf040047c0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:58.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.447+0000 7fdf0affd700 1 -- 172.21.15.112:0/1113914620 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fdf10053e00 con 0x7fdf140af680 2023-09-12T16:06:58.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:58.645+0000 7fdf1c3ff700 1 -- 172.21.15.112:0/1113914620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fdf140afbe0 con 0x7fdf140af680 2023-09-12T16:06:59.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.206+0000 7fdf0affd700 1 -- 172.21.15.112:0/1113914620 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7fdf1000ce60 con 0x7fdf140af680 2023-09-12T16:06:59.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.209+0000 7fdf1c3ff700 1 -- 172.21.15.112:0/1113914620 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdef806a580 msgr2=0x7fdef806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:59.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.209+0000 7fdf1c3ff700 1 --2- 172.21.15.112:0/1113914620 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdef806a580 0x7fdef806ca40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdf04009810 tx=0x7fdf040047c0 comp rx=0 tx=0).stop 2023-09-12T16:06:59.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.209+0000 7fdf1c3ff700 1 -- 172.21.15.112:0/1113914620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf140af680 msgr2=0x7fdf140c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:59.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.209+0000 7fdf1c3ff700 1 --2- 172.21.15.112:0/1113914620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf140af680 0x7fdf140c5810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000c450 tx=0x7fdf1000c760 comp rx=0 tx=0).stop 2023-09-12T16:06:59.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.209+0000 7fdf1c3ff700 1 -- 172.21.15.112:0/1113914620 shutdown_connections 2023-09-12T16:06:59.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.209+0000 7fdf1c3ff700 1 --2- 172.21.15.112:0/1113914620 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdef806a580 0x7fdef806ca40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:59.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.209+0000 7fdf1c3ff700 1 --2- 172.21.15.112:0/1113914620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf1415ba90 0x7fdf1415c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:59.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.209+0000 7fdf1c3ff700 1 --2- 172.21.15.112:0/1113914620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf140af680 0x7fdf140c5810 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:59.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.209+0000 7fdf1c3ff700 1 --2- 172.21.15.112:0/1113914620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf140cfac0 0x7fdf14158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:59.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.209+0000 7fdf1c3ff700 1 -- 172.21.15.112:0/1113914620 >> 172.21.15.112:0/1113914620 conn(0x7fdf1408b0a0 msgr2=0x7fdf140b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:59.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.209+0000 7fdf1c3ff700 1 -- 172.21.15.112:0/1113914620 shutdown_connections 2023-09-12T16:06:59.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.209+0000 7fdf1c3ff700 1 -- 172.21.15.112:0/1113914620 wait complete. 2023-09-12T16:06:59.222 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2023-09-12T16:06:59.243 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-12T16:06:59.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.445+0000 7f8f6f3ff700 1 -- 172.21.15.112:0/247323455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f6815bca0 msgr2=0x7f8f6815cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:59.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.445+0000 7f8f6f3ff700 1 --2- 172.21.15.112:0/247323455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f6815bca0 0x7f8f6815cb90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8f64005fd0 tx=0x7f8f64009c70 comp rx=0 tx=0).stop 2023-09-12T16:06:59.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.445+0000 7f8f6f3ff700 1 -- 172.21.15.112:0/247323455 shutdown_connections 2023-09-12T16:06:59.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.445+0000 7f8f6f3ff700 1 --2- 172.21.15.112:0/247323455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f6815bca0 0x7f8f6815cb90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:59.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.445+0000 7f8f6f3ff700 1 --2- 172.21.15.112:0/247323455 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f680cf5b0 0x7f8f680cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:59.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.445+0000 7f8f6f3ff700 1 -- 172.21.15.112:0/247323455 >> 172.21.15.112:0/247323455 conn(0x7f8f680d17d0 msgr2=0x7f8f680d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:06:59.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.445+0000 7f8f6f3ff700 1 -- 172.21.15.112:0/247323455 shutdown_connections 2023-09-12T16:06:59.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.445+0000 7f8f6f3ff700 1 -- 172.21.15.112:0/247323455 wait complete. 2023-09-12T16:06:59.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.447+0000 7f8f6f3ff700 1 Processor -- start 2023-09-12T16:06:59.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.447+0000 7f8f6f3ff700 1 -- start start 2023-09-12T16:06:59.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.448+0000 7f8f6f3ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f680cfdb0 0x7f8f681538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:59.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.448+0000 7f8f6f3ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f6815bca0 0x7f8f680ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:59.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.448+0000 7f8f6f3ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f680c88a0 0x7f8f680b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:59.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.448+0000 7f8f6f3ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f680ca960 con 0x7f8f680cfdb0 2023-09-12T16:06:59.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.448+0000 7f8f6f3ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f681f5600 con 0x7f8f6815bca0 2023-09-12T16:06:59.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.448+0000 7f8f6f3ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f681f58e0 con 0x7f8f680c88a0 2023-09-12T16:06:59.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.448+0000 7f8f6d19b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f680cfdb0 0x7f8f681538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:59.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.448+0000 7f8f6d19b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f680cfdb0 0x7f8f681538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55862/0 (socket says 172.21.15.112:55862) 2023-09-12T16:06:59.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.448+0000 7f8f6d19b700 1 -- 172.21.15.112:0/3431494587 learned_addr learned my addr 172.21.15.112:0/3431494587 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:06:59.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.448+0000 7f8f6c99a700 1 --2- 172.21.15.112:0/3431494587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f6815bca0 0x7f8f680ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:59.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.448+0000 7f8f6d99c700 1 --2- 172.21.15.112:0/3431494587 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f680c88a0 0x7f8f680b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:59.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.448+0000 7f8f6d19b700 1 -- 172.21.15.112:0/3431494587 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f680c88a0 msgr2=0x7f8f680b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:59.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.448+0000 7f8f6d19b700 1 --2- 172.21.15.112:0/3431494587 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f680c88a0 0x7f8f680b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:59.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.448+0000 7f8f6d19b700 1 -- 172.21.15.112:0/3431494587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f6815bca0 msgr2=0x7f8f680ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:06:59.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.448+0000 7f8f6d19b700 1 --2- 172.21.15.112:0/3431494587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f6815bca0 0x7f8f680ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:06:59.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.448+0000 7f8f6d19b700 1 -- 172.21.15.112:0/3431494587 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f640095f0 con 0x7f8f680cfdb0 2023-09-12T16:06:59.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.449+0000 7f8f6d19b700 1 --2- 172.21.15.112:0/3431494587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f680cfdb0 0x7f8f681538b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f640098e0 tx=0x7f8f6400bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:59.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.449+0000 7f8f5dffb700 1 -- 172.21.15.112:0/3431494587 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6401c070 con 0x7f8f680cfdb0 2023-09-12T16:06:59.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.449+0000 7f8f5dffb700 1 -- 172.21.15.112:0/3431494587 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8f64003890 con 0x7f8f680cfdb0 2023-09-12T16:06:59.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.449+0000 7f8f6f3ff700 1 -- 172.21.15.112:0/3431494587 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f681f5bc0 con 0x7f8f680cfdb0 2023-09-12T16:06:59.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.449+0000 7f8f5dffb700 1 -- 172.21.15.112:0/3431494587 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64003c40 con 0x7f8f680cfdb0 2023-09-12T16:06:59.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.449+0000 7f8f6f3ff700 1 -- 172.21.15.112:0/3431494587 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f680c8d20 con 0x7f8f680cfdb0 2023-09-12T16:06:59.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.450+0000 7f8f6f3ff700 1 -- 172.21.15.112:0/3431494587 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f680cf0b0 con 0x7f8f680cfdb0 2023-09-12T16:06:59.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.451+0000 7f8f5dffb700 1 -- 172.21.15.112:0/3431494587 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f8f6400f460 con 0x7f8f680cfdb0 2023-09-12T16:06:59.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.452+0000 7f8f5dffb700 1 --2- 172.21.15.112:0/3431494587 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8f4c06a580 0x7f8f4c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:06:59.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.452+0000 7f8f5dffb700 1 -- 172.21.15.112:0/3431494587 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f8f64089f20 con 0x7f8f680cfdb0 2023-09-12T16:06:59.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.452+0000 7f8f6c99a700 1 --2- 172.21.15.112:0/3431494587 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8f4c06a580 0x7f8f4c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:06:59.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.453+0000 7f8f6c99a700 1 --2- 172.21.15.112:0/3431494587 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8f4c06a580 0x7f8f4c06ca40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8f58005fd0 tx=0x7f8f58005f60 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:06:59.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.457+0000 7f8f5dffb700 1 -- 172.21.15.112:0/3431494587 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f8f640554f0 con 0x7f8f680cfdb0 2023-09-12T16:06:59.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:06:59.695+0000 7f8f6f3ff700 1 -- 172.21.15.112:0/3431494587 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8f6814f9b0 con 0x7f8f680cfdb0 2023-09-12T16:07:00.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.208+0000 7f8f5dffb700 1 -- 172.21.15.112:0/3431494587 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8f64025020 con 0x7f8f680cfdb0 2023-09-12T16:07:00.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.213+0000 7f8f6f3ff700 1 -- 172.21.15.112:0/3431494587 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8f4c06a580 msgr2=0x7f8f4c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:00.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.213+0000 7f8f6f3ff700 1 --2- 172.21.15.112:0/3431494587 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8f4c06a580 0x7f8f4c06ca40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8f58005fd0 tx=0x7f8f58005f60 comp rx=0 tx=0).stop 2023-09-12T16:07:00.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.213+0000 7f8f6f3ff700 1 -- 172.21.15.112:0/3431494587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f680cfdb0 msgr2=0x7f8f681538b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:00.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.213+0000 7f8f6f3ff700 1 --2- 172.21.15.112:0/3431494587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f680cfdb0 0x7f8f681538b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f640098e0 tx=0x7f8f6400bee0 comp rx=0 tx=0).stop 2023-09-12T16:07:00.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.213+0000 7f8f6f3ff700 1 -- 172.21.15.112:0/3431494587 shutdown_connections 2023-09-12T16:07:00.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.213+0000 7f8f6f3ff700 1 --2- 172.21.15.112:0/3431494587 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8f4c06a580 0x7f8f4c06ca40 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8f58005fd0 tx=0x7f8f58005f60 comp rx=0 tx=0).stop 2023-09-12T16:07:00.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.213+0000 7f8f6f3ff700 1 --2- 172.21.15.112:0/3431494587 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f680c88a0 0x7f8f680b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:00.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.213+0000 7f8f6f3ff700 1 --2- 172.21.15.112:0/3431494587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f680cfdb0 0x7f8f681538b0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f640098e0 tx=0x7f8f6400bee0 comp rx=0 tx=0).stop 2023-09-12T16:07:00.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.213+0000 7f8f6f3ff700 1 --2- 172.21.15.112:0/3431494587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f6815bca0 0x7f8f680ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:00.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.213+0000 7f8f6f3ff700 1 -- 172.21.15.112:0/3431494587 >> 172.21.15.112:0/3431494587 conn(0x7f8f680d17d0 msgr2=0x7f8f680afe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:00.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.215+0000 7f8f6f3ff700 1 -- 172.21.15.112:0/3431494587 shutdown_connections 2023-09-12T16:07:00.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.215+0000 7f8f6f3ff700 1 -- 172.21.15.112:0/3431494587 wait complete. 2023-09-12T16:07:00.217 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 2 and data pool 3 2023-09-12T16:07:00.250 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-09-12T16:07:00.250 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-09-12T16:07:00.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.457+0000 7f5063bff700 1 -- 172.21.15.112:0/132404810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f505c0cfdb0 msgr2=0x7f505c0d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:00.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.457+0000 7f5063bff700 1 --2- 172.21.15.112:0/132404810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f505c0cfdb0 0x7f505c0d01e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f505c08bf50 tx=0x7f505400b380 comp rx=0 tx=0).stop 2023-09-12T16:07:00.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.457+0000 7f5063bff700 1 -- 172.21.15.112:0/132404810 shutdown_connections 2023-09-12T16:07:00.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.457+0000 7f5063bff700 1 --2- 172.21.15.112:0/132404810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f505c0cfdb0 0x7f505c0d01e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:00.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.457+0000 7f5063bff700 1 --2- 172.21.15.112:0/132404810 >> v2:172.21.15.144:3300/0 conn(0x7f505c15bca0 0x7f505c15cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:00.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.457+0000 7f5063bff700 1 -- 172.21.15.112:0/132404810 >> 172.21.15.112:0/132404810 conn(0x7f505c0d17d0 msgr2=0x7f505c0d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:00.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.457+0000 7f5063bff700 1 -- 172.21.15.112:0/132404810 shutdown_connections 2023-09-12T16:07:00.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.457+0000 7f5063bff700 1 -- 172.21.15.112:0/132404810 wait complete. 2023-09-12T16:07:00.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.458+0000 7f5063bff700 1 Processor -- start 2023-09-12T16:07:00.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.459+0000 7f5063bff700 1 -- start start 2023-09-12T16:07:00.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.459+0000 7f5063bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f505c0cfdb0 0x7f505c0ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:00.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.459+0000 7f5063bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f505c15bca0 0x7f505c06c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:00.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.459+0000 7f5063bff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f505c15dc60 0x7f505c1f4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:00.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.459+0000 7f5063bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c15e1e0 con 0x7f505c0cfdb0 2023-09-12T16:07:00.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.459+0000 7f5063bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c15e4c0 con 0x7f505c15bca0 2023-09-12T16:07:00.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.459+0000 7f5063bff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c15e7a0 con 0x7f505c15dc60 2023-09-12T16:07:00.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.460+0000 7f506199b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f505c0cfdb0 0x7f505c0ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:00.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.460+0000 7f506199b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f505c0cfdb0 0x7f505c0ca800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55880/0 (socket says 172.21.15.112:55880) 2023-09-12T16:07:00.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.460+0000 7f506199b700 1 -- 172.21.15.112:0/2815385252 learned_addr learned my addr 172.21.15.112:0/2815385252 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:00.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.460+0000 7f506219c700 1 --2- 172.21.15.112:0/2815385252 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f505c15dc60 0x7f505c1f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:00.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.460+0000 7f506119a700 1 --2- 172.21.15.112:0/2815385252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f505c15bca0 0x7f505c06c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:00.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.460+0000 7f506199b700 1 -- 172.21.15.112:0/2815385252 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f505c15dc60 msgr2=0x7f505c1f4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:00.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.460+0000 7f506199b700 1 --2- 172.21.15.112:0/2815385252 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f505c15dc60 0x7f505c1f4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:00.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.460+0000 7f506199b700 1 -- 172.21.15.112:0/2815385252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f505c15bca0 msgr2=0x7f505c06c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:00.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.460+0000 7f506199b700 1 --2- 172.21.15.112:0/2815385252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f505c15bca0 0x7f505c06c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:00.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.460+0000 7f506199b700 1 -- 172.21.15.112:0/2815385252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5054009d00 con 0x7f505c0cfdb0 2023-09-12T16:07:00.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.460+0000 7f506199b700 1 --2- 172.21.15.112:0/2815385252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f505c0cfdb0 0x7f505c0ca800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f505800e9f0 tx=0x7f505800edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:00.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.461+0000 7f50527fc700 1 -- 172.21.15.112:0/2815385252 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505800cbd0 con 0x7f505c0cfdb0 2023-09-12T16:07:00.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.461+0000 7f50527fc700 1 -- 172.21.15.112:0/2815385252 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f505800ce20 con 0x7f505c0cfdb0 2023-09-12T16:07:00.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.461+0000 7f50527fc700 1 -- 172.21.15.112:0/2815385252 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5058010690 con 0x7f505c0cfdb0 2023-09-12T16:07:00.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.461+0000 7f5063bff700 1 -- 172.21.15.112:0/2815385252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f505c15ea80 con 0x7f505c0cfdb0 2023-09-12T16:07:00.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.461+0000 7f5063bff700 1 -- 172.21.15.112:0/2815385252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f505c0cad40 con 0x7f505c0cfdb0 2023-09-12T16:07:00.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.462+0000 7f5063bff700 1 -- 172.21.15.112:0/2815385252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f505c073ea0 con 0x7f505c0cfdb0 2023-09-12T16:07:00.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.463+0000 7f50527fc700 1 -- 172.21.15.112:0/2815385252 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f50580107f0 con 0x7f505c0cfdb0 2023-09-12T16:07:00.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.464+0000 7f50527fc700 1 --2- 172.21.15.112:0/2815385252 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f504006a580 0x7f504006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:00.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.464+0000 7f50527fc700 1 -- 172.21.15.112:0/2815385252 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5058014070 con 0x7f505c0cfdb0 2023-09-12T16:07:00.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.464+0000 7f506119a700 1 --2- 172.21.15.112:0/2815385252 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f504006a580 0x7f504006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:00.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.464+0000 7f506119a700 1 --2- 172.21.15.112:0/2815385252 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f504006a580 0x7f504006ca40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f504c000f60 tx=0x7f504c009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:00.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.468+0000 7f50527fc700 1 -- 172.21.15.112:0/2815385252 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f50580519b0 con 0x7f505c0cfdb0 2023-09-12T16:07:00.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:00.675+0000 7f5063bff700 1 -- 172.21.15.112:0/2815385252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f505c08b860 con 0x7f505c0cfdb0 2023-09-12T16:07:01.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.211+0000 7f50527fc700 1 -- 172.21.15.112:0/2815385252 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7f5058058470 con 0x7f505c0cfdb0 2023-09-12T16:07:01.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.214+0000 7f5063bff700 1 -- 172.21.15.112:0/2815385252 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f504006a580 msgr2=0x7f504006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:01.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.214+0000 7f5063bff700 1 --2- 172.21.15.112:0/2815385252 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f504006a580 0x7f504006ca40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f504c000f60 tx=0x7f504c009040 comp rx=0 tx=0).stop 2023-09-12T16:07:01.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.214+0000 7f5063bff700 1 -- 172.21.15.112:0/2815385252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f505c0cfdb0 msgr2=0x7f505c0ca800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:01.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.214+0000 7f5063bff700 1 --2- 172.21.15.112:0/2815385252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f505c0cfdb0 0x7f505c0ca800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f505800e9f0 tx=0x7f505800edb0 comp rx=0 tx=0).stop 2023-09-12T16:07:01.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.214+0000 7f5063bff700 1 -- 172.21.15.112:0/2815385252 shutdown_connections 2023-09-12T16:07:01.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.214+0000 7f5063bff700 1 --2- 172.21.15.112:0/2815385252 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f504006a580 0x7f504006ca40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:01.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.214+0000 7f5063bff700 1 --2- 172.21.15.112:0/2815385252 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f505c15dc60 0x7f505c1f4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:01.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.214+0000 7f5063bff700 1 --2- 172.21.15.112:0/2815385252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f505c0cfdb0 0x7f505c0ca800 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:01.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.214+0000 7f5063bff700 1 --2- 172.21.15.112:0/2815385252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f505c15bca0 0x7f505c06c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:01.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.214+0000 7f5063bff700 1 -- 172.21.15.112:0/2815385252 >> 172.21.15.112:0/2815385252 conn(0x7f505c0d17d0 msgr2=0x7f505c15ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:01.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.215+0000 7f5063bff700 1 -- 172.21.15.112:0/2815385252 shutdown_connections 2023-09-12T16:07:01.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.215+0000 7f5063bff700 1 -- 172.21.15.112:0/2815385252 wait complete. 2023-09-12T16:07:01.235 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-09-12T16:07:01.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.442+0000 7fdcf61ff700 1 -- 172.21.15.112:0/2751695800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcdc004d90 msgr2=0x7fdcdc005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:01.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.442+0000 7fdcf61ff700 1 --2- 172.21.15.112:0/2751695800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcdc004d90 0x7fdcdc005210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdce800e320 tx=0x7fdcdc005880 comp rx=0 tx=0).stop 2023-09-12T16:07:01.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.442+0000 7fdceffff700 1 -- 172.21.15.112:0/2751695800 reap_dead start 2023-09-12T16:07:01.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.442+0000 7fdcf61ff700 1 -- 172.21.15.112:0/2751695800 shutdown_connections 2023-09-12T16:07:01.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.442+0000 7fdcf61ff700 1 -- 172.21.15.112:0/2751695800 >> 172.21.15.112:0/2751695800 conn(0x7fdcf009abc0 msgr2=0x7fdcf0088ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:01.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.442+0000 7fdcf61ff700 1 -- 172.21.15.112:0/2751695800 shutdown_connections 2023-09-12T16:07:01.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.442+0000 7fdcf61ff700 1 -- 172.21.15.112:0/2751695800 wait complete. 2023-09-12T16:07:01.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.444+0000 7fdcf61ff700 1 Processor -- start 2023-09-12T16:07:01.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.444+0000 7fdcf61ff700 1 -- start start 2023-09-12T16:07:01.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.445+0000 7fdcf61ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcdc004d90 0x7fdcf01f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:01.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.445+0000 7fdcf61ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcf015e6c0 0x7fdcf01e53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:01.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.445+0000 7fdcf61ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcf01e42e0 0x7fdcf01f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:01.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.445+0000 7fdcf61ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf01f23a0 con 0x7fdcdc004d90 2023-09-12T16:07:01.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.445+0000 7fdcf61ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf01f2680 con 0x7fdcf015e6c0 2023-09-12T16:07:01.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.445+0000 7fdcf61ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf01f2960 con 0x7fdcf01e42e0 2023-09-12T16:07:01.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.445+0000 7fdcef7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcdc004d90 0x7fdcf01f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:01.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.445+0000 7fdcef7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcdc004d90 0x7fdcf01f1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55894/0 (socket says 172.21.15.112:55894) 2023-09-12T16:07:01.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.445+0000 7fdcef7fe700 1 -- 172.21.15.112:0/2689685604 learned_addr learned my addr 172.21.15.112:0/2689685604 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:01.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.445+0000 7fdceffff700 1 --2- 172.21.15.112:0/2689685604 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcf01e42e0 0x7fdcf01f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:01.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.445+0000 7fdce7fff700 1 --2- 172.21.15.112:0/2689685604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcf015e6c0 0x7fdcf01e53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:01.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.446+0000 7fdcef7fe700 1 -- 172.21.15.112:0/2689685604 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcf01e42e0 msgr2=0x7fdcf01f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:01.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.446+0000 7fdcef7fe700 1 --2- 172.21.15.112:0/2689685604 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcf01e42e0 0x7fdcf01f58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:01.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.446+0000 7fdcef7fe700 1 -- 172.21.15.112:0/2689685604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcf015e6c0 msgr2=0x7fdcf01e53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:01.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.446+0000 7fdcef7fe700 1 --2- 172.21.15.112:0/2689685604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcf015e6c0 0x7fdcf01e53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:01.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.446+0000 7fdcef7fe700 1 -- 172.21.15.112:0/2689685604 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf01f53c0 con 0x7fdcdc004d90 2023-09-12T16:07:01.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.446+0000 7fdcef7fe700 1 --2- 172.21.15.112:0/2689685604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcdc004d90 0x7fdcf01f1d70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdce0006640 tx=0x7fdce0003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:01.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.446+0000 7fdcecff9700 1 -- 172.21.15.112:0/2689685604 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce0011840 con 0x7fdcdc004d90 2023-09-12T16:07:01.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.446+0000 7fdcecff9700 1 -- 172.21.15.112:0/2689685604 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdce00119c0 con 0x7fdcdc004d90 2023-09-12T16:07:01.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.446+0000 7fdcecff9700 1 -- 172.21.15.112:0/2689685604 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce0011dd0 con 0x7fdcdc004d90 2023-09-12T16:07:01.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.446+0000 7fdcf61ff700 1 -- 172.21.15.112:0/2689685604 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf01f2c40 con 0x7fdcdc004d90 2023-09-12T16:07:01.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.446+0000 7fdcf61ff700 1 -- 172.21.15.112:0/2689685604 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf015eb40 con 0x7fdcdc004d90 2023-09-12T16:07:01.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.447+0000 7fdcf61ff700 1 -- 172.21.15.112:0/2689685604 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf0155910 con 0x7fdcdc004d90 2023-09-12T16:07:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.448+0000 7fdcecff9700 1 -- 172.21.15.112:0/2689685604 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fdce00103c0 con 0x7fdcdc004d90 2023-09-12T16:07:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.449+0000 7fdcecff9700 1 --2- 172.21.15.112:0/2689685604 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdcd006a580 0x7fdcd006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.449+0000 7fdcecff9700 1 -- 172.21.15.112:0/2689685604 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fdce0089bc0 con 0x7fdcdc004d90 2023-09-12T16:07:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.449+0000 7fdce7fff700 1 --2- 172.21.15.112:0/2689685604 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdcd006a580 0x7fdcd006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:01.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.450+0000 7fdce7fff700 1 --2- 172.21.15.112:0/2689685604 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdcd006a580 0x7fdcd006ca40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8006fd0 tx=0x7fdcd8006110 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:01.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.454+0000 7fdcecff9700 1 -- 172.21.15.112:0/2689685604 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fdce0054fc0 con 0x7fdcdc004d90 2023-09-12T16:07:01.652 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:01.652+0000 7fdcf61ff700 1 -- 172.21.15.112:0/2689685604 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdcf004e300 con 0x7fdcdc004d90 2023-09-12T16:07:03.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.246+0000 7fdcecff9700 1 -- 172.21.15.112:0/2689685604 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7fdce0015070 con 0x7fdcdc004d90 2023-09-12T16:07:03.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.251+0000 7fdcf61ff700 1 -- 172.21.15.112:0/2689685604 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdcd006a580 msgr2=0x7fdcd006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:03.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.251+0000 7fdcf61ff700 1 --2- 172.21.15.112:0/2689685604 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdcd006a580 0x7fdcd006ca40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8006fd0 tx=0x7fdcd8006110 comp rx=0 tx=0).stop 2023-09-12T16:07:03.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.251+0000 7fdcf61ff700 1 -- 172.21.15.112:0/2689685604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcdc004d90 msgr2=0x7fdcf01f1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:03.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.251+0000 7fdcf61ff700 1 --2- 172.21.15.112:0/2689685604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcdc004d90 0x7fdcf01f1d70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdce0006640 tx=0x7fdce0003960 comp rx=0 tx=0).stop 2023-09-12T16:07:03.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.251+0000 7fdcf61ff700 1 -- 172.21.15.112:0/2689685604 shutdown_connections 2023-09-12T16:07:03.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.251+0000 7fdcf61ff700 1 --2- 172.21.15.112:0/2689685604 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdcd006a580 0x7fdcd006ca40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:03.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.251+0000 7fdcf61ff700 1 --2- 172.21.15.112:0/2689685604 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcf01e42e0 0x7fdcf01f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:03.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.251+0000 7fdcf61ff700 1 --2- 172.21.15.112:0/2689685604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcdc004d90 0x7fdcf01f1d70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:03.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.251+0000 7fdcf61ff700 1 --2- 172.21.15.112:0/2689685604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcf015e6c0 0x7fdcf01e53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:03.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.251+0000 7fdcf61ff700 1 -- 172.21.15.112:0/2689685604 >> 172.21.15.112:0/2689685604 conn(0x7fdcf009abc0 msgr2=0x7fdcf00b7100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:03.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.252+0000 7fdcf61ff700 1 -- 172.21.15.112:0/2689685604 shutdown_connections 2023-09-12T16:07:03.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.252+0000 7fdcf61ff700 1 -- 172.21.15.112:0/2689685604 wait complete. 2023-09-12T16:07:03.261 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data_ec' created 2023-09-12T16:07:03.280 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-09-12T16:07:03.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.484+0000 7fcc4fdff700 1 -- 172.21.15.112:0/1063776623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc480cf5b0 msgr2=0x7fcc480cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:03.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.484+0000 7fcc4fdff700 1 --2- 172.21.15.112:0/1063776623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc480cf5b0 0x7fcc480cebc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcc38005fd0 tx=0x7fcc38009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:03.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.485+0000 7fcc4fdff700 1 -- 172.21.15.112:0/1063776623 shutdown_connections 2023-09-12T16:07:03.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.485+0000 7fcc4fdff700 1 --2- 172.21.15.112:0/1063776623 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc4815bca0 0x7fcc4815cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:03.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.485+0000 7fcc4fdff700 1 --2- 172.21.15.112:0/1063776623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc480cf5b0 0x7fcc480cebc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:03.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.485+0000 7fcc4fdff700 1 -- 172.21.15.112:0/1063776623 >> 172.21.15.112:0/1063776623 conn(0x7fcc480d17d0 msgr2=0x7fcc480d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:03.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.485+0000 7fcc4fdff700 1 -- 172.21.15.112:0/1063776623 shutdown_connections 2023-09-12T16:07:03.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.485+0000 7fcc4fdff700 1 -- 172.21.15.112:0/1063776623 wait complete. 2023-09-12T16:07:03.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.487+0000 7fcc4fdff700 1 Processor -- start 2023-09-12T16:07:03.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.487+0000 7fcc4fdff700 1 -- start start 2023-09-12T16:07:03.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.488+0000 7fcc4fdff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc480cfdb0 0x7fcc480c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:03.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.488+0000 7fcc4fdff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc4815bca0 0x7fcc481f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:03.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.488+0000 7fcc4fdff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc48158de0 0x7fcc480b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:03.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.488+0000 7fcc4fdff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc480b1a20 con 0x7fcc48158de0 2023-09-12T16:07:03.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.488+0000 7fcc4fdff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc480c8940 con 0x7fcc480cfdb0 2023-09-12T16:07:03.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.488+0000 7fcc4fdff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc480c8c20 con 0x7fcc4815bca0 2023-09-12T16:07:03.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.489+0000 7fcc4e39c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc48158de0 0x7fcc480b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:03.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.489+0000 7fcc4e39c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc48158de0 0x7fcc480b58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55904/0 (socket says 172.21.15.112:55904) 2023-09-12T16:07:03.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.489+0000 7fcc4e39c700 1 -- 172.21.15.112:0/3026676708 learned_addr learned my addr 172.21.15.112:0/3026676708 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:03.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.489+0000 7fcc4d39a700 1 --2- 172.21.15.112:0/3026676708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc4815bca0 0x7fcc481f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:03.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.489+0000 7fcc4db9b700 1 --2- 172.21.15.112:0/3026676708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc480cfdb0 0x7fcc480c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:03.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.489+0000 7fcc4e39c700 1 -- 172.21.15.112:0/3026676708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc4815bca0 msgr2=0x7fcc481f60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:03.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.489+0000 7fcc4e39c700 1 --2- 172.21.15.112:0/3026676708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc4815bca0 0x7fcc481f60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:03.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.489+0000 7fcc4e39c700 1 -- 172.21.15.112:0/3026676708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc480cfdb0 msgr2=0x7fcc480c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:03.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.489+0000 7fcc4e39c700 1 --2- 172.21.15.112:0/3026676708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc480cfdb0 0x7fcc480c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:03.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.489+0000 7fcc4e39c700 1 -- 172.21.15.112:0/3026676708 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc44009520 con 0x7fcc48158de0 2023-09-12T16:07:03.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.489+0000 7fcc4e39c700 1 --2- 172.21.15.112:0/3026676708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc48158de0 0x7fcc480b58d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcc4000c810 tx=0x7fcc4000cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:03.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.490+0000 7fcc3e7fc700 1 -- 172.21.15.112:0/3026676708 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc40003e30 con 0x7fcc48158de0 2023-09-12T16:07:03.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.490+0000 7fcc3e7fc700 1 -- 172.21.15.112:0/3026676708 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcc40005070 con 0x7fcc48158de0 2023-09-12T16:07:03.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.490+0000 7fcc4fdff700 1 -- 172.21.15.112:0/3026676708 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc380095f0 con 0x7fcc48158de0 2023-09-12T16:07:03.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.490+0000 7fcc3e7fc700 1 -- 172.21.15.112:0/3026676708 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc40005480 con 0x7fcc48158de0 2023-09-12T16:07:03.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.490+0000 7fcc4fdff700 1 -- 172.21.15.112:0/3026676708 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc480b1d00 con 0x7fcc48158de0 2023-09-12T16:07:03.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.491+0000 7fcc4fdff700 1 -- 172.21.15.112:0/3026676708 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc480c9140 con 0x7fcc48158de0 2023-09-12T16:07:03.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.492+0000 7fcc3e7fc700 1 -- 172.21.15.112:0/3026676708 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fcc400055e0 con 0x7fcc48158de0 2023-09-12T16:07:03.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.492+0000 7fcc3e7fc700 1 --2- 172.21.15.112:0/3026676708 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcc2c06a580 0x7fcc2c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:03.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.493+0000 7fcc3e7fc700 1 -- 172.21.15.112:0/3026676708 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fcc40088b60 con 0x7fcc48158de0 2023-09-12T16:07:03.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.493+0000 7fcc4db9b700 1 --2- 172.21.15.112:0/3026676708 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcc2c06a580 0x7fcc2c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:03.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.493+0000 7fcc4db9b700 1 --2- 172.21.15.112:0/3026676708 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcc2c06a580 0x7fcc2c06ca40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcc44009d50 tx=0x7fcc44009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:03.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.497+0000 7fcc3e7fc700 1 -- 172.21.15.112:0/3026676708 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fcc480c9140 con 0x7fcc48158de0 2023-09-12T16:07:03.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:03.691+0000 7fcc4fdff700 1 -- 172.21.15.112:0/3026676708 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fcc480c9140 con 0x7fcc48158de0 2023-09-12T16:07:04.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.248+0000 7fcc3e7fc700 1 -- 172.21.15.112:0/3026676708 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcc480c9140 con 0x7fcc48158de0 2023-09-12T16:07:04.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.252+0000 7fcc4fdff700 1 -- 172.21.15.112:0/3026676708 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcc2c06a580 msgr2=0x7fcc2c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:04.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.252+0000 7fcc4fdff700 1 --2- 172.21.15.112:0/3026676708 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcc2c06a580 0x7fcc2c06ca40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcc44009d50 tx=0x7fcc44009260 comp rx=0 tx=0).stop 2023-09-12T16:07:04.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.252+0000 7fcc4fdff700 1 -- 172.21.15.112:0/3026676708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc48158de0 msgr2=0x7fcc480b58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:04.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.252+0000 7fcc4fdff700 1 --2- 172.21.15.112:0/3026676708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc48158de0 0x7fcc480b58d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcc4000c810 tx=0x7fcc4000cb20 comp rx=0 tx=0).stop 2023-09-12T16:07:04.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.252+0000 7fcc4fdff700 1 -- 172.21.15.112:0/3026676708 shutdown_connections 2023-09-12T16:07:04.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.253+0000 7fcc4fdff700 1 --2- 172.21.15.112:0/3026676708 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcc2c06a580 0x7fcc2c06ca40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:04.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.253+0000 7fcc4fdff700 1 --2- 172.21.15.112:0/3026676708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc48158de0 0x7fcc480b58d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:04.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.253+0000 7fcc4fdff700 1 --2- 172.21.15.112:0/3026676708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc480cfdb0 0x7fcc480c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:04.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.253+0000 7fcc4fdff700 1 --2- 172.21.15.112:0/3026676708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc4815bca0 0x7fcc481f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:04.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.253+0000 7fcc4fdff700 1 -- 172.21.15.112:0/3026676708 >> 172.21.15.112:0/3026676708 conn(0x7fcc480d17d0 msgr2=0x7fcc480aed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:04.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.253+0000 7fcc4fdff700 1 -- 172.21.15.112:0/3026676708 shutdown_connections 2023-09-12T16:07:04.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.253+0000 7fcc4fdff700 1 -- 172.21.15.112:0/3026676708 wait complete. 2023-09-12T16:07:04.269 INFO:teuthology.orchestra.run.smithi112.stderr:set pool 4 allow_ec_overwrites to true 2023-09-12T16:07:04.289 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-09-12T16:07:04.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.490+0000 7f19be9ff700 1 -- 172.21.15.112:0/232903956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19a0003b90 msgr2=0x7f19a0003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:04.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.490+0000 7f19be9ff700 1 --2- 172.21.15.112:0/232903956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19a0003b90 0x7f19a0003f90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f19a80018d0 tx=0x7f19a0005880 comp rx=0 tx=0).stop 2023-09-12T16:07:04.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.490+0000 7f19be9ff700 1 -- 172.21.15.112:0/232903956 shutdown_connections 2023-09-12T16:07:04.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.490+0000 7f19be9ff700 1 --2- 172.21.15.112:0/232903956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19a0003b90 0x7f19a0003f90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:04.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.490+0000 7f19be9ff700 1 -- 172.21.15.112:0/232903956 >> 172.21.15.112:0/232903956 conn(0x7f19b80d1930 msgr2=0x7f19b80d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:04.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.491+0000 7f19be9ff700 1 -- 172.21.15.112:0/232903956 shutdown_connections 2023-09-12T16:07:04.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.491+0000 7f19be9ff700 1 -- 172.21.15.112:0/232903956 wait complete. 2023-09-12T16:07:04.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.492+0000 7f19be9ff700 1 Processor -- start 2023-09-12T16:07:04.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.492+0000 7f19be9ff700 1 -- start start 2023-09-12T16:07:04.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.493+0000 7f19be9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19a0003b90 0x7f19b8154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:04.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.493+0000 7f19be9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19b81f6280 0x7f19b815d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:04.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.493+0000 7f19be9ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19b815d7e0 0x7f19b80ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:04.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.493+0000 7f19be9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b81f5e60 con 0x7f19b81f6280 2023-09-12T16:07:04.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.493+0000 7f19be9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b815dc60 con 0x7f19a0003b90 2023-09-12T16:07:04.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.493+0000 7f19be9ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b8159a50 con 0x7f19b815d7e0 2023-09-12T16:07:04.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.494+0000 7f19b77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19b81f6280 0x7f19b815d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:04.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.494+0000 7f19b77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19b81f6280 0x7f19b815d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55924/0 (socket says 172.21.15.112:55924) 2023-09-12T16:07:04.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.494+0000 7f19b77fe700 1 -- 172.21.15.112:0/338925800 learned_addr learned my addr 172.21.15.112:0/338925800 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:04.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.494+0000 7f19b7fff700 1 --2- 172.21.15.112:0/338925800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19a0003b90 0x7f19b8154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:04.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.494+0000 7f19bcf9c700 1 --2- 172.21.15.112:0/338925800 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19b815d7e0 0x7f19b80ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:04.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.494+0000 7f19b77fe700 1 -- 172.21.15.112:0/338925800 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19b815d7e0 msgr2=0x7f19b80ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:04.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.494+0000 7f19b77fe700 1 --2- 172.21.15.112:0/338925800 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19b815d7e0 0x7f19b80ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:04.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.494+0000 7f19b77fe700 1 -- 172.21.15.112:0/338925800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19a0003b90 msgr2=0x7f19b8154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:04.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.494+0000 7f19b77fe700 1 --2- 172.21.15.112:0/338925800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19a0003b90 0x7f19b8154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:04.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.494+0000 7f19b77fe700 1 -- 172.21.15.112:0/338925800 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b80cb7c0 con 0x7f19b81f6280 2023-09-12T16:07:04.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.494+0000 7f19b77fe700 1 --2- 172.21.15.112:0/338925800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19b81f6280 0x7f19b815d2a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00e5e0 tx=0x7f19ac00e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:04.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.494+0000 7f19b4ff9700 1 -- 172.21.15.112:0/338925800 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac010890 con 0x7f19b81f6280 2023-09-12T16:07:04.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.494+0000 7f19b4ff9700 1 -- 172.21.15.112:0/338925800 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f19ac010ae0 con 0x7f19b81f6280 2023-09-12T16:07:04.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.494+0000 7f19be9ff700 1 -- 172.21.15.112:0/338925800 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b80cb4e0 con 0x7f19b81f6280 2023-09-12T16:07:04.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.494+0000 7f19b4ff9700 1 -- 172.21.15.112:0/338925800 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac011460 con 0x7f19b81f6280 2023-09-12T16:07:04.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.495+0000 7f19be9ff700 1 -- 172.21.15.112:0/338925800 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b81f5a80 con 0x7f19b81f6280 2023-09-12T16:07:04.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.495+0000 7f19be9ff700 1 -- 172.21.15.112:0/338925800 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b804e300 con 0x7f19b81f6280 2023-09-12T16:07:04.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.496+0000 7f19b4ff9700 1 -- 172.21.15.112:0/338925800 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f19ac01a400 con 0x7f19b81f6280 2023-09-12T16:07:04.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.497+0000 7f19b4ff9700 1 --2- 172.21.15.112:0/338925800 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f19a406a580 0x7f19a406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:04.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.497+0000 7f19b4ff9700 1 -- 172.21.15.112:0/338925800 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f19ac0897c0 con 0x7f19b81f6280 2023-09-12T16:07:04.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.498+0000 7f19b7fff700 1 --2- 172.21.15.112:0/338925800 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f19a406a580 0x7f19a406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:04.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.498+0000 7f19b7fff700 1 --2- 172.21.15.112:0/338925800 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f19a406a580 0x7f19a406ca40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f19a8000c00 tx=0x7f19a800f000 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:04.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.502+0000 7f19b4ff9700 1 -- 172.21.15.112:0/338925800 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f19ac054a60 con 0x7f19b81f6280 2023-09-12T16:07:04.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:04.747+0000 7f19be9ff700 1 -- 172.21.15.112:0/338925800 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f19b80c4c80 con 0x7f19b81f6280 2023-09-12T16:07:05.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.274+0000 7f19b4ff9700 1 -- 172.21.15.112:0/338925800 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f19ac058080 con 0x7f19b81f6280 2023-09-12T16:07:05.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.277+0000 7f19be9ff700 1 -- 172.21.15.112:0/338925800 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f19a406a580 msgr2=0x7f19a406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:05.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.277+0000 7f19be9ff700 1 --2- 172.21.15.112:0/338925800 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f19a406a580 0x7f19a406ca40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f19a8000c00 tx=0x7f19a800f000 comp rx=0 tx=0).stop 2023-09-12T16:07:05.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.277+0000 7f19be9ff700 1 -- 172.21.15.112:0/338925800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19b81f6280 msgr2=0x7f19b815d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:05.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.277+0000 7f19be9ff700 1 --2- 172.21.15.112:0/338925800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19b81f6280 0x7f19b815d2a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00e5e0 tx=0x7f19ac00e9a0 comp rx=0 tx=0).stop 2023-09-12T16:07:05.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.277+0000 7f19be9ff700 1 -- 172.21.15.112:0/338925800 shutdown_connections 2023-09-12T16:07:05.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.277+0000 7f19be9ff700 1 --2- 172.21.15.112:0/338925800 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f19a406a580 0x7f19a406ca40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:05.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.277+0000 7f19be9ff700 1 --2- 172.21.15.112:0/338925800 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19b815d7e0 0x7f19b80ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:05.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.277+0000 7f19be9ff700 1 --2- 172.21.15.112:0/338925800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19a0003b90 0x7f19b8154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:05.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.277+0000 7f19be9ff700 1 --2- 172.21.15.112:0/338925800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19b81f6280 0x7f19b815d2a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:05.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.277+0000 7f19be9ff700 1 -- 172.21.15.112:0/338925800 >> 172.21.15.112:0/338925800 conn(0x7f19b80d1930 msgr2=0x7f19b8155fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:05.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.277+0000 7f19be9ff700 1 -- 172.21.15.112:0/338925800 shutdown_connections 2023-09-12T16:07:05.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.277+0000 7f19be9ff700 1 -- 172.21.15.112:0/338925800 wait complete. 2023-09-12T16:07:05.280 INFO:teuthology.orchestra.run.smithi112.stderr:added data pool 4 to fsmap 2023-09-12T16:07:05.296 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-12T16:07:05.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.497+0000 7f337d9ff700 1 -- 172.21.15.112:0/1816413439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3360004d90 msgr2=0x7f3360005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:05.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.497+0000 7f337d9ff700 1 --2- 172.21.15.112:0/1816413439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3360004d90 0x7f3360005210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f33780b2d00 tx=0x7f3360005880 comp rx=0 tx=0).stop 2023-09-12T16:07:05.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.497+0000 7f33777fe700 1 -- 172.21.15.112:0/1816413439 reap_dead start 2023-09-12T16:07:05.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.497+0000 7f337d9ff700 1 -- 172.21.15.112:0/1816413439 shutdown_connections 2023-09-12T16:07:05.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.497+0000 7f337d9ff700 1 -- 172.21.15.112:0/1816413439 >> 172.21.15.112:0/1816413439 conn(0x7f33780d1930 msgr2=0x7f33780d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:05.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.497+0000 7f337d9ff700 1 -- 172.21.15.112:0/1816413439 shutdown_connections 2023-09-12T16:07:05.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.497+0000 7f337d9ff700 1 -- 172.21.15.112:0/1816413439 wait complete. 2023-09-12T16:07:05.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.498+0000 7f337d9ff700 1 Processor -- start 2023-09-12T16:07:05.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.499+0000 7f337d9ff700 1 -- start start 2023-09-12T16:07:05.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.499+0000 7f337d9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3360004d90 0x7f33781561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:05.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.499+0000 7f337d9ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f33780c8970 0x7f33780c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:05.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.500+0000 7f337d9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33780c8df0 0x7f33780c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:05.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.500+0000 7f337d9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33781579a0 con 0x7f3360004d90 2023-09-12T16:07:05.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.500+0000 7f337d9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33781566e0 con 0x7f33780c8df0 2023-09-12T16:07:05.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.500+0000 7f337d9ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33780c9350 con 0x7f33780c8970 2023-09-12T16:07:05.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.500+0000 7f3376ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3360004d90 0x7f33781561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:05.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.500+0000 7f3376ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3360004d90 0x7f33781561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55952/0 (socket says 172.21.15.112:55952) 2023-09-12T16:07:05.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.500+0000 7f3376ffd700 1 -- 172.21.15.112:0/2655382478 learned_addr learned my addr 172.21.15.112:0/2655382478 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:05.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.500+0000 7f3376ffd700 1 -- 172.21.15.112:0/2655382478 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f33780c8970 msgr2=0x7f33780c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:05.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.500+0000 7f33767fc700 1 --2- 172.21.15.112:0/2655382478 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f33780c8970 0x7f33780c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:05.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.500+0000 7f3376ffd700 1 --2- 172.21.15.112:0/2655382478 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f33780c8970 0x7f33780c5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:05.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.500+0000 7f3376ffd700 1 -- 172.21.15.112:0/2655382478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33780c8df0 msgr2=0x7f33780c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:05.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.500+0000 7f3376ffd700 1 --2- 172.21.15.112:0/2655382478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33780c8df0 0x7f33780c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:05.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.500+0000 7f3376ffd700 1 -- 172.21.15.112:0/2655382478 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33780c9630 con 0x7f3360004d90 2023-09-12T16:07:05.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.500+0000 7f3376ffd700 1 --2- 172.21.15.112:0/2655382478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3360004d90 0x7f33781561a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3368011ae0 tx=0x7f3368011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:05.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.501+0000 7f335ffff700 1 -- 172.21.15.112:0/2655382478 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336800fb00 con 0x7f3360004d90 2023-09-12T16:07:05.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.501+0000 7f335ffff700 1 -- 172.21.15.112:0/2655382478 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f336800fc60 con 0x7f3360004d90 2023-09-12T16:07:05.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.501+0000 7f337d9ff700 1 -- 172.21.15.112:0/2655382478 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3378157630 con 0x7f3360004d90 2023-09-12T16:07:05.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.501+0000 7f335ffff700 1 -- 172.21.15.112:0/2655382478 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3368019410 con 0x7f3360004d90 2023-09-12T16:07:05.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.501+0000 7f337d9ff700 1 -- 172.21.15.112:0/2655382478 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33780ca650 con 0x7f3360004d90 2023-09-12T16:07:05.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.502+0000 7f337d9ff700 1 -- 172.21.15.112:0/2655382478 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3378157c80 con 0x7f3360004d90 2023-09-12T16:07:05.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.503+0000 7f335ffff700 1 -- 172.21.15.112:0/2655382478 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f3368019570 con 0x7f3360004d90 2023-09-12T16:07:05.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.503+0000 7f335ffff700 1 --2- 172.21.15.112:0/2655382478 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f336406a5b0 0x7f336406ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:05.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.504+0000 7f335ffff700 1 -- 172.21.15.112:0/2655382478 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3368089750 con 0x7f3360004d90 2023-09-12T16:07:05.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.504+0000 7f33767fc700 1 --2- 172.21.15.112:0/2655382478 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f336406a5b0 0x7f336406ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:05.507 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.504+0000 7f33767fc700 1 --2- 172.21.15.112:0/2655382478 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f336406a5b0 0x7f336406ca70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f33780b55f0 tx=0x7f336c006a90 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:05.507 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.508+0000 7f335ffff700 1 -- 172.21.15.112:0/2655382478 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f3368054ab0 con 0x7f3360004d90 2023-09-12T16:07:05.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.745+0000 7f337d9ff700 1 -- 172.21.15.112:0/2655382478 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f337804e300 con 0x7f3360004d90 2023-09-12T16:07:05.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.746+0000 7f335ffff700 1 -- 172.21.15.112:0/2655382478 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f33680580d0 con 0x7f3360004d90 2023-09-12T16:07:05.746 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:05.747 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3995117138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3995117138},{"type":"v1","addr":"172.21.15.112:6836","nonce":3995117138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3233826602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3233826602},{"type":"v1","addr":"172.21.15.112:6837","nonce":3233826602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1854265710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1854265710},{"type":"v1","addr":"172.21.15.144:6834","nonce":1854265710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-12T16:06:59.697334+0000","modified":"2023-09-12T16:07:04.748576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4396":{"gid":4396,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/2785398652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2785398652},{"type":"v1","addr":"172.21.15.144:6835","nonce":2785398652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-09-12T16:07:05.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.748+0000 7f337d9ff700 1 -- 172.21.15.112:0/2655382478 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f336406a5b0 msgr2=0x7f336406ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:05.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.748+0000 7f337d9ff700 1 --2- 172.21.15.112:0/2655382478 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f336406a5b0 0x7f336406ca70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f33780b55f0 tx=0x7f336c006a90 comp rx=0 tx=0).stop 2023-09-12T16:07:05.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.748+0000 7f337d9ff700 1 -- 172.21.15.112:0/2655382478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3360004d90 msgr2=0x7f33781561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:05.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.748+0000 7f337d9ff700 1 --2- 172.21.15.112:0/2655382478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3360004d90 0x7f33781561a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3368011ae0 tx=0x7f3368011ea0 comp rx=0 tx=0).stop 2023-09-12T16:07:05.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.748+0000 7f337d9ff700 1 -- 172.21.15.112:0/2655382478 shutdown_connections 2023-09-12T16:07:05.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.748+0000 7f337d9ff700 1 --2- 172.21.15.112:0/2655382478 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f336406a5b0 0x7f336406ca70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:05.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.748+0000 7f337d9ff700 1 --2- 172.21.15.112:0/2655382478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33780c8df0 0x7f33780c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:05.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.748+0000 7f337d9ff700 1 --2- 172.21.15.112:0/2655382478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3360004d90 0x7f33781561a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:05.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.748+0000 7f337d9ff700 1 --2- 172.21.15.112:0/2655382478 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f33780c8970 0x7f33780c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:05.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.748+0000 7f337d9ff700 1 -- 172.21.15.112:0/2655382478 >> 172.21.15.112:0/2655382478 conn(0x7f33780d1930 msgr2=0x7f337806b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:05.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.749+0000 7f337d9ff700 1 -- 172.21.15.112:0/2655382478 shutdown_connections 2023-09-12T16:07:05.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.749+0000 7f337d9ff700 1 -- 172.21.15.112:0/2655382478 wait complete. 2023-09-12T16:07:05.751 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 7 2023-09-12T16:07:05.767 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:07:05.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.971+0000 7f591f9ff700 1 -- 172.21.15.112:0/319651612 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59180d0590 msgr2=0x7f59180cc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:05.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.971+0000 7f591f9ff700 1 --2- 172.21.15.112:0/319651612 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59180d0590 0x7f59180cc8f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5910009fd0 tx=0x7f591000b380 comp rx=0 tx=0).stop 2023-09-12T16:07:05.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.971+0000 7f591f9ff700 1 -- 172.21.15.112:0/319651612 shutdown_connections 2023-09-12T16:07:05.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.971+0000 7f591f9ff700 1 --2- 172.21.15.112:0/319651612 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59180d0590 0x7f59180cc8f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:05.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.971+0000 7f591f9ff700 1 --2- 172.21.15.112:0/319651612 >> v2:172.21.15.144:3300/0 conn(0x7f59180cdfb0 0x7f59180cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:05.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.971+0000 7f591f9ff700 1 -- 172.21.15.112:0/319651612 >> 172.21.15.112:0/319651612 conn(0x7f59180d1930 msgr2=0x7f59180d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:05.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.971+0000 7f591f9ff700 1 -- 172.21.15.112:0/319651612 shutdown_connections 2023-09-12T16:07:05.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.971+0000 7f591f9ff700 1 -- 172.21.15.112:0/319651612 wait complete. 2023-09-12T16:07:05.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.973+0000 7f591f9ff700 1 Processor -- start 2023-09-12T16:07:05.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.973+0000 7f591f9ff700 1 -- start start 2023-09-12T16:07:05.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.974+0000 7f591f9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59180cdfb0 0x7f59181539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:05.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.974+0000 7f591f9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59180d0590 0x7f59181573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:05.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.974+0000 7f591f9ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f591815f480 0x7f59181f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:05.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.974+0000 7f591f9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59181f5440 con 0x7f59180cdfb0 2023-09-12T16:07:05.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.974+0000 7f591f9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591815d910 con 0x7f59180d0590 2023-09-12T16:07:05.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.974+0000 7f591f9ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591815dbf0 con 0x7f591815f480 2023-09-12T16:07:05.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.974+0000 7f591d79b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59180cdfb0 0x7f59181539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:05.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.974+0000 7f591d79b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59180cdfb0 0x7f59181539a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51718/0 (socket says 172.21.15.112:51718) 2023-09-12T16:07:05.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.974+0000 7f591d79b700 1 -- 172.21.15.112:0/3644166456 learned_addr learned my addr 172.21.15.112:0/3644166456 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:05.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.974+0000 7f591cf9a700 1 --2- 172.21.15.112:0/3644166456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59180d0590 0x7f59181573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:05.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.974+0000 7f591df9c700 1 --2- 172.21.15.112:0/3644166456 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f591815f480 0x7f59181f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:05.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.975+0000 7f591d79b700 1 -- 172.21.15.112:0/3644166456 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f591815f480 msgr2=0x7f59181f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:05.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.975+0000 7f591d79b700 1 --2- 172.21.15.112:0/3644166456 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f591815f480 0x7f59181f5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:05.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.975+0000 7f591d79b700 1 -- 172.21.15.112:0/3644166456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59180d0590 msgr2=0x7f59181573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:05.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.975+0000 7f591d79b700 1 --2- 172.21.15.112:0/3644166456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59180d0590 0x7f59181573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:05.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.975+0000 7f591d79b700 1 -- 172.21.15.112:0/3644166456 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5908009520 con 0x7f59180cdfb0 2023-09-12T16:07:05.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.975+0000 7f591df9c700 1 --2- 172.21.15.112:0/3644166456 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f591815f480 0x7f59181f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:07:05.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.975+0000 7f591d79b700 1 --2- 172.21.15.112:0/3644166456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59180cdfb0 0x7f59181539a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5914001f00 tx=0x7f591400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:05.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.975+0000 7f590dffb700 1 -- 172.21.15.112:0/3644166456 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59140052d0 con 0x7f59180cdfb0 2023-09-12T16:07:05.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.975+0000 7f590dffb700 1 -- 172.21.15.112:0/3644166456 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5914005520 con 0x7f59180cdfb0 2023-09-12T16:07:05.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.975+0000 7f590dffb700 1 -- 172.21.15.112:0/3644166456 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914003930 con 0x7f59180cdfb0 2023-09-12T16:07:05.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.975+0000 7f591f9ff700 1 -- 172.21.15.112:0/3644166456 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5910009d00 con 0x7f59180cdfb0 2023-09-12T16:07:05.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.975+0000 7f591f9ff700 1 -- 172.21.15.112:0/3644166456 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59180b2ba0 con 0x7f59180cdfb0 2023-09-12T16:07:05.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.976+0000 7f591f9ff700 1 -- 172.21.15.112:0/3644166456 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f591804e300 con 0x7f59180cdfb0 2023-09-12T16:07:05.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.977+0000 7f590dffb700 1 -- 172.21.15.112:0/3644166456 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f5914003a90 con 0x7f59180cdfb0 2023-09-12T16:07:05.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.978+0000 7f590dffb700 1 --2- 172.21.15.112:0/3644166456 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f58fc06a580 0x7f58fc06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:05.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.978+0000 7f590dffb700 1 -- 172.21.15.112:0/3644166456 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f59140883d0 con 0x7f59180cdfb0 2023-09-12T16:07:05.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.978+0000 7f591cf9a700 1 --2- 172.21.15.112:0/3644166456 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f58fc06a580 0x7f58fc06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:05.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.979+0000 7f591cf9a700 1 --2- 172.21.15.112:0/3644166456 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f58fc06a580 0x7f58fc06ca40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f59181571b0 tx=0x7f5908009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:05.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:05.982+0000 7f590dffb700 1 -- 172.21.15.112:0/3644166456 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f59140536f0 con 0x7f59180cdfb0 2023-09-12T16:07:06.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.178+0000 7f591f9ff700 1 -- 172.21.15.112:0/3644166456 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59180b4300 con 0x7f59180cdfb0 2023-09-12T16:07:06.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.180+0000 7f590dffb700 1 -- 172.21.15.112:0/3644166456 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f5914056d10 con 0x7f59180cdfb0 2023-09-12T16:07:06.181 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:06.181 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:04.748402+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:07:06.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.182+0000 7f591f9ff700 1 -- 172.21.15.112:0/3644166456 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f58fc06a580 msgr2=0x7f58fc06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:06.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.182+0000 7f591f9ff700 1 --2- 172.21.15.112:0/3644166456 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f58fc06a580 0x7f58fc06ca40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f59181571b0 tx=0x7f5908009260 comp rx=0 tx=0).stop 2023-09-12T16:07:06.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.182+0000 7f591f9ff700 1 -- 172.21.15.112:0/3644166456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59180cdfb0 msgr2=0x7f59181539a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:06.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.182+0000 7f591f9ff700 1 --2- 172.21.15.112:0/3644166456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59180cdfb0 0x7f59181539a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5914001f00 tx=0x7f591400c7b0 comp rx=0 tx=0).stop 2023-09-12T16:07:06.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.182+0000 7f591f9ff700 1 -- 172.21.15.112:0/3644166456 shutdown_connections 2023-09-12T16:07:06.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.182+0000 7f591f9ff700 1 --2- 172.21.15.112:0/3644166456 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f58fc06a580 0x7f58fc06ca40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:06.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.182+0000 7f591f9ff700 1 --2- 172.21.15.112:0/3644166456 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f591815f480 0x7f59181f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:06.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.182+0000 7f591f9ff700 1 --2- 172.21.15.112:0/3644166456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59180cdfb0 0x7f59181539a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:06.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.182+0000 7f591f9ff700 1 --2- 172.21.15.112:0/3644166456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59180d0590 0x7f59181573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:06.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.182+0000 7f591f9ff700 1 -- 172.21.15.112:0/3644166456 >> 172.21.15.112:0/3644166456 conn(0x7f59180d1930 msgr2=0x7f591815bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:06.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.183+0000 7f591f9ff700 1 -- 172.21.15.112:0/3644166456 shutdown_connections 2023-09-12T16:07:06.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.183+0000 7f591f9ff700 1 -- 172.21.15.112:0/3644166456 wait complete. 2023-09-12T16:07:06.197 INFO:tasks.ceph.mds.d.smithi144.stderr:2023-09-12T16:07:06.197+0000 7f57757f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-12T16:07:06.200 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:07:06.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.400+0000 7f5f8b5ff700 1 -- 172.21.15.112:0/476931405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f8415f0d0 msgr2=0x7f5f840cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:06.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.400+0000 7f5f8b5ff700 1 --2- 172.21.15.112:0/476931405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f8415f0d0 0x7f5f840cfe20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009970 tx=0x7f5f80009c80 comp rx=0 tx=0).stop 2023-09-12T16:07:06.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.400+0000 7f5f8b5ff700 1 -- 172.21.15.112:0/476931405 shutdown_connections 2023-09-12T16:07:06.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.400+0000 7f5f8b5ff700 1 --2- 172.21.15.112:0/476931405 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f840b3a60 0x7f5f840b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:06.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.400+0000 7f5f8b5ff700 1 --2- 172.21.15.112:0/476931405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f8415f0d0 0x7f5f840cfe20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:06.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.400+0000 7f5f8b5ff700 1 -- 172.21.15.112:0/476931405 >> 172.21.15.112:0/476931405 conn(0x7f5f8409abe0 msgr2=0x7f5f840d18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:06.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.400+0000 7f5f8b5ff700 1 -- 172.21.15.112:0/476931405 shutdown_connections 2023-09-12T16:07:06.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.400+0000 7f5f8b5ff700 1 -- 172.21.15.112:0/476931405 wait complete. 2023-09-12T16:07:06.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.402+0000 7f5f8b5ff700 1 Processor -- start 2023-09-12T16:07:06.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.402+0000 7f5f8b5ff700 1 -- start start 2023-09-12T16:07:06.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.403+0000 7f5f8b5ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f840b3a60 0x7f5f840c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:06.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.403+0000 7f5f8b5ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f840d21f0 0x7f5f8414bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:06.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.403+0000 7f5f8b5ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f8415f0d0 0x7f5f8415ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:06.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.403+0000 7f5f8b5ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8414c2e0 con 0x7f5f840d21f0 2023-09-12T16:07:06.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.403+0000 7f5f8b5ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f841594b0 con 0x7f5f840b3a60 2023-09-12T16:07:06.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.403+0000 7f5f8b5ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f841e6540 con 0x7f5f8415f0d0 2023-09-12T16:07:06.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.403+0000 7f5f88b9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f840d21f0 0x7f5f8414bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:06.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.403+0000 7f5f88b9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f840d21f0 0x7f5f8414bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51734/0 (socket says 172.21.15.112:51734) 2023-09-12T16:07:06.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.403+0000 7f5f88b9a700 1 -- 172.21.15.112:0/464962038 learned_addr learned my addr 172.21.15.112:0/464962038 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:06.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.403+0000 7f5f8939b700 1 --2- 172.21.15.112:0/464962038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f840b3a60 0x7f5f840c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:06.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.404+0000 7f5f89b9c700 1 --2- 172.21.15.112:0/464962038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f8415f0d0 0x7f5f8415ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:06.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.404+0000 7f5f88b9a700 1 -- 172.21.15.112:0/464962038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f8415f0d0 msgr2=0x7f5f8415ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:06.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.404+0000 7f5f88b9a700 1 --2- 172.21.15.112:0/464962038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f8415f0d0 0x7f5f8415ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:06.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.404+0000 7f5f88b9a700 1 -- 172.21.15.112:0/464962038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f840b3a60 msgr2=0x7f5f840c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:06.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.404+0000 7f5f88b9a700 1 --2- 172.21.15.112:0/464962038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f840b3a60 0x7f5f840c5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:06.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.404+0000 7f5f88b9a700 1 -- 172.21.15.112:0/464962038 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f80009580 con 0x7f5f840d21f0 2023-09-12T16:07:06.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.404+0000 7f5f88b9a700 1 --2- 172.21.15.112:0/464962038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f840d21f0 0x7f5f8414bda0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5f7400c4c0 tx=0x7f5f7400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:06.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.404+0000 7f5f79ffb700 1 -- 172.21.15.112:0/464962038 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f740052d0 con 0x7f5f840d21f0 2023-09-12T16:07:06.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.404+0000 7f5f79ffb700 1 -- 172.21.15.112:0/464962038 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5f7400ce90 con 0x7f5f840d21f0 2023-09-12T16:07:06.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.404+0000 7f5f8b5ff700 1 -- 172.21.15.112:0/464962038 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f841e5f80 con 0x7f5f840d21f0 2023-09-12T16:07:06.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.404+0000 7f5f79ffb700 1 -- 172.21.15.112:0/464962038 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74005580 con 0x7f5f840d21f0 2023-09-12T16:07:06.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.405+0000 7f5f8b5ff700 1 -- 172.21.15.112:0/464962038 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8415a500 con 0x7f5f840d21f0 2023-09-12T16:07:06.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.405+0000 7f5f8b5ff700 1 -- 172.21.15.112:0/464962038 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8404e300 con 0x7f5f840d21f0 2023-09-12T16:07:06.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.406+0000 7f5f79ffb700 1 -- 172.21.15.112:0/464962038 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f5f74003680 con 0x7f5f840d21f0 2023-09-12T16:07:06.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.408+0000 7f5f79ffb700 1 --2- 172.21.15.112:0/464962038 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5f6806a580 0x7f5f6806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:06.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.408+0000 7f5f79ffb700 1 -- 172.21.15.112:0/464962038 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5f74088140 con 0x7f5f840d21f0 2023-09-12T16:07:06.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.408+0000 7f5f8939b700 1 --2- 172.21.15.112:0/464962038 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5f6806a580 0x7f5f6806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:06.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.408+0000 7f5f8939b700 1 --2- 172.21.15.112:0/464962038 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5f6806a580 0x7f5f6806ca40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5f80000c00 tx=0x7f5f800047c0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:06.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.412+0000 7f5f79ffb700 1 -- 172.21.15.112:0/464962038 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5f740533c0 con 0x7f5f840d21f0 2023-09-12T16:07:06.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.611+0000 7f5f8b5ff700 1 -- 172.21.15.112:0/464962038 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f840c4fc0 con 0x7f5f840d21f0 2023-09-12T16:07:06.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.613+0000 7f5f79ffb700 1 -- 172.21.15.112:0/464962038 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f5f740569e0 con 0x7f5f840d21f0 2023-09-12T16:07:06.614 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:06.614 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:04.748402+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:07:06.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.615+0000 7f5f8b5ff700 1 -- 172.21.15.112:0/464962038 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5f6806a580 msgr2=0x7f5f6806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:06.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.615+0000 7f5f8b5ff700 1 --2- 172.21.15.112:0/464962038 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5f6806a580 0x7f5f6806ca40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5f80000c00 tx=0x7f5f800047c0 comp rx=0 tx=0).stop 2023-09-12T16:07:06.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.615+0000 7f5f8b5ff700 1 -- 172.21.15.112:0/464962038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f840d21f0 msgr2=0x7f5f8414bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:06.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.615+0000 7f5f8b5ff700 1 --2- 172.21.15.112:0/464962038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f840d21f0 0x7f5f8414bda0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5f7400c4c0 tx=0x7f5f7400c7d0 comp rx=0 tx=0).stop 2023-09-12T16:07:06.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.615+0000 7f5f8b5ff700 1 -- 172.21.15.112:0/464962038 shutdown_connections 2023-09-12T16:07:06.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.615+0000 7f5f8b5ff700 1 --2- 172.21.15.112:0/464962038 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5f6806a580 0x7f5f6806ca40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:06.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.615+0000 7f5f8b5ff700 1 --2- 172.21.15.112:0/464962038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f8415f0d0 0x7f5f8415ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:06.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.615+0000 7f5f8b5ff700 1 --2- 172.21.15.112:0/464962038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f840b3a60 0x7f5f840c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:06.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.615+0000 7f5f8b5ff700 1 --2- 172.21.15.112:0/464962038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f840d21f0 0x7f5f8414bda0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:06.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.615+0000 7f5f8b5ff700 1 -- 172.21.15.112:0/464962038 >> 172.21.15.112:0/464962038 conn(0x7f5f8409abe0 msgr2=0x7f5f840cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:06.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.615+0000 7f5f8b5ff700 1 -- 172.21.15.112:0/464962038 shutdown_connections 2023-09-12T16:07:06.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.616+0000 7f5f8b5ff700 1 -- 172.21.15.112:0/464962038 wait complete. 2023-09-12T16:07:06.649 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-12T16:07:06.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.849+0000 7f26e739d700 1 -- 172.21.15.112:0/1315048473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26e00cfc50 msgr2=0x7f26e006b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:06.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.849+0000 7f26e739d700 1 --2- 172.21.15.112:0/1315048473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26e00cfc50 0x7f26e006b070 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f26e00cbb00 tx=0x7f26d800b380 comp rx=0 tx=0).stop 2023-09-12T16:07:06.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.849+0000 7f26e739d700 1 -- 172.21.15.112:0/1315048473 shutdown_connections 2023-09-12T16:07:06.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.849+0000 7f26e739d700 1 --2- 172.21.15.112:0/1315048473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26e00cfc50 0x7f26e006b070 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:06.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.849+0000 7f26e739d700 1 --2- 172.21.15.112:0/1315048473 >> v2:172.21.15.144:3300/0 conn(0x7f26e015ec90 0x7f26e00b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:06.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.849+0000 7f26e739d700 1 --2- 172.21.15.112:0/1315048473 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26e00b72a0 0x7f26e00cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:06.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.849+0000 7f26e739d700 1 -- 172.21.15.112:0/1315048473 >> 172.21.15.112:0/1315048473 conn(0x7f26e0071d80 msgr2=0x7f26e00d1500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:06.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.849+0000 7f26e739d700 1 -- 172.21.15.112:0/1315048473 shutdown_connections 2023-09-12T16:07:06.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.849+0000 7f26e739d700 1 -- 172.21.15.112:0/1315048473 wait complete. 2023-09-12T16:07:06.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.851+0000 7f26e739d700 1 Processor -- start 2023-09-12T16:07:06.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.851+0000 7f26e739d700 1 -- start start 2023-09-12T16:07:06.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.852+0000 7f26e739d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26e00b72a0 0x7f26e00b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:06.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.852+0000 7f26e739d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26e00cfc50 0x7f26e0151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:06.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.852+0000 7f26e739d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26e015ec90 0x7f26e00c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:06.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.852+0000 7f26e739d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00b28f0 con 0x7f26e00cfc50 2023-09-12T16:07:06.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.852+0000 7f26e739d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00b1ce0 con 0x7f26e00b72a0 2023-09-12T16:07:06.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.852+0000 7f26e739d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00b1fc0 con 0x7f26e015ec90 2023-09-12T16:07:06.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.852+0000 7f26e5b9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26e00cfc50 0x7f26e0151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:06.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.852+0000 7f26e5b9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26e00cfc50 0x7f26e0151810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51758/0 (socket says 172.21.15.112:51758) 2023-09-12T16:07:06.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.852+0000 7f26e5b9a700 1 -- 172.21.15.112:0/930855400 learned_addr learned my addr 172.21.15.112:0/930855400 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:06.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.852+0000 7f26e639b700 1 --2- 172.21.15.112:0/930855400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26e00b72a0 0x7f26e00b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:06.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.852+0000 7f26e6b9c700 1 --2- 172.21.15.112:0/930855400 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26e015ec90 0x7f26e00c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:06.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.853+0000 7f26e5b9a700 1 -- 172.21.15.112:0/930855400 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26e015ec90 msgr2=0x7f26e00c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:06.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.853+0000 7f26e5b9a700 1 --2- 172.21.15.112:0/930855400 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26e015ec90 0x7f26e00c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:06.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.853+0000 7f26e5b9a700 1 -- 172.21.15.112:0/930855400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26e00b72a0 msgr2=0x7f26e00b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:06.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.853+0000 7f26e5b9a700 1 --2- 172.21.15.112:0/930855400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26e00b72a0 0x7f26e00b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:06.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.853+0000 7f26e5b9a700 1 -- 172.21.15.112:0/930855400 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc009520 con 0x7f26e00cfc50 2023-09-12T16:07:06.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.853+0000 7f26e5b9a700 1 --2- 172.21.15.112:0/930855400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26e00cfc50 0x7f26e0151810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f26d000e9f0 tx=0x7f26d000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:06.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.853+0000 7f26d6ffd700 1 -- 172.21.15.112:0/930855400 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d000c9c0 con 0x7f26e00cfc50 2023-09-12T16:07:06.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.853+0000 7f26d6ffd700 1 -- 172.21.15.112:0/930855400 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f26d000cc10 con 0x7f26e00cfc50 2023-09-12T16:07:06.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.853+0000 7f26d6ffd700 1 -- 172.21.15.112:0/930855400 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d0010430 con 0x7f26e00cfc50 2023-09-12T16:07:06.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.853+0000 7f26e739d700 1 -- 172.21.15.112:0/930855400 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d8009d00 con 0x7f26e00cfc50 2023-09-12T16:07:06.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.853+0000 7f26e739d700 1 -- 172.21.15.112:0/930855400 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e00b2580 con 0x7f26e00cfc50 2023-09-12T16:07:06.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.854+0000 7f26e739d700 1 -- 172.21.15.112:0/930855400 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e00c7ed0 con 0x7f26e00cfc50 2023-09-12T16:07:06.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.855+0000 7f26d6ffd700 1 -- 172.21.15.112:0/930855400 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f26d0010590 con 0x7f26e00cfc50 2023-09-12T16:07:06.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.856+0000 7f26d6ffd700 1 --2- 172.21.15.112:0/930855400 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f26c406a580 0x7f26c406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:06.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.856+0000 7f26d6ffd700 1 -- 172.21.15.112:0/930855400 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f26d0014070 con 0x7f26e00cfc50 2023-09-12T16:07:06.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.856+0000 7f26e639b700 1 --2- 172.21.15.112:0/930855400 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f26c406a580 0x7f26c406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:06.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.857+0000 7f26e639b700 1 --2- 172.21.15.112:0/930855400 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f26c406a580 0x7f26c406ca40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f26dc009d50 tx=0x7f26dc009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:06.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:06.860+0000 7f26d6ffd700 1 -- 172.21.15.112:0/930855400 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f26d00519b0 con 0x7f26e00cfc50 2023-09-12T16:07:07.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.096+0000 7f26e739d700 1 -- 172.21.15.112:0/930855400 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26e015f250 con 0x7f26e00cfc50 2023-09-12T16:07:07.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.097+0000 7f26d6ffd700 1 -- 172.21.15.112:0/930855400 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f26d0054860 con 0x7f26e00cfc50 2023-09-12T16:07:07.097 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:07.098 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3995117138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3995117138},{"type":"v1","addr":"172.21.15.112:6836","nonce":3995117138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3233826602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3233826602},{"type":"v1","addr":"172.21.15.112:6837","nonce":3233826602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1854265710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1854265710},{"type":"v1","addr":"172.21.15.144:6834","nonce":1854265710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-12T16:06:59.697334+0000","modified":"2023-09-12T16:07:04.748576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4396":{"gid":4396,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/2785398652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2785398652},{"type":"v1","addr":"172.21.15.144:6835","nonce":2785398652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-09-12T16:07:07.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.099+0000 7f26e739d700 1 -- 172.21.15.112:0/930855400 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f26c406a580 msgr2=0x7f26c406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:07.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.099+0000 7f26e739d700 1 --2- 172.21.15.112:0/930855400 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f26c406a580 0x7f26c406ca40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f26dc009d50 tx=0x7f26dc009260 comp rx=0 tx=0).stop 2023-09-12T16:07:07.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.099+0000 7f26e739d700 1 -- 172.21.15.112:0/930855400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26e00cfc50 msgr2=0x7f26e0151810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:07.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.099+0000 7f26e739d700 1 --2- 172.21.15.112:0/930855400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26e00cfc50 0x7f26e0151810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f26d000e9f0 tx=0x7f26d000ed00 comp rx=0 tx=0).stop 2023-09-12T16:07:07.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.099+0000 7f26e739d700 1 -- 172.21.15.112:0/930855400 shutdown_connections 2023-09-12T16:07:07.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.099+0000 7f26e739d700 1 --2- 172.21.15.112:0/930855400 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f26c406a580 0x7f26c406ca40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:07.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.099+0000 7f26e739d700 1 --2- 172.21.15.112:0/930855400 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26e015ec90 0x7f26e00c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:07.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.099+0000 7f26e739d700 1 --2- 172.21.15.112:0/930855400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26e00b72a0 0x7f26e00b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:07.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.099+0000 7f26e739d700 1 --2- 172.21.15.112:0/930855400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26e00cfc50 0x7f26e0151810 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:07.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.099+0000 7f26e739d700 1 -- 172.21.15.112:0/930855400 >> 172.21.15.112:0/930855400 conn(0x7f26e0071d80 msgr2=0x7f26e015c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:07.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.100+0000 7f26e739d700 1 -- 172.21.15.112:0/930855400 shutdown_connections 2023-09-12T16:07:07.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.100+0000 7f26e739d700 1 -- 172.21.15.112:0/930855400 wait complete. 2023-09-12T16:07:07.104 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 7 2023-09-12T16:07:07.117 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:07:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.320+0000 7f86a61ff700 1 -- 172.21.15.112:0/2830427330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86a00b28f0 msgr2=0x7f86a00cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:07.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.320+0000 7f86a61ff700 1 --2- 172.21.15.112:0/2830427330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86a00b28f0 0x7f86a00cd3c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f86a00cf400 tx=0x7f869800b380 comp rx=0 tx=0).stop 2023-09-12T16:07:07.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.320+0000 7f86a61ff700 1 -- 172.21.15.112:0/2830427330 shutdown_connections 2023-09-12T16:07:07.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.320+0000 7f86a61ff700 1 --2- 172.21.15.112:0/2830427330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86a00b28f0 0x7f86a00cd3c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:07.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.320+0000 7f86a61ff700 1 --2- 172.21.15.112:0/2830427330 >> v2:172.21.15.144:3300/0 conn(0x7f86a015f480 0x7f86a00cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:07.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.320+0000 7f86a61ff700 1 -- 172.21.15.112:0/2830427330 >> 172.21.15.112:0/2830427330 conn(0x7f86a00d1930 msgr2=0x7f86a00d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:07.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.320+0000 7f86a61ff700 1 -- 172.21.15.112:0/2830427330 shutdown_connections 2023-09-12T16:07:07.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.320+0000 7f86a61ff700 1 -- 172.21.15.112:0/2830427330 wait complete. 2023-09-12T16:07:07.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.322+0000 7f86a61ff700 1 Processor -- start 2023-09-12T16:07:07.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.322+0000 7f86a61ff700 1 -- start start 2023-09-12T16:07:07.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.323+0000 7f86a61ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86a00b28f0 0x7f86a01e6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:07.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.323+0000 7f86a61ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86a00cdfb0 0x7f86a00b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:07.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.323+0000 7f86a61ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86a015f480 0x7f86a01587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:07.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.323+0000 7f86a61ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a0158d00 con 0x7f86a00cdfb0 2023-09-12T16:07:07.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.323+0000 7f86a61ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00b5110 con 0x7f86a015f480 2023-09-12T16:07:07.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.323+0000 7f86a61ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00b53b0 con 0x7f86a00b28f0 2023-09-12T16:07:07.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.323+0000 7f869effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86a00cdfb0 0x7f86a00b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:07.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.323+0000 7f869effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86a00cdfb0 0x7f86a00b6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51776/0 (socket says 172.21.15.112:51776) 2023-09-12T16:07:07.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.323+0000 7f869effd700 1 -- 172.21.15.112:0/789117934 learned_addr learned my addr 172.21.15.112:0/789117934 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:07.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.323+0000 7f869f7fe700 1 --2- 172.21.15.112:0/789117934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86a00b28f0 0x7f86a01e6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:07.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.323+0000 7f869ffff700 1 --2- 172.21.15.112:0/789117934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86a015f480 0x7f86a01587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:07.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.324+0000 7f869effd700 1 -- 172.21.15.112:0/789117934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86a00b28f0 msgr2=0x7f86a01e6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:07.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.324+0000 7f869effd700 1 --2- 172.21.15.112:0/789117934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86a00b28f0 0x7f86a01e6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:07.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.324+0000 7f869effd700 1 -- 172.21.15.112:0/789117934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86a015f480 msgr2=0x7f86a01587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:07.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.324+0000 7f869effd700 1 --2- 172.21.15.112:0/789117934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86a015f480 0x7f86a01587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:07.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.324+0000 7f869effd700 1 -- 172.21.15.112:0/789117934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8698009d00 con 0x7f86a00cdfb0 2023-09-12T16:07:07.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.324+0000 7f869ffff700 1 --2- 172.21.15.112:0/789117934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86a015f480 0x7f86a01587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:07:07.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.324+0000 7f869f7fe700 1 --2- 172.21.15.112:0/789117934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86a00b28f0 0x7f86a01e6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:07:07.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.324+0000 7f869effd700 1 --2- 172.21.15.112:0/789117934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86a00cdfb0 0x7f86a00b6170 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f869400c4e0 tx=0x7f869400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:07.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.324+0000 7f8687fff700 1 -- 172.21.15.112:0/789117934 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86940052d0 con 0x7f86a00cdfb0 2023-09-12T16:07:07.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.324+0000 7f8687fff700 1 -- 172.21.15.112:0/789117934 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8694005520 con 0x7f86a00cdfb0 2023-09-12T16:07:07.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.324+0000 7f86a61ff700 1 -- 172.21.15.112:0/789117934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a00b5690 con 0x7f86a00cdfb0 2023-09-12T16:07:07.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.324+0000 7f8687fff700 1 -- 172.21.15.112:0/789117934 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86940038e0 con 0x7f86a00cdfb0 2023-09-12T16:07:07.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.324+0000 7f86a61ff700 1 -- 172.21.15.112:0/789117934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a00b5c50 con 0x7f86a00cdfb0 2023-09-12T16:07:07.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.325+0000 7f86a61ff700 1 -- 172.21.15.112:0/789117934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a00b5de0 con 0x7f86a00cdfb0 2023-09-12T16:07:07.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.326+0000 7f8687fff700 1 -- 172.21.15.112:0/789117934 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f8694003a40 con 0x7f86a00cdfb0 2023-09-12T16:07:07.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.327+0000 7f8687fff700 1 --2- 172.21.15.112:0/789117934 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f868c06a580 0x7f868c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:07.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.327+0000 7f8687fff700 1 -- 172.21.15.112:0/789117934 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86940884a0 con 0x7f86a00cdfb0 2023-09-12T16:07:07.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.327+0000 7f869f7fe700 1 --2- 172.21.15.112:0/789117934 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f868c06a580 0x7f868c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:07.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.328+0000 7f869f7fe700 1 --2- 172.21.15.112:0/789117934 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f868c06a580 0x7f868c06ca40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f86a00b5000 tx=0x7f86900091e0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:07.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.331+0000 7f8687fff700 1 -- 172.21.15.112:0/789117934 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f8694053730 con 0x7f86a00cdfb0 2023-09-12T16:07:07.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.528+0000 7f86a61ff700 1 -- 172.21.15.112:0/789117934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86a004e300 con 0x7f86a00cdfb0 2023-09-12T16:07:07.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.530+0000 7f8687fff700 1 -- 172.21.15.112:0/789117934 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f8694056d50 con 0x7f86a00cdfb0 2023-09-12T16:07:07.530 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:07.530 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:04.748402+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:07:07.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.532+0000 7f86a61ff700 1 -- 172.21.15.112:0/789117934 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f868c06a580 msgr2=0x7f868c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:07.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.532+0000 7f86a61ff700 1 --2- 172.21.15.112:0/789117934 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f868c06a580 0x7f868c06ca40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f86a00b5000 tx=0x7f86900091e0 comp rx=0 tx=0).stop 2023-09-12T16:07:07.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.532+0000 7f86a61ff700 1 -- 172.21.15.112:0/789117934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86a00cdfb0 msgr2=0x7f86a00b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:07.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.532+0000 7f86a61ff700 1 --2- 172.21.15.112:0/789117934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86a00cdfb0 0x7f86a00b6170 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f869400c4e0 tx=0x7f869400c8a0 comp rx=0 tx=0).stop 2023-09-12T16:07:07.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.532+0000 7f86a61ff700 1 -- 172.21.15.112:0/789117934 shutdown_connections 2023-09-12T16:07:07.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.532+0000 7f86a61ff700 1 --2- 172.21.15.112:0/789117934 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f868c06a580 0x7f868c06ca40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:07.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.532+0000 7f86a61ff700 1 --2- 172.21.15.112:0/789117934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86a00b28f0 0x7f86a01e6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:07.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.532+0000 7f86a61ff700 1 --2- 172.21.15.112:0/789117934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86a015f480 0x7f86a01587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:07.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.532+0000 7f86a61ff700 1 --2- 172.21.15.112:0/789117934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86a00cdfb0 0x7f86a00b6170 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:07.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.532+0000 7f86a61ff700 1 -- 172.21.15.112:0/789117934 >> 172.21.15.112:0/789117934 conn(0x7f86a00d1930 msgr2=0x7f86a00c57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:07.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.532+0000 7f86a61ff700 1 -- 172.21.15.112:0/789117934 shutdown_connections 2023-09-12T16:07:07.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:07.532+0000 7f86a61ff700 1 -- 172.21.15.112:0/789117934 wait complete. 2023-09-12T16:07:07.954 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-12T16:06:59.697334+0000', 'modified': '2023-09-12T16:07:04.748576+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4396}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4396': {'gid': 4396, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6835/2785398652', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6833', 'nonce': 2785398652}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 2785398652}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-09-12T16:07:07.954 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-12T16:07:07.955 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-09-12T16:07:08.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.157+0000 7f40a09ff700 1 -- 172.21.15.112:0/2350006849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409c0cdfb0 msgr2=0x7f409c0cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:08.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.157+0000 7f40a09ff700 1 --2- 172.21.15.112:0/2350006849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409c0cdfb0 0x7f409c0cc3b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4084005fd0 tx=0x7f4084009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:08.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.157+0000 7f40a09ff700 1 -- 172.21.15.112:0/2350006849 shutdown_connections 2023-09-12T16:07:08.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.157+0000 7f40a09ff700 1 --2- 172.21.15.112:0/2350006849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409c0cdfb0 0x7f409c0cc3b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.157+0000 7f40a09ff700 1 -- 172.21.15.112:0/2350006849 >> 172.21.15.112:0/2350006849 conn(0x7f409c0d1930 msgr2=0x7f409c0d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:08.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.157+0000 7f40a09ff700 1 -- 172.21.15.112:0/2350006849 shutdown_connections 2023-09-12T16:07:08.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.157+0000 7f40a09ff700 1 -- 172.21.15.112:0/2350006849 wait complete. 2023-09-12T16:07:08.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.159+0000 7f40a09ff700 1 Processor -- start 2023-09-12T16:07:08.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.159+0000 7f40a09ff700 1 -- start start 2023-09-12T16:07:08.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.160+0000 7f40a09ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409c0cdfb0 0x7f409c15a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:08.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.160+0000 7f40a09ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409c0d0590 0x7f409c0c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:08.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.160+0000 7f40a09ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f409c15f480 0x7f409c0ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:08.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.160+0000 7f40a09ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409c0b5db0 con 0x7f409c0cdfb0 2023-09-12T16:07:08.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.160+0000 7f40a09ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409c0b51a0 con 0x7f409c0d0590 2023-09-12T16:07:08.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.160+0000 7f40a09ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409c0b5480 con 0x7f409c15f480 2023-09-12T16:07:08.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.160+0000 7f409a59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409c0cdfb0 0x7f409c15a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:08.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.160+0000 7f409a59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409c0cdfb0 0x7f409c15a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51794/0 (socket says 172.21.15.112:51794) 2023-09-12T16:07:08.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.160+0000 7f409a59c700 1 -- 172.21.15.112:0/2216984456 learned_addr learned my addr 172.21.15.112:0/2216984456 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:08.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.161+0000 7f4093fff700 1 --2- 172.21.15.112:0/2216984456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409c0d0590 0x7f409c0c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:08.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.161+0000 7f409ad9d700 1 --2- 172.21.15.112:0/2216984456 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f409c15f480 0x7f409c0ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:08.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.161+0000 7f409a59c700 1 -- 172.21.15.112:0/2216984456 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f409c15f480 msgr2=0x7f409c0ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:08.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.161+0000 7f409a59c700 1 --2- 172.21.15.112:0/2216984456 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f409c15f480 0x7f409c0ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.161+0000 7f409a59c700 1 -- 172.21.15.112:0/2216984456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409c0d0590 msgr2=0x7f409c0c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:08.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.161+0000 7f409a59c700 1 --2- 172.21.15.112:0/2216984456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409c0d0590 0x7f409c0c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.161+0000 7f409a59c700 1 -- 172.21.15.112:0/2216984456 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40840095f0 con 0x7f409c0cdfb0 2023-09-12T16:07:08.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.161+0000 7f409ad9d700 1 --2- 172.21.15.112:0/2216984456 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f409c15f480 0x7f409c0ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:08.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.161+0000 7f409a59c700 1 --2- 172.21.15.112:0/2216984456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409c0cdfb0 0x7f409c15a3a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f408c00c4d0 tx=0x7f408c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:08.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.161+0000 7f4092ffd700 1 -- 172.21.15.112:0/2216984456 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c0054e0 con 0x7f409c0cdfb0 2023-09-12T16:07:08.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.161+0000 7f4092ffd700 1 -- 172.21.15.112:0/2216984456 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f408c003680 con 0x7f409c0cdfb0 2023-09-12T16:07:08.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.161+0000 7f40a09ff700 1 -- 172.21.15.112:0/2216984456 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f409c0b5760 con 0x7f409c0cdfb0 2023-09-12T16:07:08.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.161+0000 7f4092ffd700 1 -- 172.21.15.112:0/2216984456 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c003a90 con 0x7f409c0cdfb0 2023-09-12T16:07:08.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.161+0000 7f40a09ff700 1 -- 172.21.15.112:0/2216984456 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f409c0b4520 con 0x7f409c0cdfb0 2023-09-12T16:07:08.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.163+0000 7f4092ffd700 1 -- 172.21.15.112:0/2216984456 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f408c003bf0 con 0x7f409c0cdfb0 2023-09-12T16:07:08.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.164+0000 7f4092ffd700 1 --2- 172.21.15.112:0/2216984456 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f407c06a580 0x7f407c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:08.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.164+0000 7f4092ffd700 1 -- 172.21.15.112:0/2216984456 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f408c088480 con 0x7f409c0cdfb0 2023-09-12T16:07:08.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.165+0000 7f4093fff700 1 --2- 172.21.15.112:0/2216984456 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f407c06a580 0x7f407c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:08.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.165+0000 7f4093fff700 1 --2- 172.21.15.112:0/2216984456 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f407c06a580 0x7f407c06ca40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f409c0c8240 tx=0x7f40840047c0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:08.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.166+0000 7f40b438fb80 1 Processor -- start 2023-09-12T16:07:08.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.166+0000 7f40b438fb80 1 -- start start 2023-09-12T16:07:08.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.167+0000 7f40b438fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e10805e0 0x5607e10809c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:08.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.167+0000 7f40b438fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607e1053990 0x5607e10567c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:08.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.167+0000 7f40b438fb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5607e1051a80 0x5607e107d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:08.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.167+0000 7f40b438fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607e0fbeca0 con 0x5607e10805e0 2023-09-12T16:07:08.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.167+0000 7f40b438fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607e0fae670 con 0x5607e1053990 2023-09-12T16:07:08.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.167+0000 7f40b438fb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x5607e0fabdd0 con 0x5607e1051a80 2023-09-12T16:07:08.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.167+0000 7f409a59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e10805e0 0x5607e10809c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:08.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.167+0000 7f409a59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e10805e0 0x5607e10809c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51810/0 (socket says 172.21.15.112:51810) 2023-09-12T16:07:08.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.167+0000 7f409a59c700 1 -- 172.21.15.112:0/3251794673 learned_addr learned my addr 172.21.15.112:0/3251794673 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:08.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.168+0000 7f409ad9d700 1 --2- 172.21.15.112:0/3251794673 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5607e1051a80 0x5607e107d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:08.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.168+0000 7f4093fff700 1 --2- 172.21.15.112:0/3251794673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607e1053990 0x5607e10567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:08.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.168+0000 7f409a59c700 1 -- 172.21.15.112:0/3251794673 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5607e1051a80 msgr2=0x5607e107d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-12T16:07:08.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.168+0000 7f409a59c700 1 --2- 172.21.15.112:0/3251794673 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5607e1051a80 0x5607e107d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.168+0000 7f409a59c700 1 -- 172.21.15.112:0/3251794673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607e1053990 msgr2=0x5607e10567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-12T16:07:08.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.168+0000 7f409a59c700 1 --2- 172.21.15.112:0/3251794673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607e1053990 0x5607e10567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.168+0000 7f409a59c700 1 -- 172.21.15.112:0/3251794673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607e0d99790 con 0x5607e10805e0 2023-09-12T16:07:08.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.168+0000 7f409a59c700 1 --2- 172.21.15.112:0/3251794673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e10805e0 0x5607e10809c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f408c0572c0 tx=0x7f408c056d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08c676221806ebc server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:08.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.168+0000 7f407bfff700 1 -- 172.21.15.112:0/3251794673 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c05bea0 con 0x5607e10805e0 2023-09-12T16:07:08.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.168+0000 7f407bfff700 1 -- 172.21.15.112:0/3251794673 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f408c05b160 con 0x5607e10805e0 2023-09-12T16:07:08.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.168+0000 7f407bfff700 1 -- 172.21.15.112:0/3251794673 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c05f310 con 0x5607e10805e0 2023-09-12T16:07:08.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.169+0000 7f40b438fb80 1 -- 172.21.15.112:0/3251794673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e10805e0 msgr2=0x5607e10809c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:08.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.169+0000 7f40b438fb80 1 --2- 172.21.15.112:0/3251794673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e10805e0 0x5607e10809c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f408c0572c0 tx=0x7f408c056d60 comp rx=0 tx=0).stop 2023-09-12T16:07:08.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.169+0000 7f40b438fb80 1 -- 172.21.15.112:0/3251794673 shutdown_connections 2023-09-12T16:07:08.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.169+0000 7f40b438fb80 1 --2- 172.21.15.112:0/3251794673 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5607e1051a80 0x5607e107d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.169+0000 7f40b438fb80 1 --2- 172.21.15.112:0/3251794673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e10805e0 0x5607e10809c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.169+0000 7f40b438fb80 1 --2- 172.21.15.112:0/3251794673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607e1053990 0x5607e10567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.169+0000 7f40b438fb80 1 -- 172.21.15.112:0/3251794673 >> 172.21.15.112:0/3251794673 conn(0x5607e0f83530 msgr2=0x5607e109b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:08.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.169+0000 7f40b438fb80 1 -- 172.21.15.112:0/3251794673 shutdown_connections 2023-09-12T16:07:08.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.169+0000 7f40b438fb80 1 -- 172.21.15.112:0/3251794673 wait complete. 2023-09-12T16:07:08.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.170+0000 7f40b438fb80 1 -- start start 2023-09-12T16:07:08.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.170+0000 7f40b438fb80 1 Processor -- start 2023-09-12T16:07:08.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.171+0000 7f40b438fb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5607e1051a80 0x5607e10ad740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:08.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.171+0000 7f40b438fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e1053990 0x5607e1081fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:08.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.171+0000 7f40b438fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607e10805e0 0x5607e10addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:08.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.171+0000 7f40b438fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607e0fa76c0 con 0x5607e1053990 2023-09-12T16:07:08.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.171+0000 7f40b438fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607e0f63790 con 0x5607e10805e0 2023-09-12T16:07:08.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.171+0000 7f40b438fb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x5607e0f49af0 con 0x5607e1051a80 2023-09-12T16:07:08.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.171+0000 7f40b438fb80 10 client.0 _ll_register_callbacks cb 0x5607e0dad5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-12T16:07:08.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.171+0000 7f4093fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e1053990 0x5607e1081fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:08.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.171+0000 7f4093fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e1053990 0x5607e1081fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51824/0 (socket says 172.21.15.112:51824) 2023-09-12T16:07:08.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.171+0000 7f4093fff700 1 -- 172.21.15.112:0/724650642 learned_addr learned my addr 172.21.15.112:0/724650642 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:08.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.171+0000 7f409a59c700 1 --2- 172.21.15.112:0/724650642 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5607e1051a80 0x5607e10ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:08.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.171+0000 7f409ad9d700 1 --2- 172.21.15.112:0/724650642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607e10805e0 0x5607e10addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:08.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.172+0000 7f4093fff700 1 -- 172.21.15.112:0/724650642 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5607e1051a80 msgr2=0x5607e10ad740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-12T16:07:08.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.172+0000 7f4093fff700 1 --2- 172.21.15.112:0/724650642 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5607e1051a80 0x5607e10ad740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.172+0000 7f4093fff700 1 -- 172.21.15.112:0/724650642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607e10805e0 msgr2=0x5607e10addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-12T16:07:08.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.172+0000 7f4093fff700 1 --2- 172.21.15.112:0/724650642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607e10805e0 0x5607e10addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.172+0000 7f4093fff700 1 -- 172.21.15.112:0/724650642 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f409c0b4520 con 0x5607e1053990 2023-09-12T16:07:08.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.172+0000 7f4093fff700 1 --2- 172.21.15.112:0/724650642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e1053990 0x5607e1081fa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4084013000 tx=0x7f4084009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78085e72fb1335 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:08.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.172+0000 7f40797fa700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-09-12T16:07:08.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.172+0000 7f40797fa700 1 -- 172.21.15.112:0/724650642 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084005200 con 0x5607e1053990 2023-09-12T16:07:08.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.172+0000 7f40b438fb80 1 -- 172.21.15.112:0/724650642 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5607e1048980 con 0x5607e1053990 2023-09-12T16:07:08.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.172+0000 7f40797fa700 1 -- 172.21.15.112:0/724650642 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4084005360 con 0x5607e1053990 2023-09-12T16:07:08.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.172+0000 7f40797fa700 1 -- 172.21.15.112:0/724650642 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4084005520 con 0x5607e1053990 2023-09-12T16:07:08.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.172+0000 7f40b438fb80 10 client.4482 fetch_fsmap learned FSMap version 7 2023-09-12T16:07:08.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.172+0000 7f40b438fb80 1 -- 172.21.15.112:0/724650642 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5607e0e860a0 con 0x5607e1053990 2023-09-12T16:07:08.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.173+0000 7f40797fa700 1 -- 172.21.15.112:0/724650642 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x5607e1048980 con 0x5607e1053990 2023-09-12T16:07:08.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.173+0000 7f40797fa700 1 -- 172.21.15.112:0/724650642 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f408400f460 con 0x5607e1053990 2023-09-12T16:07:08.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.173+0000 7f40b438fb80 10 client.4482 fetch_fsmap finished waiting for FSMap version 7 2023-09-12T16:07:08.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.173+0000 7f40b438fb80 10 client.4482 resolve_mds: resolved name 'd' to daemon mds.d 2023-09-12T16:07:08.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.173+0000 7f40b438fb80 20 client.4482 populate_metadata read hostname 'smithi112' 2023-09-12T16:07:08.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.173+0000 7f40b438fb80 1 --2- 172.21.15.112:0/724650642 >> [v2:172.21.15.144:6833/2785398652,v1:172.21.15.144:6835/2785398652] conn(0x5607e107ea20 0x5607e1083400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:08.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.173+0000 7f40b438fb80 4 client.4482 mds_command: new command op to 4396 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-12T16:07:08.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.173+0000 7f40b438fb80 1 -- 172.21.15.112:0/724650642 --> [v2:172.21.15.144:6833/2785398652,v1:172.21.15.144:6835/2785398652] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5607e1024e90 con 0x5607e107ea20 2023-09-12T16:07:08.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.173+0000 7f409a59c700 1 --2- 172.21.15.112:0/724650642 >> [v2:172.21.15.144:6833/2785398652,v1:172.21.15.144:6835/2785398652] conn(0x5607e107ea20 0x5607e1083400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:08.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.174+0000 7f409a59c700 1 --2- 172.21.15.112:0/724650642 >> [v2:172.21.15.144:6833/2785398652,v1:172.21.15.144:6835/2785398652] conn(0x5607e107ea20 0x5607e1083400 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bd2601bb2008779 server_cookie=4ef256d0d47b62fe in_seq=0 out_seq=0 2023-09-12T16:07:08.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.174+0000 7f40797fa700 10 client.4482 ms_handle_connect on v2:172.21.15.144:6833/2785398652 2023-09-12T16:07:08.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.175+0000 7f40797fa700 1 -- 172.21.15.112:0/724650642 <== mds.0 v2:172.21.15.144:6833/2785398652 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5607e1024e90 con 0x5607e107ea20 2023-09-12T16:07:08.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.175+0000 7f40797fa700 10 client.4482 handle_command_reply: tid=0 2023-09-12T16:07:08.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.175+0000 7f40b438fb80 1 client.4482 shutdown 2023-09-12T16:07:08.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.175+0000 7f40b438fb80 1 -- 172.21.15.112:0/724650642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e1053990 msgr2=0x5607e1081fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:08.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.175+0000 7f40b438fb80 1 --2- 172.21.15.112:0/724650642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e1053990 0x5607e1081fa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4084013000 tx=0x7f4084009310 comp rx=0 tx=0).stop 2023-09-12T16:07:08.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.175+0000 7f40b438fb80 1 -- 172.21.15.112:0/724650642 shutdown_connections 2023-09-12T16:07:08.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.175+0000 7f40b438fb80 1 --2- 172.21.15.112:0/724650642 >> [v2:172.21.15.144:6833/2785398652,v1:172.21.15.144:6835/2785398652] conn(0x5607e107ea20 0x5607e1083400 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.175+0000 7f40b438fb80 1 --2- 172.21.15.112:0/724650642 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5607e1051a80 0x5607e10ad740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.175+0000 7f40b438fb80 1 --2- 172.21.15.112:0/724650642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607e10805e0 0x5607e10addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.175+0000 7f40b438fb80 1 --2- 172.21.15.112:0/724650642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e1053990 0x5607e1081fa0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.175+0000 7f40b438fb80 1 -- 172.21.15.112:0/724650642 >> 172.21.15.112:0/724650642 conn(0x5607e0f83530 msgr2=0x5607e1055bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:08.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.175+0000 7f40797fa700 0 client.4482 ms_handle_reset on v2:172.21.15.144:6833/2785398652 2023-09-12T16:07:08.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.175+0000 7f40b438fb80 1 -- 172.21.15.112:0/724650642 shutdown_connections 2023-09-12T16:07:08.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.175+0000 7f40b438fb80 1 -- 172.21.15.112:0/724650642 wait complete. 2023-09-12T16:07:08.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.175+0000 7f40b438fb80 20 client.4482 trim_cache size 0 max 16384 2023-09-12T16:07:08.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.193+0000 7f40b438fb80 1 Processor -- start 2023-09-12T16:07:08.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.193+0000 7f40b438fb80 1 -- start start 2023-09-12T16:07:08.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.194+0000 7f40b438fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607e1051a80 0x5607e1055720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:08.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.194+0000 7f40b438fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e1053990 0x5607e1055c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:08.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.194+0000 7f40b438fb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5607e10805e0 0x5607e1050610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:08.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.194+0000 7f40b438fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607e10551c0 con 0x5607e1053990 2023-09-12T16:07:08.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.194+0000 7f40b438fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607e0d9a390 con 0x5607e1051a80 2023-09-12T16:07:08.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.194+0000 7f40b438fb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x5607e0fa9640 con 0x5607e10805e0 2023-09-12T16:07:08.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.194+0000 7f4093fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e1053990 0x5607e1055c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:08.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.194+0000 7f4093fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e1053990 0x5607e1055c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51838/0 (socket says 172.21.15.112:51838) 2023-09-12T16:07:08.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.194+0000 7f4093fff700 1 -- 172.21.15.112:0/2253185089 learned_addr learned my addr 172.21.15.112:0/2253185089 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:08.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.194+0000 7f4093fff700 1 -- 172.21.15.112:0/2253185089 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5607e10805e0 msgr2=0x5607e1050610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-12T16:07:08.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.194+0000 7f4093fff700 1 --2- 172.21.15.112:0/2253185089 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5607e10805e0 0x5607e1050610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.194+0000 7f4093fff700 1 -- 172.21.15.112:0/2253185089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607e1051a80 msgr2=0x5607e1055720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-12T16:07:08.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.194+0000 7f4093fff700 1 --2- 172.21.15.112:0/2253185089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607e1051a80 0x5607e1055720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.194+0000 7f4093fff700 1 -- 172.21.15.112:0/2253185089 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607e0f6bb90 con 0x5607e1053990 2023-09-12T16:07:08.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.194+0000 7f4093fff700 1 --2- 172.21.15.112:0/2253185089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e1053990 0x5607e1055c60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f408400b610 tx=0x7f4084022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497a066fae923cb2 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:08.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.195+0000 7f4090ff9700 1 -- 172.21.15.112:0/2253185089 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084029070 con 0x5607e1053990 2023-09-12T16:07:08.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.195+0000 7f4090ff9700 1 -- 172.21.15.112:0/2253185089 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f408402c040 con 0x5607e1053990 2023-09-12T16:07:08.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.195+0000 7f4090ff9700 1 -- 172.21.15.112:0/2253185089 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084005a00 con 0x5607e1053990 2023-09-12T16:07:08.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.195+0000 7f40b438fb80 1 -- 172.21.15.112:0/2253185089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e1053990 msgr2=0x5607e1055c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:08.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.195+0000 7f40b438fb80 1 --2- 172.21.15.112:0/2253185089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e1053990 0x5607e1055c60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f408400b610 tx=0x7f4084022000 comp rx=0 tx=0).stop 2023-09-12T16:07:08.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.195+0000 7f40b438fb80 1 -- 172.21.15.112:0/2253185089 shutdown_connections 2023-09-12T16:07:08.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.195+0000 7f40b438fb80 1 --2- 172.21.15.112:0/2253185089 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5607e10805e0 0x5607e1050610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.195+0000 7f40b438fb80 1 --2- 172.21.15.112:0/2253185089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607e1051a80 0x5607e1055720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.195+0000 7f40b438fb80 1 --2- 172.21.15.112:0/2253185089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e1053990 0x5607e1055c60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.195+0000 7f40b438fb80 1 -- 172.21.15.112:0/2253185089 >> 172.21.15.112:0/2253185089 conn(0x5607e0f83530 msgr2=0x5607e107fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:08.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.195+0000 7f40b438fb80 1 -- 172.21.15.112:0/2253185089 shutdown_connections 2023-09-12T16:07:08.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.195+0000 7f40b438fb80 1 -- 172.21.15.112:0/2253185089 wait complete. 2023-09-12T16:07:08.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.196+0000 7f40b438fb80 1 -- start start 2023-09-12T16:07:08.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.196+0000 7f40b438fb80 1 Processor -- start 2023-09-12T16:07:08.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.197+0000 7f40b438fb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5607e1051a80 0x5607e1101cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:08.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.197+0000 7f40b438fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e1053990 0x5607e1055720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:08.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.197+0000 7f40b438fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607e10805e0 0x5607e1055c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:08.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.197+0000 7f40b438fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607e10ac3b0 con 0x5607e1053990 2023-09-12T16:07:08.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.197+0000 7f40b438fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607e1102750 con 0x5607e10805e0 2023-09-12T16:07:08.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.197+0000 7f40b438fb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x5607e10a6f40 con 0x5607e1051a80 2023-09-12T16:07:08.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.197+0000 7f40b438fb80 10 client.0 _ll_register_callbacks cb 0x7f4084004a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-12T16:07:08.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.197+0000 7f4093fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e1053990 0x5607e1055720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:08.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.197+0000 7f4093fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e1053990 0x5607e1055720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51840/0 (socket says 172.21.15.112:51840) 2023-09-12T16:07:08.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.197+0000 7f4093fff700 1 -- 172.21.15.112:0/1106924697 learned_addr learned my addr 172.21.15.112:0/1106924697 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:08.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.197+0000 7f409ad9d700 1 --2- 172.21.15.112:0/1106924697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607e10805e0 0x5607e1055c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:08.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.198+0000 7f409a59c700 1 --2- 172.21.15.112:0/1106924697 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5607e1051a80 0x5607e1101cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:08.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.198+0000 7f4093fff700 1 -- 172.21.15.112:0/1106924697 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5607e1051a80 msgr2=0x5607e1101cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-12T16:07:08.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.198+0000 7f4093fff700 1 --2- 172.21.15.112:0/1106924697 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5607e1051a80 0x5607e1101cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.198+0000 7f4093fff700 1 -- 172.21.15.112:0/1106924697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607e10805e0 msgr2=0x5607e1055c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-12T16:07:08.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.198+0000 7f4093fff700 1 --2- 172.21.15.112:0/1106924697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607e10805e0 0x5607e1055c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.198+0000 7f4093fff700 1 -- 172.21.15.112:0/1106924697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5607e0e860a0 con 0x5607e1053990 2023-09-12T16:07:08.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.198+0000 7f409ad9d700 1 --2- 172.21.15.112:0/1106924697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607e10805e0 0x5607e1055c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:07:08.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.198+0000 7f4093fff700 1 --2- 172.21.15.112:0/1106924697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e1053990 0x5607e1055720 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4084032040 tx=0x7f408400bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71915060b0245a21 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:08.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.198+0000 7f40797fa700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-09-12T16:07:08.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.198+0000 7f40797fa700 1 -- 172.21.15.112:0/1106924697 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084029040 con 0x5607e1053990 2023-09-12T16:07:08.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.198+0000 7f40797fa700 1 -- 172.21.15.112:0/1106924697 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f408400fe30 con 0x5607e1053990 2023-09-12T16:07:08.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.198+0000 7f40b438fb80 1 -- 172.21.15.112:0/1106924697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f408c05b160 con 0x5607e1053990 2023-09-12T16:07:08.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.198+0000 7f40797fa700 1 -- 172.21.15.112:0/1106924697 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4084005200 con 0x5607e1053990 2023-09-12T16:07:08.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.198+0000 7f40b438fb80 10 client.4488 fetch_fsmap learned FSMap version 7 2023-09-12T16:07:08.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.198+0000 7f40b438fb80 1 -- 172.21.15.112:0/1106924697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5607e0dfa1d0 con 0x5607e1053990 2023-09-12T16:07:08.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.199+0000 7f40797fa700 1 -- 172.21.15.112:0/1106924697 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f408c05b160 con 0x5607e1053990 2023-09-12T16:07:08.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.199+0000 7f40797fa700 1 -- 172.21.15.112:0/1106924697 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f4084038020 con 0x5607e1053990 2023-09-12T16:07:08.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.199+0000 7f40b438fb80 10 client.4488 fetch_fsmap finished waiting for FSMap version 7 2023-09-12T16:07:08.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.199+0000 7f40b438fb80 10 client.4488 resolve_mds: resolved name 'd' to daemon mds.d 2023-09-12T16:07:08.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.199+0000 7f40b438fb80 20 client.4488 populate_metadata read hostname 'smithi112' 2023-09-12T16:07:08.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.199+0000 7f40b438fb80 1 --2- 172.21.15.112:0/1106924697 >> [v2:172.21.15.144:6833/2785398652,v1:172.21.15.144:6835/2785398652] conn(0x5607e1091390 0x5607e1091770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:08.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.199+0000 7f40b438fb80 4 client.4488 mds_command: new command op to 4396 tid=0[{"prefix": "status"}] 2023-09-12T16:07:08.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.199+0000 7f40b438fb80 1 -- 172.21.15.112:0/1106924697 --> [v2:172.21.15.144:6833/2785398652,v1:172.21.15.144:6835/2785398652] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5607e0fa0800 con 0x5607e1091390 2023-09-12T16:07:08.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.199+0000 7f409a59c700 1 --2- 172.21.15.112:0/1106924697 >> [v2:172.21.15.144:6833/2785398652,v1:172.21.15.144:6835/2785398652] conn(0x5607e1091390 0x5607e1091770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:08.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.200+0000 7f40797fa700 10 client.4488 ms_handle_connect on v2:172.21.15.144:6833/2785398652 2023-09-12T16:07:08.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.200+0000 7f409a59c700 1 --2- 172.21.15.112:0/1106924697 >> [v2:172.21.15.144:6833/2785398652,v1:172.21.15.144:6835/2785398652] conn(0x5607e1091390 0x5607e1091770 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a2a85faf2dada1b server_cookie=2a3d670c217b9c18 in_seq=0 out_seq=0 2023-09-12T16:07:08.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.200+0000 7f40797fa700 1 -- 172.21.15.112:0/1106924697 <== mds.0 v2:172.21.15.144:6833/2785398652 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5607e0fa0800 con 0x5607e1091390 2023-09-12T16:07:08.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.200+0000 7f40797fa700 10 client.4488 handle_command_reply: tid=0 2023-09-12T16:07:08.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.200+0000 7f40b438fb80 1 client.4488 shutdown 2023-09-12T16:07:08.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.200+0000 7f40b438fb80 1 -- 172.21.15.112:0/1106924697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e1053990 msgr2=0x5607e1055720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:08.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.200+0000 7f40b438fb80 1 --2- 172.21.15.112:0/1106924697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e1053990 0x5607e1055720 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4084032040 tx=0x7f408400bec0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.200+0000 7f40b438fb80 1 -- 172.21.15.112:0/1106924697 shutdown_connections 2023-09-12T16:07:08.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.200+0000 7f40b438fb80 1 --2- 172.21.15.112:0/1106924697 >> [v2:172.21.15.144:6833/2785398652,v1:172.21.15.144:6835/2785398652] conn(0x5607e1091390 0x5607e1091770 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.200+0000 7f40b438fb80 1 --2- 172.21.15.112:0/1106924697 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5607e1051a80 0x5607e1101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.200+0000 7f40b438fb80 1 --2- 172.21.15.112:0/1106924697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607e10805e0 0x5607e1055c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.200+0000 7f40797fa700 0 client.4488 ms_handle_reset on v2:172.21.15.144:6833/2785398652 2023-09-12T16:07:08.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.200+0000 7f40b438fb80 1 --2- 172.21.15.112:0/1106924697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5607e1053990 0x5607e1055720 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.200+0000 7f40b438fb80 1 -- 172.21.15.112:0/1106924697 >> 172.21.15.112:0/1106924697 conn(0x5607e0f83530 msgr2=0x5607e107f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:08.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.200+0000 7f40b438fb80 1 -- 172.21.15.112:0/1106924697 shutdown_connections 2023-09-12T16:07:08.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.200+0000 7f40b438fb80 1 -- 172.21.15.112:0/1106924697 wait complete. 2023-09-12T16:07:08.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.200+0000 7f40b438fb80 20 client.4488 trim_cache size 0 max 16384 2023-09-12T16:07:08.215 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-09-12T16:07:08.215 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "81d9ebed-ec6c-4564-a5d4-cdbd74c977f8", 2023-09-12T16:07:08.215 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2023-09-12T16:07:08.215 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 4396, 2023-09-12T16:07:08.216 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2023-09-12T16:07:08.216 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2023-09-12T16:07:08.216 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2023-09-12T16:07:08.216 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 7.9899573229999996, 2023-09-12T16:07:08.216 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 7, 2023-09-12T16:07:08.217 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 24, 2023-09-12T16:07:08.217 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 24, 2023-09-12T16:07:08.217 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 13.006193217 2023-09-12T16:07:08.217 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-09-12T16:07:08.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.201+0000 7f40a09ff700 1 -- 172.21.15.112:0/2216984456 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f407c06a580 msgr2=0x7f407c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:08.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.201+0000 7f40a09ff700 1 --2- 172.21.15.112:0/2216984456 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f407c06a580 0x7f407c06ca40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f409c0c8240 tx=0x7f40840047c0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.201+0000 7f40a09ff700 1 -- 172.21.15.112:0/2216984456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409c0cdfb0 msgr2=0x7f409c15a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:08.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.201+0000 7f40a09ff700 1 --2- 172.21.15.112:0/2216984456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409c0cdfb0 0x7f409c15a3a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f408c00c4d0 tx=0x7f408c00c890 comp rx=0 tx=0).stop 2023-09-12T16:07:08.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.201+0000 7f40a09ff700 1 -- 172.21.15.112:0/2216984456 shutdown_connections 2023-09-12T16:07:08.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.201+0000 7f40a09ff700 1 --2- 172.21.15.112:0/2216984456 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f407c06a580 0x7f407c06ca40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.201+0000 7f40a09ff700 1 --2- 172.21.15.112:0/2216984456 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f409c15f480 0x7f409c0ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.201+0000 7f40a09ff700 1 --2- 172.21.15.112:0/2216984456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409c0cdfb0 0x7f409c15a3a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.201+0000 7f40a09ff700 1 --2- 172.21.15.112:0/2216984456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409c0d0590 0x7f409c0c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.201+0000 7f40a09ff700 1 -- 172.21.15.112:0/2216984456 >> 172.21.15.112:0/2216984456 conn(0x7f409c0d1930 msgr2=0x7f409c0c73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:08.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.201+0000 7f40a09ff700 1 -- 172.21.15.112:0/2216984456 shutdown_connections 2023-09-12T16:07:08.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.201+0000 7f40a09ff700 1 -- 172.21.15.112:0/2216984456 wait complete. 2023-09-12T16:07:08.221 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-12T16:07:08.222 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-09-12T16:07:08.222 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-12T16:07:08.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.424+0000 7f908d9ff700 1 -- 172.21.15.112:0/1049789546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90880cdfb0 msgr2=0x7f90880d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:08.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.424+0000 7f908d9ff700 1 --2- 172.21.15.112:0/1049789546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90880cdfb0 0x7f90880d03c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f90880cf400 tx=0x7f907c009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:08.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.424+0000 7f908d9ff700 1 -- 172.21.15.112:0/1049789546 shutdown_connections 2023-09-12T16:07:08.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.424+0000 7f908d9ff700 1 --2- 172.21.15.112:0/1049789546 >> v2:172.21.15.144:3300/0 conn(0x7f908815f480 0x7f90880cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.424+0000 7f908d9ff700 1 --2- 172.21.15.112:0/1049789546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90880cdfb0 0x7f90880d03c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.424+0000 7f908d9ff700 1 -- 172.21.15.112:0/1049789546 >> 172.21.15.112:0/1049789546 conn(0x7f90880d1930 msgr2=0x7f90880d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:08.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.424+0000 7f908d9ff700 1 -- 172.21.15.112:0/1049789546 shutdown_connections 2023-09-12T16:07:08.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.424+0000 7f908d9ff700 1 -- 172.21.15.112:0/1049789546 wait complete. 2023-09-12T16:07:08.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.426+0000 7f908d9ff700 1 Processor -- start 2023-09-12T16:07:08.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.426+0000 7f908d9ff700 1 -- start start 2023-09-12T16:07:08.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.427+0000 7f908d9ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90880b28f0 0x7f9088147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:08.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.427+0000 7f908d9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90880cdfb0 0x7f90880c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:08.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.427+0000 7f908d9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f908815f480 0x7f90880b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:08.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.427+0000 7f908d9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90880ca2b0 con 0x7f908815f480 2023-09-12T16:07:08.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.427+0000 7f908d9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9088148370 con 0x7f90880cdfb0 2023-09-12T16:07:08.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.427+0000 7f908d9ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9088158330 con 0x7f90880b28f0 2023-09-12T16:07:08.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.427+0000 7f90877fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f908815f480 0x7f90880b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:08.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.427+0000 7f90877fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f908815f480 0x7f90880b66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51856/0 (socket says 172.21.15.112:51856) 2023-09-12T16:07:08.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.427+0000 7f90877fe700 1 -- 172.21.15.112:0/1307121161 learned_addr learned my addr 172.21.15.112:0/1307121161 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:08.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.427+0000 7f9086ffd700 1 --2- 172.21.15.112:0/1307121161 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90880b28f0 0x7f9088147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:08.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.427+0000 7f90867fc700 1 --2- 172.21.15.112:0/1307121161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90880cdfb0 0x7f90880c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:08.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.427+0000 7f90877fe700 1 -- 172.21.15.112:0/1307121161 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90880b28f0 msgr2=0x7f9088147e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:08.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.427+0000 7f90877fe700 1 --2- 172.21.15.112:0/1307121161 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90880b28f0 0x7f9088147e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.427+0000 7f90877fe700 1 -- 172.21.15.112:0/1307121161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90880cdfb0 msgr2=0x7f90880c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:08.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.427+0000 7f90877fe700 1 --2- 172.21.15.112:0/1307121161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90880cdfb0 0x7f90880c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.427+0000 7f90877fe700 1 -- 172.21.15.112:0/1307121161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907c0095f0 con 0x7f908815f480 2023-09-12T16:07:08.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.428+0000 7f90877fe700 1 --2- 172.21.15.112:0/1307121161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f908815f480 0x7f90880b66f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f908000cbc0 tx=0x7f908000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:08.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.428+0000 7f906ffff700 1 -- 172.21.15.112:0/1307121161 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080003c00 con 0x7f908815f480 2023-09-12T16:07:08.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.428+0000 7f906ffff700 1 -- 172.21.15.112:0/1307121161 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9080003d60 con 0x7f908815f480 2023-09-12T16:07:08.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.428+0000 7f908d9ff700 1 -- 172.21.15.112:0/1307121161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9088158610 con 0x7f908815f480 2023-09-12T16:07:08.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.428+0000 7f906ffff700 1 -- 172.21.15.112:0/1307121161 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908000ab00 con 0x7f908815f480 2023-09-12T16:07:08.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.428+0000 7f908d9ff700 1 -- 172.21.15.112:0/1307121161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90880c9f40 con 0x7f908815f480 2023-09-12T16:07:08.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.429+0000 7f908d9ff700 1 -- 172.21.15.112:0/1307121161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90880c8240 con 0x7f908815f480 2023-09-12T16:07:08.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.430+0000 7f906ffff700 1 -- 172.21.15.112:0/1307121161 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f908000ac60 con 0x7f908815f480 2023-09-12T16:07:08.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.431+0000 7f906ffff700 1 --2- 172.21.15.112:0/1307121161 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f907406a580 0x7f907406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:08.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.431+0000 7f906ffff700 1 -- 172.21.15.112:0/1307121161 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9080088e60 con 0x7f908815f480 2023-09-12T16:07:08.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.431+0000 7f9086ffd700 1 --2- 172.21.15.112:0/1307121161 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f907406a580 0x7f907406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:08.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.431+0000 7f9086ffd700 1 --2- 172.21.15.112:0/1307121161 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f907406a580 0x7f907406ca40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f90880cbca0 tx=0x7f907800b390 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:08.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.435+0000 7f906ffff700 1 -- 172.21.15.112:0/1307121161 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f90800540f0 con 0x7f908815f480 2023-09-12T16:07:08.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.673+0000 7f908d9ff700 1 -- 172.21.15.112:0/1307121161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f90880d0e30 con 0x7f908815f480 2023-09-12T16:07:08.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.674+0000 7f906ffff700 1 -- 172.21.15.112:0/1307121161 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9080057710 con 0x7f908815f480 2023-09-12T16:07:08.674 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-12T16:07:08.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.676+0000 7f908d9ff700 1 -- 172.21.15.112:0/1307121161 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f907406a580 msgr2=0x7f907406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:08.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.676+0000 7f908d9ff700 1 --2- 172.21.15.112:0/1307121161 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f907406a580 0x7f907406ca40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f90880cbca0 tx=0x7f907800b390 comp rx=0 tx=0).stop 2023-09-12T16:07:08.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.676+0000 7f908d9ff700 1 -- 172.21.15.112:0/1307121161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f908815f480 msgr2=0x7f90880b66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:08.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.676+0000 7f908d9ff700 1 --2- 172.21.15.112:0/1307121161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f908815f480 0x7f90880b66f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f908000cbc0 tx=0x7f908000ced0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.676+0000 7f908d9ff700 1 -- 172.21.15.112:0/1307121161 shutdown_connections 2023-09-12T16:07:08.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.676+0000 7f908d9ff700 1 --2- 172.21.15.112:0/1307121161 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f907406a580 0x7f907406ca40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.676+0000 7f908d9ff700 1 --2- 172.21.15.112:0/1307121161 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90880b28f0 0x7f9088147e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.676+0000 7f908d9ff700 1 --2- 172.21.15.112:0/1307121161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f908815f480 0x7f90880b66f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.676+0000 7f908d9ff700 1 --2- 172.21.15.112:0/1307121161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90880cdfb0 0x7f90880c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:08.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.676+0000 7f908d9ff700 1 -- 172.21.15.112:0/1307121161 >> 172.21.15.112:0/1307121161 conn(0x7f90880d1930 msgr2=0x7f908815c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:08.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.677+0000 7f908d9ff700 1 -- 172.21.15.112:0/1307121161 shutdown_connections 2023-09-12T16:07:08.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:08.677+0000 7f908d9ff700 1 -- 172.21.15.112:0/1307121161 wait complete. 2023-09-12T16:07:08.694 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-12T16:07:08.694 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-12T16:07:08.695 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-09-12T16:07:08.695 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-09-12T16:07:08.695 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-09-12T16:07:08.696 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-12T16:07:08.696 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-12T16:07:08.696 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-12T16:07:08.696 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-09-12T16:07:08.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:08.697 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-09-12T16:07:08.744 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-12T16:07:08.744 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-12T16:07:08.744 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-09-12T16:07:08.745 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:08.745 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-09-12T16:07:08.745 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:08.745 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-12T16:07:08.745 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-09-12T16:07:08.746 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2023-09-12T16:07:08.746 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-12T16:07:08.746 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-09-12T16:07:08.746 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2023-09-12T16:07:08.747 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-12T16:07:08.747 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-09-12T16:07:08.747 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-12T16:07:08.747 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-09-12T16:07:08.747 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-12T16:07:08.748 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42355sec preferred_lft 42355sec 2023-09-12T16:07:08.748 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2023-09-12T16:07:08.748 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:08.749 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-12T16:07:08.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:08.750 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-09-12T16:07:08.751 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-09-12T16:07:08.751 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add name ceph-brx type bridge 2023-09-12T16:07:08.751 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr flush dev ceph-brx 2023-09-12T16:07:08.752 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set ceph-brx up 2023-09-12T16:07:08.752 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-12T16:07:08.752 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-09-12T16:07:09.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:09.168 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-12T16:07:09.270 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-09-12T16:07:09.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:09.274 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-09-12T16:07:09.344 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-09-12T16:07:09.345 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-12T16:07:09.345 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-12T16:07:09.345 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-12T16:07:09.345 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-12T16:07:09.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:09.347 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-09-12T16:07:09.347 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-09-12T16:07:09.347 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-12T16:07:09.347 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-12T16:07:09.348 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-12T16:07:09.348 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-09-12T16:07:10.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:10.035 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-09-12T16:07:10.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:10.082 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2023-09-12T16:07:10.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:10.130 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-09-12T16:07:10.130 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-09-12T16:07:10.131 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-09-12T16:07:10.131 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-09-12T16:07:10.131 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-09-12T16:07:10.275 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-09-12T16:07:10.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:10.277 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-09-12T16:07:10.277 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-09-12T16:07:10.278 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-09-12T16:07:10.278 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-12T16:07:10.279 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-09-12T16:07:10.279 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-09-12T16:07:10.279 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-09-12T16:07:10.280 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-09-12T16:07:10.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:10.545 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-09-12T16:07:10.545 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-09-12T16:07:10.545 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2023-09-12T16:07:10.546 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.0 master ceph-brx 2023-09-12T16:07:10.546 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-09-12T16:07:10.720 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-09-12T16:07:10.720 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-12T16:07:10.721 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-09-12T16:07:10.767 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-09-12T16:07:10.767 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-12T16:07:10.768 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-09-12T16:07:10.852 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2023-09-12T16:07:10.963 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-12T16:07:10.964 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-12T16:07:11.038 INFO:teuthology.orchestra.run.smithi112.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-12T16:07:11.040 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-12T16:07:11.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:11.042 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2023-09-12T16:07:11.089 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-12T16:07:11.089 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-09-12T16:07:11.133 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2023-09-12T16:07:11.204 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-12T16:07:11.205 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-12T16:07:11.273 INFO:teuthology.orchestra.run.smithi112.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-12T16:07:11.276 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-12T16:07:11.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:11.277 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2023-09-12T16:07:11.306 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi112.stderr:2023-09-12T16:07:11.306+0000 7f10384de5c0 -1 init, newargv = 0x56268fe984c0 newargc=15 2023-09-12T16:07:11.306 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi112.stderr:ceph-fuse[123790]: starting ceph client 2023-09-12T16:07:11.317 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi112.stderr:ceph-fuse[123790]: starting fuse 2023-09-12T16:07:11.327 INFO:teuthology.orchestra.run.smithi112.stdout:43 2023-09-12T16:07:11.328 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-09-12T16:07:11.328 DEBUG:teuthology.orchestra.run.smithi112:> sudo stdin-killer -- python3 -c ' 2023-09-12T16:07:11.329 DEBUG:teuthology.orchestra.run.smithi112:> import glob 2023-09-12T16:07:11.329 DEBUG:teuthology.orchestra.run.smithi112:> import re 2023-09-12T16:07:11.329 DEBUG:teuthology.orchestra.run.smithi112:> import os 2023-09-12T16:07:11.330 DEBUG:teuthology.orchestra.run.smithi112:> import subprocess 2023-09-12T16:07:11.330 DEBUG:teuthology.orchestra.run.smithi112:> 2023-09-12T16:07:11.330 DEBUG:teuthology.orchestra.run.smithi112:> def _find_admin_socket(client_name): 2023-09-12T16:07:11.331 DEBUG:teuthology.orchestra.run.smithi112:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-09-12T16:07:11.331 DEBUG:teuthology.orchestra.run.smithi112:> files = glob.glob(asok_path) 2023-09-12T16:07:11.332 DEBUG:teuthology.orchestra.run.smithi112:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-09-12T16:07:11.332 DEBUG:teuthology.orchestra.run.smithi112:> 2023-09-12T16:07:11.332 DEBUG:teuthology.orchestra.run.smithi112:> # Given a non-glob path, it better be there 2023-09-12T16:07:11.333 DEBUG:teuthology.orchestra.run.smithi112:> if "*" not in asok_path: 2023-09-12T16:07:11.333 DEBUG:teuthology.orchestra.run.smithi112:> assert(len(files) == 1) 2023-09-12T16:07:11.333 DEBUG:teuthology.orchestra.run.smithi112:> return files[0] 2023-09-12T16:07:11.334 DEBUG:teuthology.orchestra.run.smithi112:> 2023-09-12T16:07:11.334 DEBUG:teuthology.orchestra.run.smithi112:> for f in files: 2023-09-12T16:07:11.334 DEBUG:teuthology.orchestra.run.smithi112:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-12T16:07:11.335 DEBUG:teuthology.orchestra.run.smithi112:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-12T16:07:11.335 DEBUG:teuthology.orchestra.run.smithi112:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-12T16:07:11.335 DEBUG:teuthology.orchestra.run.smithi112:> contents = proc_f.read() 2023-09-12T16:07:11.336 DEBUG:teuthology.orchestra.run.smithi112:> if mountpoint in contents: 2023-09-12T16:07:11.336 DEBUG:teuthology.orchestra.run.smithi112:> return f 2023-09-12T16:07:11.336 DEBUG:teuthology.orchestra.run.smithi112:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-12T16:07:11.337 DEBUG:teuthology.orchestra.run.smithi112:> 2023-09-12T16:07:11.337 DEBUG:teuthology.orchestra.run.smithi112:> print(_find_admin_socket("client.admin")) 2023-09-12T16:07:11.338 DEBUG:teuthology.orchestra.run.smithi112:> ' 2023-09-12T16:07:11.513 INFO:teuthology.orchestra.run.smithi112.stdout:/var/run/ceph/ceph-client.admin.123790.asok 2023-09-12T16:07:11.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-12T16:07:11.526 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.123790.asok 2023-09-12T16:07:11.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:11.527 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.123790.asok status 2023-09-12T16:07:11.753 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-09-12T16:07:11.754 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": { 2023-09-12T16:07:11.754 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_sha1": "2110e00747b31a0d73768c9e5229da18b26b8aa0", 2023-09-12T16:07:11.754 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 18.0.0-6088-g2110e007 (2110e00747b31a0d73768c9e5229da18b26b8aa0) reef (dev)", 2023-09-12T16:07:11.754 INFO:teuthology.orchestra.run.smithi112.stdout: "entity_id": "admin", 2023-09-12T16:07:11.755 INFO:teuthology.orchestra.run.smithi112.stdout: "hostname": "smithi112", 2023-09-12T16:07:11.755 INFO:teuthology.orchestra.run.smithi112.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-09-12T16:07:11.755 INFO:teuthology.orchestra.run.smithi112.stdout: "pid": "123790", 2023-09-12T16:07:11.755 INFO:teuthology.orchestra.run.smithi112.stdout: "root": "/" 2023-09-12T16:07:11.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:07:11.756 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_count": 0, 2023-09-12T16:07:11.756 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_pinned_count": 0, 2023-09-12T16:07:11.757 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 4503, 2023-09-12T16:07:11.757 INFO:teuthology.orchestra.run.smithi112.stdout: "inst": { 2023-09-12T16:07:11.757 INFO:teuthology.orchestra.run.smithi112.stdout: "name": { 2023-09-12T16:07:11.758 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "client", 2023-09-12T16:07:11.758 INFO:teuthology.orchestra.run.smithi112.stdout: "num": 4503 2023-09-12T16:07:11.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:07:11.759 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2023-09-12T16:07:11.759 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2023-09-12T16:07:11.759 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2023-09-12T16:07:11.760 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 843529191 2023-09-12T16:07:11.760 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:07:11.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:07:11.761 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2023-09-12T16:07:11.761 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2023-09-12T16:07:11.761 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2023-09-12T16:07:11.761 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 843529191 2023-09-12T16:07:11.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:07:11.762 INFO:teuthology.orchestra.run.smithi112.stdout: "inst_str": "client.4503 192.168.0.1:0/843529191", 2023-09-12T16:07:11.762 INFO:teuthology.orchestra.run.smithi112.stdout: "addr_str": "192.168.0.1:0/843529191", 2023-09-12T16:07:11.762 INFO:teuthology.orchestra.run.smithi112.stdout: "inode_count": 1, 2023-09-12T16:07:11.763 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_epoch": 7, 2023-09-12T16:07:11.763 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch": 24, 2023-09-12T16:07:11.763 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch_barrier": 0, 2023-09-12T16:07:11.763 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklisted": false, 2023-09-12T16:07:11.763 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs" 2023-09-12T16:07:11.764 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-09-12T16:07:11.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:11.768 DEBUG:teuthology.orchestra.run.smithi112:> stat --file-system '--printf=%T 2023-09-12T16:07:11.768 DEBUG:teuthology.orchestra.run.smithi112:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-09-12T16:07:11.814 INFO:teuthology.orchestra.run.smithi112.stdout:fuseblk 2023-09-12T16:07:11.815 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-09-12T16:07:11.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:11.815 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-09-12T16:07:11.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:11.928 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-09-12T16:07:12.127 INFO:teuthology.orchestra.run.smithi112.stdout:# file: . 2023-09-12T16:07:12.127 INFO:teuthology.orchestra.run.smithi112.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-09-12T16:07:12.127 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:12.129 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:07:12.129 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T16:07:12.175 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:07:12.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.417+0000 7f93c09ff700 1 -- 172.21.15.112:0/986985081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a8003a00 msgr2=0x7f93a8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:12.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.417+0000 7f93c09ff700 1 --2- 172.21.15.112:0/986985081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a8003a00 0x7f93a8003e20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f93ac001720 tx=0x7f93a8005880 comp rx=0 tx=0).stop 2023-09-12T16:07:12.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.417+0000 7f93c09ff700 1 -- 172.21.15.112:0/986985081 shutdown_connections 2023-09-12T16:07:12.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.417+0000 7f93c09ff700 1 --2- 172.21.15.112:0/986985081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a8003a00 0x7f93a8003e20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:12.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.417+0000 7f93c09ff700 1 -- 172.21.15.112:0/986985081 >> 172.21.15.112:0/986985081 conn(0x7f93bc06a650 msgr2=0x7f93bc06c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:12.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.417+0000 7f93c09ff700 1 -- 172.21.15.112:0/986985081 shutdown_connections 2023-09-12T16:07:12.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.417+0000 7f93c09ff700 1 -- 172.21.15.112:0/986985081 wait complete. 2023-09-12T16:07:12.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.419+0000 7f93c09ff700 1 Processor -- start 2023-09-12T16:07:12.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.420+0000 7f93c09ff700 1 -- start start 2023-09-12T16:07:12.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.421+0000 7f93c09ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93a8003a00 0x7f93bc0c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:12.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.421+0000 7f93c09ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93bc151430 0x7f93bc153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:12.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.421+0000 7f93c09ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93bc150b10 0x7f93bc154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:12.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.421+0000 7f93c09ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc153460 con 0x7f93bc150b10 2023-09-12T16:07:12.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.421+0000 7f93c09ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc1527e0 con 0x7f93a8003a00 2023-09-12T16:07:12.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.421+0000 7f93c09ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc152ac0 con 0x7f93bc151430 2023-09-12T16:07:12.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.421+0000 7f93bad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93bc150b10 0x7f93bc154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:12.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.421+0000 7f93bad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93bc150b10 0x7f93bc154a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51868/0 (socket says 172.21.15.112:51868) 2023-09-12T16:07:12.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.421+0000 7f93bad9d700 1 -- 172.21.15.112:0/2667229265 learned_addr learned my addr 172.21.15.112:0/2667229265 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:12.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.422+0000 7f93ba59c700 1 --2- 172.21.15.112:0/2667229265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93a8003a00 0x7f93bc0c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:12.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.422+0000 7f93b3fff700 1 --2- 172.21.15.112:0/2667229265 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93bc151430 0x7f93bc153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:12.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.422+0000 7f93bad9d700 1 -- 172.21.15.112:0/2667229265 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93bc151430 msgr2=0x7f93bc153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:12.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.422+0000 7f93bad9d700 1 --2- 172.21.15.112:0/2667229265 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93bc151430 0x7f93bc153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:12.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.422+0000 7f93bad9d700 1 -- 172.21.15.112:0/2667229265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93a8003a00 msgr2=0x7f93bc0c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:12.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.422+0000 7f93bad9d700 1 --2- 172.21.15.112:0/2667229265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93a8003a00 0x7f93bc0c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:12.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.422+0000 7f93bad9d700 1 -- 172.21.15.112:0/2667229265 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc152da0 con 0x7f93bc150b10 2023-09-12T16:07:12.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.422+0000 7f93ba59c700 1 --2- 172.21.15.112:0/2667229265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93a8003a00 0x7f93bc0c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:12.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.422+0000 7f93b3fff700 1 --2- 172.21.15.112:0/2667229265 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93bc151430 0x7f93bc153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:12.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.422+0000 7f93bad9d700 1 --2- 172.21.15.112:0/2667229265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93bc150b10 0x7f93bc154a40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f93bc06d030 tx=0x7f93b4007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:12.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.422+0000 7f93b2ffd700 1 -- 172.21.15.112:0/2667229265 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b400e070 con 0x7f93bc150b10 2023-09-12T16:07:12.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.422+0000 7f93b2ffd700 1 -- 172.21.15.112:0/2667229265 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f93b400f040 con 0x7f93bc150b10 2023-09-12T16:07:12.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.422+0000 7f93c09ff700 1 -- 172.21.15.112:0/2667229265 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93bc153080 con 0x7f93bc150b10 2023-09-12T16:07:12.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.422+0000 7f93b2ffd700 1 -- 172.21.15.112:0/2667229265 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4004e10 con 0x7f93bc150b10 2023-09-12T16:07:12.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.422+0000 7f93c09ff700 1 -- 172.21.15.112:0/2667229265 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93bc153dc0 con 0x7f93bc150b10 2023-09-12T16:07:12.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.423+0000 7f93c09ff700 1 -- 172.21.15.112:0/2667229265 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93bc04e300 con 0x7f93bc150b10 2023-09-12T16:07:12.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.424+0000 7f93b2ffd700 1 -- 172.21.15.112:0/2667229265 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f93b4019070 con 0x7f93bc150b10 2023-09-12T16:07:12.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.425+0000 7f93b2ffd700 1 --2- 172.21.15.112:0/2667229265 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f939c06a580 0x7f939c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:12.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.425+0000 7f93b2ffd700 1 -- 172.21.15.112:0/2667229265 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f93b408a6f0 con 0x7f93bc150b10 2023-09-12T16:07:12.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.425+0000 7f93ba59c700 1 --2- 172.21.15.112:0/2667229265 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f939c06a580 0x7f939c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:12.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.426+0000 7f93ba59c700 1 --2- 172.21.15.112:0/2667229265 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f939c06a580 0x7f939c06ca40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f93ac001720 tx=0x7f93ac001190 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:12.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.430+0000 7f93b2ffd700 1 -- 172.21.15.112:0/2667229265 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f93b4055a10 con 0x7f93bc150b10 2023-09-12T16:07:12.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.626+0000 7f93c09ff700 1 -- 172.21.15.112:0/2667229265 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93bc1535a0 con 0x7f93bc150b10 2023-09-12T16:07:12.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.627+0000 7f93b2ffd700 1 -- 172.21.15.112:0/2667229265 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f93bc1535a0 con 0x7f93bc150b10 2023-09-12T16:07:12.628 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:12.628 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:04.748402+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:07:12.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.630+0000 7f93c09ff700 1 -- 172.21.15.112:0/2667229265 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f939c06a580 msgr2=0x7f939c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:12.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.630+0000 7f93c09ff700 1 --2- 172.21.15.112:0/2667229265 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f939c06a580 0x7f939c06ca40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f93ac001720 tx=0x7f93ac001190 comp rx=0 tx=0).stop 2023-09-12T16:07:12.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.630+0000 7f93c09ff700 1 -- 172.21.15.112:0/2667229265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93bc150b10 msgr2=0x7f93bc154a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:12.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.630+0000 7f93c09ff700 1 --2- 172.21.15.112:0/2667229265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93bc150b10 0x7f93bc154a40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f93bc06d030 tx=0x7f93b4007ea0 comp rx=0 tx=0).stop 2023-09-12T16:07:12.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.630+0000 7f93c09ff700 1 -- 172.21.15.112:0/2667229265 shutdown_connections 2023-09-12T16:07:12.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.630+0000 7f93c09ff700 1 --2- 172.21.15.112:0/2667229265 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f939c06a580 0x7f939c06ca40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:12.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.630+0000 7f93c09ff700 1 --2- 172.21.15.112:0/2667229265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93bc150b10 0x7f93bc154a40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:12.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.630+0000 7f93c09ff700 1 --2- 172.21.15.112:0/2667229265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93a8003a00 0x7f93bc0c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:12.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.630+0000 7f93c09ff700 1 --2- 172.21.15.112:0/2667229265 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93bc151430 0x7f93bc153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:12.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.630+0000 7f93c09ff700 1 -- 172.21.15.112:0/2667229265 >> 172.21.15.112:0/2667229265 conn(0x7f93bc06a650 msgr2=0x7f93bc0ad9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:12.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.630+0000 7f93c09ff700 1 -- 172.21.15.112:0/2667229265 shutdown_connections 2023-09-12T16:07:12.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.630+0000 7f93c09ff700 1 -- 172.21.15.112:0/2667229265 wait complete. 2023-09-12T16:07:12.648 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-12T16:06:48.871680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-12T16:06:58.137223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-12T16:06:58.684034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-12T16:07:02.283459+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-12T16:07:12.649 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-12T16:07:12.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.851+0000 7f9305dff700 1 -- 172.21.15.112:0/2618807722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f930015bca0 msgr2=0x7f930015cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:12.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.851+0000 7f9305dff700 1 --2- 172.21.15.112:0/2618807722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f930015bca0 0x7f930015cb90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f92f00098c0 tx=0x7f92f0009bd0 comp rx=0 tx=0).stop 2023-09-12T16:07:12.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.851+0000 7f9305dff700 1 -- 172.21.15.112:0/2618807722 shutdown_connections 2023-09-12T16:07:12.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.851+0000 7f9305dff700 1 --2- 172.21.15.112:0/2618807722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f930015bca0 0x7f930015cb90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:12.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.851+0000 7f9305dff700 1 -- 172.21.15.112:0/2618807722 >> 172.21.15.112:0/2618807722 conn(0x7f93000d17d0 msgr2=0x7f93000d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:12.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.851+0000 7f9305dff700 1 -- 172.21.15.112:0/2618807722 shutdown_connections 2023-09-12T16:07:12.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.851+0000 7f9305dff700 1 -- 172.21.15.112:0/2618807722 wait complete. 2023-09-12T16:07:12.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.852+0000 7f9305dff700 1 Processor -- start 2023-09-12T16:07:12.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.853+0000 7f9305dff700 1 -- start start 2023-09-12T16:07:12.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.854+0000 7f9305dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93000cfdb0 0x7f93000c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:12.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.854+0000 7f9305dff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f930015bca0 0x7f930014edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:12.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.854+0000 7f9305dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93000c5fa0 0x7f930006c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:12.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.854+0000 7f9305dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930014f310 con 0x7f93000cfdb0 2023-09-12T16:07:12.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.854+0000 7f9305dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93000caba0 con 0x7f93000c5fa0 2023-09-12T16:07:12.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.854+0000 7f9305dff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93001f5610 con 0x7f930015bca0 2023-09-12T16:07:12.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.854+0000 7f92ff7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93000cfdb0 0x7f93000c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:12.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.854+0000 7f92ff7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93000cfdb0 0x7f93000c6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51880/0 (socket says 172.21.15.112:51880) 2023-09-12T16:07:12.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.854+0000 7f92ff7fe700 1 -- 172.21.15.112:0/2131587510 learned_addr learned my addr 172.21.15.112:0/2131587510 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:12.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.854+0000 7f92fffff700 1 --2- 172.21.15.112:0/2131587510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93000c5fa0 0x7f930006c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:12.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.854+0000 7f92feffd700 1 --2- 172.21.15.112:0/2131587510 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f930015bca0 0x7f930014edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:12.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.854+0000 7f92ff7fe700 1 -- 172.21.15.112:0/2131587510 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f930015bca0 msgr2=0x7f930014edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:12.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.854+0000 7f92ff7fe700 1 --2- 172.21.15.112:0/2131587510 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f930015bca0 0x7f930014edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:12.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.854+0000 7f92ff7fe700 1 -- 172.21.15.112:0/2131587510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93000c5fa0 msgr2=0x7f930006c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:12.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.854+0000 7f92ff7fe700 1 --2- 172.21.15.112:0/2131587510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93000c5fa0 0x7f930006c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:12.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.854+0000 7f92ff7fe700 1 -- 172.21.15.112:0/2131587510 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f0009520 con 0x7f93000cfdb0 2023-09-12T16:07:12.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.854+0000 7f92fffff700 1 --2- 172.21.15.112:0/2131587510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93000c5fa0 0x7f930006c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:12.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.854+0000 7f92feffd700 1 --2- 172.21.15.112:0/2131587510 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f930015bca0 0x7f930014edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:12.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.854+0000 7f92ff7fe700 1 --2- 172.21.15.112:0/2131587510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93000cfdb0 0x7f93000c6760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f92f000a010 tx=0x7f92f0005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:12.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.855+0000 7f92e7fff700 1 -- 172.21.15.112:0/2131587510 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f000f9b0 con 0x7f93000cfdb0 2023-09-12T16:07:12.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.855+0000 7f92e7fff700 1 -- 172.21.15.112:0/2131587510 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f92f000fc00 con 0x7f93000cfdb0 2023-09-12T16:07:12.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.855+0000 7f9305dff700 1 -- 172.21.15.112:0/2131587510 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93001f58f0 con 0x7f93000cfdb0 2023-09-12T16:07:12.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.855+0000 7f92e7fff700 1 -- 172.21.15.112:0/2131587510 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f001f420 con 0x7f93000cfdb0 2023-09-12T16:07:12.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.855+0000 7f9305dff700 1 -- 172.21.15.112:0/2131587510 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93001f5eb0 con 0x7f93000cfdb0 2023-09-12T16:07:12.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.856+0000 7f9305dff700 1 -- 172.21.15.112:0/2131587510 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93000cad10 con 0x7f93000cfdb0 2023-09-12T16:07:12.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.857+0000 7f92e7fff700 1 -- 172.21.15.112:0/2131587510 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f92f001f580 con 0x7f93000cfdb0 2023-09-12T16:07:12.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.858+0000 7f92e7fff700 1 --2- 172.21.15.112:0/2131587510 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f92ec06a580 0x7f92ec06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:12.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.858+0000 7f92e7fff700 1 -- 172.21.15.112:0/2131587510 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f92f008add0 con 0x7f93000cfdb0 2023-09-12T16:07:12.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.858+0000 7f92feffd700 1 --2- 172.21.15.112:0/2131587510 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f92ec06a580 0x7f92ec06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:12.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.859+0000 7f92feffd700 1 --2- 172.21.15.112:0/2131587510 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f92ec06a580 0x7f92ec06ca40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f93001f5190 tx=0x7f92f4009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:12.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:12.862+0000 7f92e7fff700 1 -- 172.21.15.112:0/2131587510 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f93000cad10 con 0x7f93000cfdb0 2023-09-12T16:07:13.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.059+0000 7f9305dff700 1 -- 172.21.15.112:0/2131587510 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9300073ea0 con 0x7f93000cfdb0 2023-09-12T16:07:13.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.059+0000 7f92e7fff700 1 -- 172.21.15.112:0/2131587510 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92f0056170 con 0x7f93000cfdb0 2023-09-12T16:07:13.060 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-09-12T16:07:13.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.061+0000 7f9305dff700 1 -- 172.21.15.112:0/2131587510 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f92ec06a580 msgr2=0x7f92ec06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:13.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.061+0000 7f9305dff700 1 --2- 172.21.15.112:0/2131587510 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f92ec06a580 0x7f92ec06ca40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f93001f5190 tx=0x7f92f4009040 comp rx=0 tx=0).stop 2023-09-12T16:07:13.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.061+0000 7f9305dff700 1 -- 172.21.15.112:0/2131587510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93000cfdb0 msgr2=0x7f93000c6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:13.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.061+0000 7f9305dff700 1 --2- 172.21.15.112:0/2131587510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93000cfdb0 0x7f93000c6760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f92f000a010 tx=0x7f92f0005da0 comp rx=0 tx=0).stop 2023-09-12T16:07:13.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.062+0000 7f9305dff700 1 -- 172.21.15.112:0/2131587510 shutdown_connections 2023-09-12T16:07:13.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.062+0000 7f9305dff700 1 --2- 172.21.15.112:0/2131587510 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f92ec06a580 0x7f92ec06ca40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:13.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.062+0000 7f9305dff700 1 --2- 172.21.15.112:0/2131587510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93000c5fa0 0x7f930006c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:13.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.062+0000 7f9305dff700 1 --2- 172.21.15.112:0/2131587510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93000cfdb0 0x7f93000c6760 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:13.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.062+0000 7f9305dff700 1 --2- 172.21.15.112:0/2131587510 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f930015bca0 0x7f930014edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:13.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.062+0000 7f9305dff700 1 -- 172.21.15.112:0/2131587510 >> 172.21.15.112:0/2131587510 conn(0x7f93000d17d0 msgr2=0x7f93000afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:13.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.062+0000 7f9305dff700 1 -- 172.21.15.112:0/2131587510 shutdown_connections 2023-09-12T16:07:13.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.062+0000 7f9305dff700 1 -- 172.21.15.112:0/2131587510 wait complete. 2023-09-12T16:07:13.079 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-12T16:07:13.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.280+0000 7f3cfc7ff700 1 -- 172.21.15.112:0/377999291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf40cf5b0 msgr2=0x7f3cf40cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:13.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.280+0000 7f3cfc7ff700 1 --2- 172.21.15.112:0/377999291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf40cf5b0 0x7f3cf40cebc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4005fd0 tx=0x7f3ce4009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:13.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.280+0000 7f3cfc7ff700 1 -- 172.21.15.112:0/377999291 shutdown_connections 2023-09-12T16:07:13.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.280+0000 7f3cfc7ff700 1 --2- 172.21.15.112:0/377999291 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf40cfdb0 0x7f3cf40d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:13.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.280+0000 7f3cfc7ff700 1 --2- 172.21.15.112:0/377999291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf40cf5b0 0x7f3cf40cebc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:13.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.280+0000 7f3cfc7ff700 1 -- 172.21.15.112:0/377999291 >> 172.21.15.112:0/377999291 conn(0x7f3cf40d17d0 msgr2=0x7f3cf40d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:13.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.280+0000 7f3cfc7ff700 1 -- 172.21.15.112:0/377999291 shutdown_connections 2023-09-12T16:07:13.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.280+0000 7f3cfc7ff700 1 -- 172.21.15.112:0/377999291 wait complete. 2023-09-12T16:07:13.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.282+0000 7f3cfc7ff700 1 Processor -- start 2023-09-12T16:07:13.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.282+0000 7f3cfc7ff700 1 -- start start 2023-09-12T16:07:13.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.283+0000 7f3cfc7ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf40cfdb0 0x7f3cf40c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:13.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.283+0000 7f3cfc7ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf415bca0 0x7f3cf41f1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:13.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.283+0000 7f3cfc7ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf40c88a0 0x7f3cf40b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:13.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.283+0000 7f3cfc7ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf40c9be0 con 0x7f3cf415bca0 2023-09-12T16:07:13.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.283+0000 7f3cfc7ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf40c9660 con 0x7f3cf40c88a0 2023-09-12T16:07:13.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.283+0000 7f3cfc7ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf40c6620 con 0x7f3cf40cfdb0 2023-09-12T16:07:13.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.283+0000 7f3cf9d9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf415bca0 0x7f3cf41f1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:13.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.283+0000 7f3cf9d9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf415bca0 0x7f3cf41f1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51894/0 (socket says 172.21.15.112:51894) 2023-09-12T16:07:13.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.283+0000 7f3cf9d9a700 1 -- 172.21.15.112:0/1142283479 learned_addr learned my addr 172.21.15.112:0/1142283479 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:13.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.283+0000 7f3cfa59b700 1 --2- 172.21.15.112:0/1142283479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf40cfdb0 0x7f3cf40c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:13.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.283+0000 7f3cfad9c700 1 --2- 172.21.15.112:0/1142283479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf40c88a0 0x7f3cf40b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:13.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.284+0000 7f3cf9d9a700 1 -- 172.21.15.112:0/1142283479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf40cfdb0 msgr2=0x7f3cf40c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:13.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.284+0000 7f3cf9d9a700 1 --2- 172.21.15.112:0/1142283479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf40cfdb0 0x7f3cf40c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:13.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.284+0000 7f3cf9d9a700 1 -- 172.21.15.112:0/1142283479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf40c88a0 msgr2=0x7f3cf40b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:13.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.284+0000 7f3cf9d9a700 1 --2- 172.21.15.112:0/1142283479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf40c88a0 0x7f3cf40b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:13.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.284+0000 7f3cf9d9a700 1 -- 172.21.15.112:0/1142283479 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce40095f0 con 0x7f3cf415bca0 2023-09-12T16:07:13.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.284+0000 7f3cfad9c700 1 --2- 172.21.15.112:0/1142283479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf40c88a0 0x7f3cf40b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:07:13.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.284+0000 7f3cf9d9a700 1 --2- 172.21.15.112:0/1142283479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf415bca0 0x7f3cf41f1c40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40098e0 tx=0x7f3ce400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:13.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.284+0000 7f3ceaffd700 1 -- 172.21.15.112:0/1142283479 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce401d070 con 0x7f3cf415bca0 2023-09-12T16:07:13.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.284+0000 7f3ceaffd700 1 -- 172.21.15.112:0/1142283479 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3ce4003890 con 0x7f3cf415bca0 2023-09-12T16:07:13.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.284+0000 7f3cfc7ff700 1 -- 172.21.15.112:0/1142283479 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf40c9900 con 0x7f3cf415bca0 2023-09-12T16:07:13.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.284+0000 7f3ceaffd700 1 -- 172.21.15.112:0/1142283479 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce40045f0 con 0x7f3cf415bca0 2023-09-12T16:07:13.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.284+0000 7f3cfc7ff700 1 -- 172.21.15.112:0/1142283479 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf40c6bc0 con 0x7f3cf415bca0 2023-09-12T16:07:13.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.285+0000 7f3cfc7ff700 1 -- 172.21.15.112:0/1142283479 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf415f700 con 0x7f3cf415bca0 2023-09-12T16:07:13.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.286+0000 7f3ceaffd700 1 -- 172.21.15.112:0/1142283479 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f3ce4003ca0 con 0x7f3cf415bca0 2023-09-12T16:07:13.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.287+0000 7f3ceaffd700 1 --2- 172.21.15.112:0/1142283479 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3cd806a580 0x7f3cd806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:13.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.287+0000 7f3ceaffd700 1 -- 172.21.15.112:0/1142283479 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3ce408a680 con 0x7f3cf415bca0 2023-09-12T16:07:13.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.287+0000 7f3cfa59b700 1 --2- 172.21.15.112:0/1142283479 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3cd806a580 0x7f3cd806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:13.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.288+0000 7f3cfa59b700 1 --2- 172.21.15.112:0/1142283479 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3cd806a580 0x7f3cd806ca40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0007fd0 tx=0x7f3cf0009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:13.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.291+0000 7f3ceaffd700 1 -- 172.21.15.112:0/1142283479 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f3ce40557f0 con 0x7f3cf415bca0 2023-09-12T16:07:13.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.488+0000 7f3cfc7ff700 1 -- 172.21.15.112:0/1142283479 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3cf40c6db0 con 0x7f3cf415bca0 2023-09-12T16:07:13.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.488+0000 7f3ceaffd700 1 -- 172.21.15.112:0/1142283479 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3ce4058e10 con 0x7f3cf415bca0 2023-09-12T16:07:13.489 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:07:13.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.491+0000 7f3cfc7ff700 1 -- 172.21.15.112:0/1142283479 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3cd806a580 msgr2=0x7f3cd806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:13.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.491+0000 7f3cfc7ff700 1 --2- 172.21.15.112:0/1142283479 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3cd806a580 0x7f3cd806ca40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0007fd0 tx=0x7f3cf0009040 comp rx=0 tx=0).stop 2023-09-12T16:07:13.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.491+0000 7f3cfc7ff700 1 -- 172.21.15.112:0/1142283479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf415bca0 msgr2=0x7f3cf41f1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:13.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.491+0000 7f3cfc7ff700 1 --2- 172.21.15.112:0/1142283479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf415bca0 0x7f3cf41f1c40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40098e0 tx=0x7f3ce400be30 comp rx=0 tx=0).stop 2023-09-12T16:07:13.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.491+0000 7f3cfc7ff700 1 -- 172.21.15.112:0/1142283479 shutdown_connections 2023-09-12T16:07:13.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.491+0000 7f3cfc7ff700 1 --2- 172.21.15.112:0/1142283479 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3cd806a580 0x7f3cd806ca40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:13.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.491+0000 7f3cfc7ff700 1 --2- 172.21.15.112:0/1142283479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf40cfdb0 0x7f3cf40c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:13.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.491+0000 7f3cfc7ff700 1 --2- 172.21.15.112:0/1142283479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf40c88a0 0x7f3cf40b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:13.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.491+0000 7f3cfc7ff700 1 --2- 172.21.15.112:0/1142283479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf415bca0 0x7f3cf41f1c40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:13.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.491+0000 7f3cfc7ff700 1 -- 172.21.15.112:0/1142283479 >> 172.21.15.112:0/1142283479 conn(0x7f3cf40d17d0 msgr2=0x7f3cf406bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:13.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.491+0000 7f3cfc7ff700 1 -- 172.21.15.112:0/1142283479 shutdown_connections 2023-09-12T16:07:13.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.491+0000 7f3cfc7ff700 1 -- 172.21.15.112:0/1142283479 wait complete. 2023-09-12T16:07:13.509 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-12T16:07:13.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.712+0000 7f96271ff700 1 -- 172.21.15.112:0/52628629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9610004ea0 msgr2=0x7f9610005320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:13.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.712+0000 7f96271ff700 1 --2- 172.21.15.112:0/52628629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9610004ea0 0x7f9610005320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f961800c680 tx=0x7f9610005880 comp rx=0 tx=0).stop 2023-09-12T16:07:13.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.712+0000 7f962579c700 1 -- 172.21.15.112:0/52628629 reap_dead start 2023-09-12T16:07:13.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.712+0000 7f96271ff700 1 -- 172.21.15.112:0/52628629 shutdown_connections 2023-09-12T16:07:13.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.712+0000 7f96271ff700 1 -- 172.21.15.112:0/52628629 >> 172.21.15.112:0/52628629 conn(0x7f96200d17d0 msgr2=0x7f96200d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:13.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.712+0000 7f96271ff700 1 -- 172.21.15.112:0/52628629 shutdown_connections 2023-09-12T16:07:13.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.712+0000 7f96271ff700 1 -- 172.21.15.112:0/52628629 wait complete. 2023-09-12T16:07:13.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.714+0000 7f96271ff700 1 Processor -- start 2023-09-12T16:07:13.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.714+0000 7f96271ff700 1 -- start start 2023-09-12T16:07:13.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.715+0000 7f96271ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9610004ea0 0x7f962015a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:13.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.715+0000 7f96271ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96201e7230 0x7f96201e62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:13.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.715+0000 7f96271ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96201e7690 0x7f96201e6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:13.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.715+0000 7f96271ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962015d610 con 0x7f96201e7690 2023-09-12T16:07:13.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.715+0000 7f96271ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96201e6d70 con 0x7f96201e7230 2023-09-12T16:07:13.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.715+0000 7f96271ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96200c66f0 con 0x7f9610004ea0 2023-09-12T16:07:13.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.715+0000 7f962579c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96201e7690 0x7f96201e6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:13.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.715+0000 7f962579c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96201e7690 0x7f96201e6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51914/0 (socket says 172.21.15.112:51914) 2023-09-12T16:07:13.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.715+0000 7f962579c700 1 -- 172.21.15.112:0/3518857979 learned_addr learned my addr 172.21.15.112:0/3518857979 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:13.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.715+0000 7f961ffff700 1 --2- 172.21.15.112:0/3518857979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96201e7230 0x7f96201e62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:13.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.715+0000 7f9624f9b700 1 --2- 172.21.15.112:0/3518857979 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9610004ea0 0x7f962015a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:13.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.716+0000 7f962579c700 1 -- 172.21.15.112:0/3518857979 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9610004ea0 msgr2=0x7f962015a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:13.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.716+0000 7f962579c700 1 --2- 172.21.15.112:0/3518857979 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9610004ea0 0x7f962015a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:13.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.716+0000 7f962579c700 1 -- 172.21.15.112:0/3518857979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96201e7230 msgr2=0x7f96201e62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:13.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.716+0000 7f962579c700 1 --2- 172.21.15.112:0/3518857979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96201e7230 0x7f96201e62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:13.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.716+0000 7f962579c700 1 -- 172.21.15.112:0/3518857979 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96200c69d0 con 0x7f96201e7690 2023-09-12T16:07:13.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.716+0000 7f962579c700 1 --2- 172.21.15.112:0/3518857979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96201e7690 0x7f96201e6830 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f961000bd70 tx=0x7f96180020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:13.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.716+0000 7f961d7fa700 1 -- 172.21.15.112:0/3518857979 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9618006e70 con 0x7f96201e7690 2023-09-12T16:07:13.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.716+0000 7f961d7fa700 1 -- 172.21.15.112:0/3518857979 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9618006400 con 0x7f96201e7690 2023-09-12T16:07:13.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.716+0000 7f961d7fa700 1 -- 172.21.15.112:0/3518857979 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9618006810 con 0x7f96201e7690 2023-09-12T16:07:13.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.716+0000 7f96271ff700 1 -- 172.21.15.112:0/3518857979 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96200c6cb0 con 0x7f96201e7690 2023-09-12T16:07:13.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.716+0000 7f96271ff700 1 -- 172.21.15.112:0/3518857979 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962015a950 con 0x7f96201e7690 2023-09-12T16:07:13.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.717+0000 7f96271ff700 1 -- 172.21.15.112:0/3518857979 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962015d7c0 con 0x7f96201e7690 2023-09-12T16:07:13.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.718+0000 7f961d7fa700 1 -- 172.21.15.112:0/3518857979 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f9618022070 con 0x7f96201e7690 2023-09-12T16:07:13.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.719+0000 7f961d7fa700 1 --2- 172.21.15.112:0/3518857979 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f960406a580 0x7f960406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:13.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.719+0000 7f961d7fa700 1 -- 172.21.15.112:0/3518857979 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f961808ade0 con 0x7f96201e7690 2023-09-12T16:07:13.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.720+0000 7f9624f9b700 1 --2- 172.21.15.112:0/3518857979 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f960406a580 0x7f960406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:13.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.720+0000 7f9624f9b700 1 --2- 172.21.15.112:0/3518857979 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f960406a580 0x7f960406ca40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f96200c8390 tx=0x7f9614009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:13.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.723+0000 7f961d7fa700 1 -- 172.21.15.112:0/3518857979 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f962015d7c0 con 0x7f96201e7690 2023-09-12T16:07:13.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.922+0000 7f96271ff700 1 -- 172.21.15.112:0/3518857979 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9620073ea0 con 0x7f96201e7690 2023-09-12T16:07:13.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.923+0000 7f961d7fa700 1 -- 172.21.15.112:0/3518857979 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f961802a0a0 con 0x7f96201e7690 2023-09-12T16:07:13.923 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-09-12T16:07:13.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.925+0000 7f96271ff700 1 -- 172.21.15.112:0/3518857979 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f960406a580 msgr2=0x7f960406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:13.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.925+0000 7f96271ff700 1 --2- 172.21.15.112:0/3518857979 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f960406a580 0x7f960406ca40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f96200c8390 tx=0x7f9614009260 comp rx=0 tx=0).stop 2023-09-12T16:07:13.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.925+0000 7f96271ff700 1 -- 172.21.15.112:0/3518857979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96201e7690 msgr2=0x7f96201e6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:13.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.925+0000 7f96271ff700 1 --2- 172.21.15.112:0/3518857979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96201e7690 0x7f96201e6830 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f961000bd70 tx=0x7f96180020c0 comp rx=0 tx=0).stop 2023-09-12T16:07:13.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.925+0000 7f96271ff700 1 -- 172.21.15.112:0/3518857979 shutdown_connections 2023-09-12T16:07:13.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.925+0000 7f96271ff700 1 --2- 172.21.15.112:0/3518857979 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f960406a580 0x7f960406ca40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:13.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.925+0000 7f96271ff700 1 --2- 172.21.15.112:0/3518857979 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9610004ea0 0x7f962015a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:13.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.925+0000 7f96271ff700 1 --2- 172.21.15.112:0/3518857979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96201e7690 0x7f96201e6830 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:13.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.925+0000 7f96271ff700 1 --2- 172.21.15.112:0/3518857979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96201e7230 0x7f96201e62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:13.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.925+0000 7f96271ff700 1 -- 172.21.15.112:0/3518857979 >> 172.21.15.112:0/3518857979 conn(0x7f96200d17d0 msgr2=0x7f96200ca8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:13.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.925+0000 7f96271ff700 1 -- 172.21.15.112:0/3518857979 shutdown_connections 2023-09-12T16:07:13.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:13.926+0000 7f96271ff700 1 -- 172.21.15.112:0/3518857979 wait complete. 2023-09-12T16:07:13.943 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-12T16:07:14.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.145+0000 7f56ee7ff700 1 -- 172.21.15.112:0/2391054934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56e80cfdb0 msgr2=0x7f56e80d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:14.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.145+0000 7f56ee7ff700 1 --2- 172.21.15.112:0/2391054934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56e80cfdb0 0x7f56e80d01e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009f90 tx=0x7f56e000b330 comp rx=0 tx=0).stop 2023-09-12T16:07:14.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.145+0000 7f56ee7ff700 1 -- 172.21.15.112:0/2391054934 shutdown_connections 2023-09-12T16:07:14.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.145+0000 7f56ee7ff700 1 --2- 172.21.15.112:0/2391054934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56e80cfdb0 0x7f56e80d01e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:14.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.145+0000 7f56ee7ff700 1 -- 172.21.15.112:0/2391054934 >> 172.21.15.112:0/2391054934 conn(0x7f56e80d17d0 msgr2=0x7f56e80d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:14.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.145+0000 7f56ee7ff700 1 -- 172.21.15.112:0/2391054934 shutdown_connections 2023-09-12T16:07:14.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.145+0000 7f56ee7ff700 1 -- 172.21.15.112:0/2391054934 wait complete. 2023-09-12T16:07:14.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.147+0000 7f56ee7ff700 1 Processor -- start 2023-09-12T16:07:14.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.147+0000 7f56ee7ff700 1 -- start start 2023-09-12T16:07:14.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.148+0000 7f56ee7ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56e80cfdb0 0x7f56e81447e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:14.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.148+0000 7f56ee7ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56e815bca0 0x7f56e80c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:14.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.148+0000 7f56ee7ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56e80c8de0 0x7f56e81577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:14.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.148+0000 7f56ee7ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e80c9290 con 0x7f56e80cfdb0 2023-09-12T16:07:14.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.148+0000 7f56ee7ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e8158e00 con 0x7f56e815bca0 2023-09-12T16:07:14.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.148+0000 7f56ee7ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e8158560 con 0x7f56e80c8de0 2023-09-12T16:07:14.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.148+0000 7f56e7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56e80cfdb0 0x7f56e81447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:14.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.148+0000 7f56e7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56e80cfdb0 0x7f56e81447e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51922/0 (socket says 172.21.15.112:51922) 2023-09-12T16:07:14.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.148+0000 7f56e7fff700 1 -- 172.21.15.112:0/1125878312 learned_addr learned my addr 172.21.15.112:0/1125878312 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:14.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.148+0000 7f56ecd9c700 1 --2- 172.21.15.112:0/1125878312 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56e80c8de0 0x7f56e81577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:14.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.148+0000 7f56e7fff700 1 -- 172.21.15.112:0/1125878312 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56e80c8de0 msgr2=0x7f56e81577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:14.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.148+0000 7f56e77fe700 1 --2- 172.21.15.112:0/1125878312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56e815bca0 0x7f56e80c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:14.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.149+0000 7f56e7fff700 1 --2- 172.21.15.112:0/1125878312 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56e80c8de0 0x7f56e81577a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:14.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.149+0000 7f56e7fff700 1 -- 172.21.15.112:0/1125878312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56e815bca0 msgr2=0x7f56e80c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:14.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.149+0000 7f56e7fff700 1 --2- 172.21.15.112:0/1125878312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56e815bca0 0x7f56e80c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:14.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.149+0000 7f56e7fff700 1 -- 172.21.15.112:0/1125878312 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e0009c40 con 0x7f56e80cfdb0 2023-09-12T16:07:14.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.149+0000 7f56e7fff700 1 --2- 172.21.15.112:0/1125878312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56e80cfdb0 0x7f56e81447e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f56d800c500 tx=0x7f56d800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:14.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.149+0000 7f56e4ff9700 1 -- 172.21.15.112:0/1125878312 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d80052d0 con 0x7f56e80cfdb0 2023-09-12T16:07:14.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.149+0000 7f56e4ff9700 1 -- 172.21.15.112:0/1125878312 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f56d8005540 con 0x7f56e80cfdb0 2023-09-12T16:07:14.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.149+0000 7f56ee7ff700 1 -- 172.21.15.112:0/1125878312 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e8158840 con 0x7f56e80cfdb0 2023-09-12T16:07:14.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.149+0000 7f56e4ff9700 1 -- 172.21.15.112:0/1125878312 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d80038e0 con 0x7f56e80cfdb0 2023-09-12T16:07:14.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.149+0000 7f56ee7ff700 1 -- 172.21.15.112:0/1125878312 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e8145080 con 0x7f56e80cfdb0 2023-09-12T16:07:14.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.150+0000 7f56ee7ff700 1 -- 172.21.15.112:0/1125878312 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e8073ea0 con 0x7f56e80cfdb0 2023-09-12T16:07:14.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.151+0000 7f56e4ff9700 1 -- 172.21.15.112:0/1125878312 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f56d8003a40 con 0x7f56e80cfdb0 2023-09-12T16:07:14.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.152+0000 7f56e4ff9700 1 --2- 172.21.15.112:0/1125878312 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f56d406a580 0x7f56d406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:14.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.153+0000 7f56e4ff9700 1 -- 172.21.15.112:0/1125878312 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f56d8088460 con 0x7f56e80cfdb0 2023-09-12T16:07:14.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.153+0000 7f56e77fe700 1 --2- 172.21.15.112:0/1125878312 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f56d406a580 0x7f56d406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:14.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.153+0000 7f56e77fe700 1 --2- 172.21.15.112:0/1125878312 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f56d406a580 0x7f56d406ca40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f56e81596c0 tx=0x7f56dc009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:14.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.157+0000 7f56e4ff9700 1 -- 172.21.15.112:0/1125878312 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f56d8053780 con 0x7f56e80cfdb0 2023-09-12T16:07:14.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.354+0000 7f56ee7ff700 1 -- 172.21.15.112:0/1125878312 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f56e808b860 con 0x7f56e80cfdb0 2023-09-12T16:07:14.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.354+0000 7f56e4ff9700 1 -- 172.21.15.112:0/1125878312 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f56d8056da0 con 0x7f56e80cfdb0 2023-09-12T16:07:14.354 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:07:14.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.356+0000 7f56ee7ff700 1 -- 172.21.15.112:0/1125878312 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f56d406a580 msgr2=0x7f56d406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:14.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.356+0000 7f56ee7ff700 1 --2- 172.21.15.112:0/1125878312 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f56d406a580 0x7f56d406ca40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f56e81596c0 tx=0x7f56dc009040 comp rx=0 tx=0).stop 2023-09-12T16:07:14.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.356+0000 7f56ee7ff700 1 -- 172.21.15.112:0/1125878312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56e80cfdb0 msgr2=0x7f56e81447e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:14.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.356+0000 7f56ee7ff700 1 --2- 172.21.15.112:0/1125878312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56e80cfdb0 0x7f56e81447e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f56d800c500 tx=0x7f56d800c8c0 comp rx=0 tx=0).stop 2023-09-12T16:07:14.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.357+0000 7f56ee7ff700 1 -- 172.21.15.112:0/1125878312 shutdown_connections 2023-09-12T16:07:14.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.357+0000 7f56ee7ff700 1 --2- 172.21.15.112:0/1125878312 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f56d406a580 0x7f56d406ca40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:14.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.357+0000 7f56ee7ff700 1 --2- 172.21.15.112:0/1125878312 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56e80c8de0 0x7f56e81577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:14.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.357+0000 7f56ee7ff700 1 --2- 172.21.15.112:0/1125878312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56e80cfdb0 0x7f56e81447e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:14.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.357+0000 7f56ee7ff700 1 --2- 172.21.15.112:0/1125878312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56e815bca0 0x7f56e80c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:14.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.357+0000 7f56ee7ff700 1 -- 172.21.15.112:0/1125878312 >> 172.21.15.112:0/1125878312 conn(0x7f56e80d17d0 msgr2=0x7f56e815af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:14.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.357+0000 7f56ee7ff700 1 -- 172.21.15.112:0/1125878312 shutdown_connections 2023-09-12T16:07:14.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.357+0000 7f56ee7ff700 1 -- 172.21.15.112:0/1125878312 wait complete. 2023-09-12T16:07:14.375 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-12T16:07:14.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.573+0000 7f8f32dff700 1 -- 172.21.15.112:0/559383709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f1c003a00 msgr2=0x7f8f1c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:14.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.573+0000 7f8f32dff700 1 --2- 172.21.15.112:0/559383709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f1c003a00 0x7f8f1c003e20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8f2000c310 tx=0x7f8f1c005880 comp rx=0 tx=0).stop 2023-09-12T16:07:14.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.574+0000 7f8f32dff700 1 -- 172.21.15.112:0/559383709 shutdown_connections 2023-09-12T16:07:14.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.574+0000 7f8f32dff700 1 --2- 172.21.15.112:0/559383709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f1c003a00 0x7f8f1c003e20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:14.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.574+0000 7f8f32dff700 1 -- 172.21.15.112:0/559383709 >> 172.21.15.112:0/559383709 conn(0x7f8f2c0d1930 msgr2=0x7f8f2c0d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:14.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.574+0000 7f8f32dff700 1 -- 172.21.15.112:0/559383709 shutdown_connections 2023-09-12T16:07:14.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.574+0000 7f8f32dff700 1 -- 172.21.15.112:0/559383709 wait complete. 2023-09-12T16:07:14.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.575+0000 7f8f32dff700 1 Processor -- start 2023-09-12T16:07:14.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.575+0000 7f8f32dff700 1 -- start start 2023-09-12T16:07:14.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.576+0000 7f8f32dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1c003a00 0x7f8f2c148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:14.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.576+0000 7f8f32dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f2c0c9d40 0x7f8f2c0b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:14.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.576+0000 7f8f32dff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f2c0ca850 0x7f8f2c0cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:14.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.576+0000 7f8f32dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c1492f0 con 0x7f8f2c0c9d40 2023-09-12T16:07:14.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.576+0000 7f8f32dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0cb210 con 0x7f8f1c003a00 2023-09-12T16:07:14.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.576+0000 7f8f32dff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0b50b0 con 0x7f8f2c0ca850 2023-09-12T16:07:14.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.577+0000 7f8f2bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f2c0c9d40 0x7f8f2c0b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:14.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.577+0000 7f8f2bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f2c0c9d40 0x7f8f2c0b7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51940/0 (socket says 172.21.15.112:51940) 2023-09-12T16:07:14.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.577+0000 7f8f2bfff700 1 -- 172.21.15.112:0/195685577 learned_addr learned my addr 172.21.15.112:0/195685577 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:14.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.577+0000 7f8f30b9b700 1 --2- 172.21.15.112:0/195685577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1c003a00 0x7f8f2c148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:14.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.577+0000 7f8f2bfff700 1 -- 172.21.15.112:0/195685577 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f2c0ca850 msgr2=0x7f8f2c0cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:14.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.577+0000 7f8f2bfff700 1 --2- 172.21.15.112:0/195685577 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f2c0ca850 0x7f8f2c0cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:14.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.577+0000 7f8f2bfff700 1 -- 172.21.15.112:0/195685577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1c003a00 msgr2=0x7f8f2c148db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:14.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.577+0000 7f8f2bfff700 1 --2- 172.21.15.112:0/195685577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1c003a00 0x7f8f2c148db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:14.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.577+0000 7f8f2bfff700 1 -- 172.21.15.112:0/195685577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c0b5370 con 0x7f8f2c0c9d40 2023-09-12T16:07:14.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.577+0000 7f8f30b9b700 1 --2- 172.21.15.112:0/195685577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1c003a00 0x7f8f2c148db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:14.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.577+0000 7f8f2bfff700 1 --2- 172.21.15.112:0/195685577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f2c0c9d40 0x7f8f2c0b7080 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8f18010b20 tx=0x7f8f18010ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:14.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.577+0000 7f8f297fa700 1 -- 172.21.15.112:0/195685577 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1800ed10 con 0x7f8f2c0c9d40 2023-09-12T16:07:14.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.577+0000 7f8f297fa700 1 -- 172.21.15.112:0/195685577 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8f1800ee70 con 0x7f8f2c0c9d40 2023-09-12T16:07:14.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.577+0000 7f8f297fa700 1 -- 172.21.15.112:0/195685577 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f18004a90 con 0x7f8f2c0c9d40 2023-09-12T16:07:14.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.577+0000 7f8f32dff700 1 -- 172.21.15.112:0/195685577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2c0b5650 con 0x7f8f2c0c9d40 2023-09-12T16:07:14.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.578+0000 7f8f32dff700 1 -- 172.21.15.112:0/195685577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2c0b75c0 con 0x7f8f2c0c9d40 2023-09-12T16:07:14.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.579+0000 7f8f32dff700 1 -- 172.21.15.112:0/195685577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2c0b5ca0 con 0x7f8f2c0c9d40 2023-09-12T16:07:14.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.579+0000 7f8f297fa700 1 -- 172.21.15.112:0/195685577 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f8f18004bf0 con 0x7f8f2c0c9d40 2023-09-12T16:07:14.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.580+0000 7f8f297fa700 1 --2- 172.21.15.112:0/195685577 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8f1006a580 0x7f8f1006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:14.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.581+0000 7f8f297fa700 1 -- 172.21.15.112:0/195685577 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8f18016070 con 0x7f8f2c0c9d40 2023-09-12T16:07:14.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.581+0000 7f8f30b9b700 1 --2- 172.21.15.112:0/195685577 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8f1006a580 0x7f8f1006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:14.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.581+0000 7f8f30b9b700 1 --2- 172.21.15.112:0/195685577 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8f1006a580 0x7f8f1006ca40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f20000c00 tx=0x7f8f2000f000 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:14.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.584+0000 7f8f297fa700 1 -- 172.21.15.112:0/195685577 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f8f18054dd0 con 0x7f8f2c0c9d40 2023-09-12T16:07:14.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.795+0000 7f8f32dff700 1 -- 172.21.15.112:0/195685577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8f2c04e300 con 0x7f8f2c0c9d40 2023-09-12T16:07:14.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.796+0000 7f8f297fa700 1 -- 172.21.15.112:0/195685577 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8f180583f0 con 0x7f8f2c0c9d40 2023-09-12T16:07:14.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.798+0000 7f8f32dff700 1 -- 172.21.15.112:0/195685577 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8f1006a580 msgr2=0x7f8f1006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:14.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.798+0000 7f8f32dff700 1 --2- 172.21.15.112:0/195685577 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8f1006a580 0x7f8f1006ca40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f20000c00 tx=0x7f8f2000f000 comp rx=0 tx=0).stop 2023-09-12T16:07:14.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.798+0000 7f8f32dff700 1 -- 172.21.15.112:0/195685577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f2c0c9d40 msgr2=0x7f8f2c0b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:14.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.798+0000 7f8f32dff700 1 --2- 172.21.15.112:0/195685577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f2c0c9d40 0x7f8f2c0b7080 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8f18010b20 tx=0x7f8f18010ee0 comp rx=0 tx=0).stop 2023-09-12T16:07:14.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.799+0000 7f8f32dff700 1 -- 172.21.15.112:0/195685577 shutdown_connections 2023-09-12T16:07:14.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.799+0000 7f8f32dff700 1 --2- 172.21.15.112:0/195685577 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8f1006a580 0x7f8f1006ca40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:14.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.799+0000 7f8f32dff700 1 --2- 172.21.15.112:0/195685577 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f2c0ca850 0x7f8f2c0cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:14.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.799+0000 7f8f32dff700 1 --2- 172.21.15.112:0/195685577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1c003a00 0x7f8f2c148db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:14.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.799+0000 7f8f32dff700 1 --2- 172.21.15.112:0/195685577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f2c0c9d40 0x7f8f2c0b7080 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:14.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.799+0000 7f8f32dff700 1 -- 172.21.15.112:0/195685577 >> 172.21.15.112:0/195685577 conn(0x7f8f2c0d1930 msgr2=0x7f8f2c0cc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:14.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.799+0000 7f8f32dff700 1 -- 172.21.15.112:0/195685577 shutdown_connections 2023-09-12T16:07:14.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:14.799+0000 7f8f32dff700 1 -- 172.21.15.112:0/195685577 wait complete. 2023-09-12T16:07:14.801 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2023-09-12T16:07:14.817 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:07:14.817 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T16:07:14.864 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:07:15.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.102+0000 7fa0c1bff700 1 -- 172.21.15.112:0/2882546398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0bc15f480 msgr2=0x7fa0bc0cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:15.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.102+0000 7fa0c1bff700 1 --2- 172.21.15.112:0/2882546398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0bc15f480 0x7fa0bc0cfe80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac009fd0 tx=0x7fa0ac00b3d0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.102+0000 7fa0c1bff700 1 -- 172.21.15.112:0/2882546398 shutdown_connections 2023-09-12T16:07:15.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.102+0000 7fa0c1bff700 1 --2- 172.21.15.112:0/2882546398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0bc15f480 0x7fa0bc0cfe80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.102+0000 7fa0c1bff700 1 --2- 172.21.15.112:0/2882546398 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0bc0cdfb0 0x7fa0bc0d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.102+0000 7fa0c1bff700 1 -- 172.21.15.112:0/2882546398 >> 172.21.15.112:0/2882546398 conn(0x7fa0bc0d1930 msgr2=0x7fa0bc0d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:15.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.102+0000 7fa0c1bff700 1 -- 172.21.15.112:0/2882546398 shutdown_connections 2023-09-12T16:07:15.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.102+0000 7fa0c1bff700 1 -- 172.21.15.112:0/2882546398 wait complete. 2023-09-12T16:07:15.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.104+0000 7fa0c1bff700 1 Processor -- start 2023-09-12T16:07:15.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.104+0000 7fa0c1bff700 1 -- start start 2023-09-12T16:07:15.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.105+0000 7fa0c1bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0bc0b28f0 0x7fa0bc1f2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:15.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.105+0000 7fa0c1bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc0cdfb0 0x7fa0bc15aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:15.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.105+0000 7fa0c1bff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0bc15f480 0x7fa0bc0aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:15.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.105+0000 7fa0c1bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc1f2550 con 0x7fa0bc0b28f0 2023-09-12T16:07:15.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.105+0000 7fa0c1bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc1f3010 con 0x7fa0bc0cdfb0 2023-09-12T16:07:15.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.105+0000 7fa0c1bff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc15b0e0 con 0x7fa0bc15f480 2023-09-12T16:07:15.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.105+0000 7fa0bb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0bc0b28f0 0x7fa0bc1f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:15.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.105+0000 7fa0bb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0bc0b28f0 0x7fa0bc1f2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51956/0 (socket says 172.21.15.112:51956) 2023-09-12T16:07:15.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.105+0000 7fa0bb7fe700 1 -- 172.21.15.112:0/3154315585 learned_addr learned my addr 172.21.15.112:0/3154315585 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:15.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.106+0000 7fa0b2ffd700 1 --2- 172.21.15.112:0/3154315585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc0cdfb0 0x7fa0bc15aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:15.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.106+0000 7fa0bb7fe700 1 -- 172.21.15.112:0/3154315585 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0bc15f480 msgr2=0x7fa0bc0aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:15.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.106+0000 7fa0bb7fe700 1 --2- 172.21.15.112:0/3154315585 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0bc15f480 0x7fa0bc0aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.106+0000 7fa0bb7fe700 1 -- 172.21.15.112:0/3154315585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc0cdfb0 msgr2=0x7fa0bc15aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:15.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.106+0000 7fa0bb7fe700 1 --2- 172.21.15.112:0/3154315585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc0cdfb0 0x7fa0bc15aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.106+0000 7fa0bb7fe700 1 -- 172.21.15.112:0/3154315585 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac009d00 con 0x7fa0bc0b28f0 2023-09-12T16:07:15.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.106+0000 7fa0b2ffd700 1 --2- 172.21.15.112:0/3154315585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc0cdfb0 0x7fa0bc15aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:15.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.106+0000 7fa0bb7fe700 1 --2- 172.21.15.112:0/3154315585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0bc0b28f0 0x7fa0bc1f2010 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc08b1f0 tx=0x7fa0ac007be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:15.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.106+0000 7fa0b8ff9700 1 -- 172.21.15.112:0/3154315585 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac00e040 con 0x7fa0bc0b28f0 2023-09-12T16:07:15.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.106+0000 7fa0b8ff9700 1 -- 172.21.15.112:0/3154315585 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa0ac003c20 con 0x7fa0bc0b28f0 2023-09-12T16:07:15.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.106+0000 7fa0c1bff700 1 -- 172.21.15.112:0/3154315585 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0bc0af210 con 0x7fa0bc0b28f0 2023-09-12T16:07:15.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.106+0000 7fa0b8ff9700 1 -- 172.21.15.112:0/3154315585 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac009b80 con 0x7fa0bc0b28f0 2023-09-12T16:07:15.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.106+0000 7fa0c1bff700 1 -- 172.21.15.112:0/3154315585 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0bc1f2a50 con 0x7fa0bc0b28f0 2023-09-12T16:07:15.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.107+0000 7fa0c1bff700 1 -- 172.21.15.112:0/3154315585 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0bc04e300 con 0x7fa0bc0b28f0 2023-09-12T16:07:15.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.108+0000 7fa0b8ff9700 1 -- 172.21.15.112:0/3154315585 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fa0ac012600 con 0x7fa0bc0b28f0 2023-09-12T16:07:15.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.109+0000 7fa0b8ff9700 1 --2- 172.21.15.112:0/3154315585 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa09c06a570 0x7fa09c06ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:15.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.109+0000 7fa0b8ff9700 1 -- 172.21.15.112:0/3154315585 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa0ac089f90 con 0x7fa0bc0b28f0 2023-09-12T16:07:15.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.109+0000 7fa0b2ffd700 1 --2- 172.21.15.112:0/3154315585 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa09c06a570 0x7fa09c06ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:15.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.110+0000 7fa0b2ffd700 1 --2- 172.21.15.112:0/3154315585 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa09c06a570 0x7fa09c06ca30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4005fd0 tx=0x7fa0a4005ee0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:15.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.113+0000 7fa0b8ff9700 1 -- 172.21.15.112:0/3154315585 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fa0ac055210 con 0x7fa0bc0b28f0 2023-09-12T16:07:15.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.318+0000 7fa0c1bff700 1 -- 172.21.15.112:0/3154315585 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0bc0b3ba0 con 0x7fa0bc0b28f0 2023-09-12T16:07:15.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.319+0000 7fa0b8ff9700 1 -- 172.21.15.112:0/3154315585 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fa0ac022070 con 0x7fa0bc0b28f0 2023-09-12T16:07:15.319 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:15.320 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:04.748402+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:07:15.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.321+0000 7fa0c1bff700 1 -- 172.21.15.112:0/3154315585 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa09c06a570 msgr2=0x7fa09c06ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:15.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.321+0000 7fa0c1bff700 1 --2- 172.21.15.112:0/3154315585 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa09c06a570 0x7fa09c06ca30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4005fd0 tx=0x7fa0a4005ee0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.321+0000 7fa0c1bff700 1 -- 172.21.15.112:0/3154315585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0bc0b28f0 msgr2=0x7fa0bc1f2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:15.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.321+0000 7fa0c1bff700 1 --2- 172.21.15.112:0/3154315585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0bc0b28f0 0x7fa0bc1f2010 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc08b1f0 tx=0x7fa0ac007be0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.322+0000 7fa0c1bff700 1 -- 172.21.15.112:0/3154315585 shutdown_connections 2023-09-12T16:07:15.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.322+0000 7fa0c1bff700 1 --2- 172.21.15.112:0/3154315585 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa09c06a570 0x7fa09c06ca30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.322+0000 7fa0c1bff700 1 --2- 172.21.15.112:0/3154315585 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0bc15f480 0x7fa0bc0aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.322+0000 7fa0c1bff700 1 --2- 172.21.15.112:0/3154315585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0bc0b28f0 0x7fa0bc1f2010 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.322+0000 7fa0c1bff700 1 --2- 172.21.15.112:0/3154315585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc0cdfb0 0x7fa0bc15aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.322+0000 7fa0c1bff700 1 -- 172.21.15.112:0/3154315585 >> 172.21.15.112:0/3154315585 conn(0x7fa0bc0d1930 msgr2=0x7fa0bc06cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:15.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.322+0000 7fa0c1bff700 1 -- 172.21.15.112:0/3154315585 shutdown_connections 2023-09-12T16:07:15.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.322+0000 7fa0c1bff700 1 -- 172.21.15.112:0/3154315585 wait complete. 2023-09-12T16:07:15.340 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-12T16:06:48.871680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-12T16:06:58.137223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-12T16:06:58.684034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-12T16:07:02.283459+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-12T16:07:15.341 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-12T16:07:15.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.542+0000 7f7a3c1ff700 1 -- 172.21.15.112:0/3941627235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a3415bca0 msgr2=0x7f7a3415cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:15.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.542+0000 7f7a3c1ff700 1 --2- 172.21.15.112:0/3941627235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a3415bca0 0x7f7a3415cb90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7a340cbed0 tx=0x7f7a30009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:15.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.543+0000 7f7a3c1ff700 1 -- 172.21.15.112:0/3941627235 shutdown_connections 2023-09-12T16:07:15.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.543+0000 7f7a3c1ff700 1 --2- 172.21.15.112:0/3941627235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a3415bca0 0x7f7a3415cb90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.543+0000 7f7a3c1ff700 1 --2- 172.21.15.112:0/3941627235 >> v2:172.21.15.144:3300/0 conn(0x7f7a340cf5b0 0x7f7a340cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.543+0000 7f7a3c1ff700 1 -- 172.21.15.112:0/3941627235 >> 172.21.15.112:0/3941627235 conn(0x7f7a340d17d0 msgr2=0x7f7a340d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:15.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.543+0000 7f7a3c1ff700 1 -- 172.21.15.112:0/3941627235 shutdown_connections 2023-09-12T16:07:15.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.543+0000 7f7a3c1ff700 1 -- 172.21.15.112:0/3941627235 wait complete. 2023-09-12T16:07:15.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.544+0000 7f7a3c1ff700 1 Processor -- start 2023-09-12T16:07:15.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.545+0000 7f7a3c1ff700 1 -- start start 2023-09-12T16:07:15.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.545+0000 7f7a3c1ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a340cfdb0 0x7f7a3414a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:15.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.546+0000 7f7a3c1ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a3415bca0 0x7f7a340c5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:15.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.546+0000 7f7a3c1ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a341570a0 0x7f7a3415f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:15.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.546+0000 7f7a3c1ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3415ec00 con 0x7f7a3415bca0 2023-09-12T16:07:15.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.546+0000 7f7a3c1ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a340c5840 con 0x7f7a340cfdb0 2023-09-12T16:07:15.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.546+0000 7f7a3c1ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a340c7c80 con 0x7f7a341570a0 2023-09-12T16:07:15.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.546+0000 7f7a3979a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a3415bca0 0x7f7a340c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:15.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.546+0000 7f7a3979a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a3415bca0 0x7f7a340c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51976/0 (socket says 172.21.15.112:51976) 2023-09-12T16:07:15.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.546+0000 7f7a3979a700 1 -- 172.21.15.112:0/4097417190 learned_addr learned my addr 172.21.15.112:0/4097417190 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:15.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.546+0000 7f7a39f9b700 1 --2- 172.21.15.112:0/4097417190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a340cfdb0 0x7f7a3414a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:15.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.546+0000 7f7a3a79c700 1 --2- 172.21.15.112:0/4097417190 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a341570a0 0x7f7a3415f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:15.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.546+0000 7f7a3979a700 1 -- 172.21.15.112:0/4097417190 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a341570a0 msgr2=0x7f7a3415f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:15.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.546+0000 7f7a3979a700 1 --2- 172.21.15.112:0/4097417190 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a341570a0 0x7f7a3415f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.546+0000 7f7a3979a700 1 -- 172.21.15.112:0/4097417190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a340cfdb0 msgr2=0x7f7a3414a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:15.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.546+0000 7f7a3979a700 1 --2- 172.21.15.112:0/4097417190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a340cfdb0 0x7f7a3414a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.546+0000 7f7a3979a700 1 -- 172.21.15.112:0/4097417190 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a300095f0 con 0x7f7a3415bca0 2023-09-12T16:07:15.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.546+0000 7f7a3a79c700 1 --2- 172.21.15.112:0/4097417190 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a341570a0 0x7f7a3415f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:07:15.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.546+0000 7f7a3979a700 1 --2- 172.21.15.112:0/4097417190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a3415bca0 0x7f7a340c5300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400d950 tx=0x7f7a2400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:15.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.547+0000 7f7a2a7fc700 1 -- 172.21.15.112:0/4097417190 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24009940 con 0x7f7a3415bca0 2023-09-12T16:07:15.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.547+0000 7f7a2a7fc700 1 -- 172.21.15.112:0/4097417190 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7a24009b90 con 0x7f7a3415bca0 2023-09-12T16:07:15.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.547+0000 7f7a3c1ff700 1 -- 172.21.15.112:0/4097417190 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a3415a160 con 0x7f7a3415bca0 2023-09-12T16:07:15.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.547+0000 7f7a2a7fc700 1 -- 172.21.15.112:0/4097417190 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24010460 con 0x7f7a3415bca0 2023-09-12T16:07:15.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.547+0000 7f7a3c1ff700 1 -- 172.21.15.112:0/4097417190 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a340c8210 con 0x7f7a3415bca0 2023-09-12T16:07:15.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.548+0000 7f7a3c1ff700 1 -- 172.21.15.112:0/4097417190 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a34073ea0 con 0x7f7a3415bca0 2023-09-12T16:07:15.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.549+0000 7f7a2a7fc700 1 -- 172.21.15.112:0/4097417190 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f7a240105c0 con 0x7f7a3415bca0 2023-09-12T16:07:15.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.550+0000 7f7a2a7fc700 1 --2- 172.21.15.112:0/4097417190 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7a1806a580 0x7f7a1806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:15.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.550+0000 7f7a2a7fc700 1 -- 172.21.15.112:0/4097417190 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7a240892c0 con 0x7f7a3415bca0 2023-09-12T16:07:15.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.550+0000 7f7a39f9b700 1 --2- 172.21.15.112:0/4097417190 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7a1806a580 0x7f7a1806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:15.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.551+0000 7f7a39f9b700 1 --2- 172.21.15.112:0/4097417190 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7a1806a580 0x7f7a1806ca40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7a300098e0 tx=0x7f7a30019040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:15.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.554+0000 7f7a2a7fc700 1 -- 172.21.15.112:0/4097417190 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f7a240545e0 con 0x7f7a3415bca0 2023-09-12T16:07:15.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.752+0000 7f7a3c1ff700 1 -- 172.21.15.112:0/4097417190 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7a3406cb70 con 0x7f7a3415bca0 2023-09-12T16:07:15.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.752+0000 7f7a2a7fc700 1 -- 172.21.15.112:0/4097417190 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a24057c00 con 0x7f7a3415bca0 2023-09-12T16:07:15.753 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-09-12T16:07:15.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.754+0000 7f7a3c1ff700 1 -- 172.21.15.112:0/4097417190 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7a1806a580 msgr2=0x7f7a1806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:15.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.754+0000 7f7a3c1ff700 1 --2- 172.21.15.112:0/4097417190 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7a1806a580 0x7f7a1806ca40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7a300098e0 tx=0x7f7a30019040 comp rx=0 tx=0).stop 2023-09-12T16:07:15.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.755+0000 7f7a3c1ff700 1 -- 172.21.15.112:0/4097417190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a3415bca0 msgr2=0x7f7a340c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:15.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.755+0000 7f7a3c1ff700 1 --2- 172.21.15.112:0/4097417190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a3415bca0 0x7f7a340c5300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400d950 tx=0x7f7a2400dc60 comp rx=0 tx=0).stop 2023-09-12T16:07:15.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.755+0000 7f7a3c1ff700 1 -- 172.21.15.112:0/4097417190 shutdown_connections 2023-09-12T16:07:15.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.755+0000 7f7a3c1ff700 1 --2- 172.21.15.112:0/4097417190 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7a1806a580 0x7f7a1806ca40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.755+0000 7f7a3c1ff700 1 --2- 172.21.15.112:0/4097417190 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a341570a0 0x7f7a3415f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.755+0000 7f7a3c1ff700 1 --2- 172.21.15.112:0/4097417190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a340cfdb0 0x7f7a3414a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.755+0000 7f7a3c1ff700 1 --2- 172.21.15.112:0/4097417190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a3415bca0 0x7f7a340c5300 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.755+0000 7f7a3c1ff700 1 -- 172.21.15.112:0/4097417190 >> 172.21.15.112:0/4097417190 conn(0x7f7a340d17d0 msgr2=0x7f7a340b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:15.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.755+0000 7f7a3c1ff700 1 -- 172.21.15.112:0/4097417190 shutdown_connections 2023-09-12T16:07:15.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.755+0000 7f7a3c1ff700 1 -- 172.21.15.112:0/4097417190 wait complete. 2023-09-12T16:07:15.773 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-12T16:07:15.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.976+0000 7fa5d1bff700 1 -- 172.21.15.112:0/3234617679 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5cc0cd5b0 msgr2=0x7fa5cc0cd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:15.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.976+0000 7fa5d1bff700 1 --2- 172.21.15.112:0/3234617679 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5cc0cd5b0 0x7fa5cc0cd9e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4009f60 tx=0x7fa5c4009f90 comp rx=0 tx=0).stop 2023-09-12T16:07:15.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.976+0000 7fa5d1bff700 1 -- 172.21.15.112:0/3234617679 shutdown_connections 2023-09-12T16:07:15.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.976+0000 7fa5d1bff700 1 --2- 172.21.15.112:0/3234617679 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5cc0cd5b0 0x7fa5cc0cd9e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.976+0000 7fa5d1bff700 1 --2- 172.21.15.112:0/3234617679 >> v2:172.21.15.144:3300/0 conn(0x7fa5cc15a7a0 0x7fa5cc15dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.976+0000 7fa5d1bff700 1 -- 172.21.15.112:0/3234617679 >> 172.21.15.112:0/3234617679 conn(0x7fa5cc06a200 msgr2=0x7fa5cc06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:15.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.976+0000 7fa5d1bff700 1 -- 172.21.15.112:0/3234617679 shutdown_connections 2023-09-12T16:07:15.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.976+0000 7fa5d1bff700 1 -- 172.21.15.112:0/3234617679 wait complete. 2023-09-12T16:07:15.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.979+0000 7fa5d1bff700 1 Processor -- start 2023-09-12T16:07:15.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.979+0000 7fa5d1bff700 1 -- start start 2023-09-12T16:07:15.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.980+0000 7fa5d1bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5cc0cd5b0 0x7fa5cc159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:15.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.980+0000 7fa5d1bff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5cc142ef0 0x7fa5cc0c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:15.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.980+0000 7fa5d1bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5cc15a7a0 0x7fa5cc0c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:15.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.980+0000 7fa5d1bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc1596b0 con 0x7fa5cc0cd5b0 2023-09-12T16:07:15.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.980+0000 7fa5d1bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc0cd0b0 con 0x7fa5cc15a7a0 2023-09-12T16:07:15.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.980+0000 7fa5d1bff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc0c8540 con 0x7fa5cc142ef0 2023-09-12T16:07:15.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.980+0000 7fa5cb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5cc0cd5b0 0x7fa5cc159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:15.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.980+0000 7fa5cb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5cc0cd5b0 0x7fa5cc159170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50072/0 (socket says 172.21.15.112:50072) 2023-09-12T16:07:15.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.980+0000 7fa5cb7fe700 1 -- 172.21.15.112:0/4214420216 learned_addr learned my addr 172.21.15.112:0/4214420216 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:15.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.980+0000 7fa5cbfff700 1 --2- 172.21.15.112:0/4214420216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5cc15a7a0 0x7fa5cc0c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:15.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.980+0000 7fa5caffd700 1 --2- 172.21.15.112:0/4214420216 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5cc142ef0 0x7fa5cc0c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:15.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.981+0000 7fa5cb7fe700 1 -- 172.21.15.112:0/4214420216 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5cc142ef0 msgr2=0x7fa5cc0c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:15.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.981+0000 7fa5cb7fe700 1 --2- 172.21.15.112:0/4214420216 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5cc142ef0 0x7fa5cc0c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.981+0000 7fa5cb7fe700 1 -- 172.21.15.112:0/4214420216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5cc15a7a0 msgr2=0x7fa5cc0c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:15.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.981+0000 7fa5cb7fe700 1 --2- 172.21.15.112:0/4214420216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5cc15a7a0 0x7fa5cc0c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:15.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.981+0000 7fa5cb7fe700 1 -- 172.21.15.112:0/4214420216 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c00095f0 con 0x7fa5cc0cd5b0 2023-09-12T16:07:15.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.981+0000 7fa5cb7fe700 1 --2- 172.21.15.112:0/4214420216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5cc0cd5b0 0x7fa5cc159170 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc00c4e0 tx=0x7fa5bc00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:15.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.981+0000 7fa5b3fff700 1 -- 172.21.15.112:0/4214420216 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc0052d0 con 0x7fa5cc0cd5b0 2023-09-12T16:07:15.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.981+0000 7fa5b3fff700 1 -- 172.21.15.112:0/4214420216 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa5bc005520 con 0x7fa5cc0cd5b0 2023-09-12T16:07:15.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.981+0000 7fa5b3fff700 1 -- 172.21.15.112:0/4214420216 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc0038e0 con 0x7fa5cc0cd5b0 2023-09-12T16:07:15.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.981+0000 7fa5d1bff700 1 -- 172.21.15.112:0/4214420216 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c4009c40 con 0x7fa5cc0cd5b0 2023-09-12T16:07:15.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.981+0000 7fa5d1bff700 1 -- 172.21.15.112:0/4214420216 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5cc0c8b00 con 0x7fa5cc0cd5b0 2023-09-12T16:07:15.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.982+0000 7fa5d1bff700 1 -- 172.21.15.112:0/4214420216 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5cc073ea0 con 0x7fa5cc0cd5b0 2023-09-12T16:07:15.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.983+0000 7fa5b3fff700 1 -- 172.21.15.112:0/4214420216 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fa5bc003a40 con 0x7fa5cc0cd5b0 2023-09-12T16:07:15.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.984+0000 7fa5b3fff700 1 --2- 172.21.15.112:0/4214420216 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa5b806a580 0x7fa5b806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:15.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.984+0000 7fa5b3fff700 1 -- 172.21.15.112:0/4214420216 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa5bc0883f0 con 0x7fa5cc0cd5b0 2023-09-12T16:07:15.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.984+0000 7fa5caffd700 1 --2- 172.21.15.112:0/4214420216 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa5b806a580 0x7fa5b806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:15.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.985+0000 7fa5caffd700 1 --2- 172.21.15.112:0/4214420216 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa5b806a580 0x7fa5b806ca40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0005fd0 tx=0x7fa5c0009310 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:15.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:15.989+0000 7fa5b3fff700 1 -- 172.21.15.112:0/4214420216 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fa5bc0535e0 con 0x7fa5cc0cd5b0 2023-09-12T16:07:16.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.185+0000 7fa5d1bff700 1 -- 172.21.15.112:0/4214420216 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa5cc071b30 con 0x7fa5cc0cd5b0 2023-09-12T16:07:16.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.185+0000 7fa5b3fff700 1 -- 172.21.15.112:0/4214420216 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa5bc056c00 con 0x7fa5cc0cd5b0 2023-09-12T16:07:16.186 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:07:16.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.188+0000 7fa5d1bff700 1 -- 172.21.15.112:0/4214420216 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa5b806a580 msgr2=0x7fa5b806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:16.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.188+0000 7fa5d1bff700 1 --2- 172.21.15.112:0/4214420216 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa5b806a580 0x7fa5b806ca40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0005fd0 tx=0x7fa5c0009310 comp rx=0 tx=0).stop 2023-09-12T16:07:16.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.188+0000 7fa5d1bff700 1 -- 172.21.15.112:0/4214420216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5cc0cd5b0 msgr2=0x7fa5cc159170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:16.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.188+0000 7fa5d1bff700 1 --2- 172.21.15.112:0/4214420216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5cc0cd5b0 0x7fa5cc159170 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc00c4e0 tx=0x7fa5bc00c7f0 comp rx=0 tx=0).stop 2023-09-12T16:07:16.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.188+0000 7fa5d1bff700 1 -- 172.21.15.112:0/4214420216 shutdown_connections 2023-09-12T16:07:16.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.188+0000 7fa5d1bff700 1 --2- 172.21.15.112:0/4214420216 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa5b806a580 0x7fa5b806ca40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:16.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.188+0000 7fa5d1bff700 1 --2- 172.21.15.112:0/4214420216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5cc15a7a0 0x7fa5cc0c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:16.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.188+0000 7fa5d1bff700 1 --2- 172.21.15.112:0/4214420216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5cc0cd5b0 0x7fa5cc159170 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:16.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.188+0000 7fa5d1bff700 1 --2- 172.21.15.112:0/4214420216 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5cc142ef0 0x7fa5cc0c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:16.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.188+0000 7fa5d1bff700 1 -- 172.21.15.112:0/4214420216 >> 172.21.15.112:0/4214420216 conn(0x7fa5cc06a200 msgr2=0x7fa5cc142090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:16.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.188+0000 7fa5d1bff700 1 -- 172.21.15.112:0/4214420216 shutdown_connections 2023-09-12T16:07:16.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.188+0000 7fa5d1bff700 1 -- 172.21.15.112:0/4214420216 wait complete. 2023-09-12T16:07:16.206 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-12T16:07:16.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.412+0000 7fc0c7fff700 1 -- 172.21.15.112:0/4004254352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0c015efd0 msgr2=0x7fc0c00d21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:16.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.412+0000 7fc0c7fff700 1 --2- 172.21.15.112:0/4004254352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0c015efd0 0x7fc0c00d21c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc005fd0 tx=0x7fc0bc009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:16.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.413+0000 7fc0c7fff700 1 -- 172.21.15.112:0/4004254352 shutdown_connections 2023-09-12T16:07:16.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.413+0000 7fc0c7fff700 1 --2- 172.21.15.112:0/4004254352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0c015efd0 0x7fc0c00d21c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:16.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.413+0000 7fc0c7fff700 1 -- 172.21.15.112:0/4004254352 >> 172.21.15.112:0/4004254352 conn(0x7fc0c009aa90 msgr2=0x7fc0c00d1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:16.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.413+0000 7fc0c7fff700 1 -- 172.21.15.112:0/4004254352 shutdown_connections 2023-09-12T16:07:16.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.413+0000 7fc0c7fff700 1 -- 172.21.15.112:0/4004254352 wait complete. 2023-09-12T16:07:16.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.414+0000 7fc0c7fff700 1 Processor -- start 2023-09-12T16:07:16.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.414+0000 7fc0c7fff700 1 -- start start 2023-09-12T16:07:16.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.415+0000 7fc0c7fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0c00b0a60 0x7fc0c0156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:16.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.415+0000 7fc0c7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0c00ce820 0x7fc0c00c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:16.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.415+0000 7fc0c7fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0c015efd0 0x7fc0c0155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:16.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.415+0000 7fc0c7fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00c8e50 con 0x7fc0c00ce820 2023-09-12T16:07:16.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.415+0000 7fc0c7fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00c90f0 con 0x7fc0c015efd0 2023-09-12T16:07:16.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.415+0000 7fc0c7fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00c93d0 con 0x7fc0c00b0a60 2023-09-12T16:07:16.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.416+0000 7fc0c559a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0c00ce820 0x7fc0c00c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:16.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.416+0000 7fc0c559a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0c00ce820 0x7fc0c00c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50102/0 (socket says 172.21.15.112:50102) 2023-09-12T16:07:16.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.416+0000 7fc0c559a700 1 -- 172.21.15.112:0/1560276004 learned_addr learned my addr 172.21.15.112:0/1560276004 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:16.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.416+0000 7fc0c5d9b700 1 --2- 172.21.15.112:0/1560276004 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0c00b0a60 0x7fc0c0156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:16.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.416+0000 7fc0c559a700 1 -- 172.21.15.112:0/1560276004 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0c00b0a60 msgr2=0x7fc0c0156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:16.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.416+0000 7fc0c559a700 1 --2- 172.21.15.112:0/1560276004 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0c00b0a60 0x7fc0c0156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:16.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.416+0000 7fc0c559a700 1 -- 172.21.15.112:0/1560276004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0c015efd0 msgr2=0x7fc0c0155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:16.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.416+0000 7fc0c659c700 1 --2- 172.21.15.112:0/1560276004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0c015efd0 0x7fc0c0155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:16.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.416+0000 7fc0c559a700 1 --2- 172.21.15.112:0/1560276004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0c015efd0 0x7fc0c0155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:16.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.416+0000 7fc0c559a700 1 -- 172.21.15.112:0/1560276004 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0bc0095f0 con 0x7fc0c00ce820 2023-09-12T16:07:16.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.416+0000 7fc0c659c700 1 --2- 172.21.15.112:0/1560276004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0c015efd0 0x7fc0c0155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:16.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.416+0000 7fc0c559a700 1 --2- 172.21.15.112:0/1560276004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0c00ce820 0x7fc0c00c8910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000c4e0 tx=0x7fc0b000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:16.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.416+0000 7fc0b67fc700 1 -- 172.21.15.112:0/1560276004 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b00052d0 con 0x7fc0c00ce820 2023-09-12T16:07:16.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.417+0000 7fc0b67fc700 1 -- 172.21.15.112:0/1560276004 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc0b0005520 con 0x7fc0c00ce820 2023-09-12T16:07:16.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.417+0000 7fc0c7fff700 1 -- 172.21.15.112:0/1560276004 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c00c96b0 con 0x7fc0c00ce820 2023-09-12T16:07:16.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.417+0000 7fc0b67fc700 1 -- 172.21.15.112:0/1560276004 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b00038e0 con 0x7fc0c00ce820 2023-09-12T16:07:16.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.417+0000 7fc0c7fff700 1 -- 172.21.15.112:0/1560276004 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c00c53f0 con 0x7fc0c00ce820 2023-09-12T16:07:16.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.418+0000 7fc0c7fff700 1 -- 172.21.15.112:0/1560276004 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c0073ea0 con 0x7fc0c00ce820 2023-09-12T16:07:16.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.419+0000 7fc0b67fc700 1 -- 172.21.15.112:0/1560276004 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fc0b0003a40 con 0x7fc0c00ce820 2023-09-12T16:07:16.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.420+0000 7fc0b67fc700 1 --2- 172.21.15.112:0/1560276004 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc0a406a580 0x7fc0a406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:16.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.420+0000 7fc0b67fc700 1 -- 172.21.15.112:0/1560276004 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc0b00884f0 con 0x7fc0c00ce820 2023-09-12T16:07:16.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.420+0000 7fc0c5d9b700 1 --2- 172.21.15.112:0/1560276004 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc0a406a580 0x7fc0a406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:16.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.421+0000 7fc0c5d9b700 1 --2- 172.21.15.112:0/1560276004 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc0a406a580 0x7fc0a406ca40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc0c00cb610 tx=0x7fc0bc011040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:16.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.425+0000 7fc0b67fc700 1 -- 172.21.15.112:0/1560276004 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fc0b0053780 con 0x7fc0c00ce820 2023-09-12T16:07:16.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.622+0000 7fc0c7fff700 1 -- 172.21.15.112:0/1560276004 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc0c00c55b0 con 0x7fc0c00ce820 2023-09-12T16:07:16.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.623+0000 7fc0b67fc700 1 -- 172.21.15.112:0/1560276004 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc0b0056da0 con 0x7fc0c00ce820 2023-09-12T16:07:16.623 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-09-12T16:07:16.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.625+0000 7fc0c7fff700 1 -- 172.21.15.112:0/1560276004 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc0a406a580 msgr2=0x7fc0a406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:16.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.625+0000 7fc0c7fff700 1 --2- 172.21.15.112:0/1560276004 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc0a406a580 0x7fc0a406ca40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc0c00cb610 tx=0x7fc0bc011040 comp rx=0 tx=0).stop 2023-09-12T16:07:16.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.625+0000 7fc0c7fff700 1 -- 172.21.15.112:0/1560276004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0c00ce820 msgr2=0x7fc0c00c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:16.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.625+0000 7fc0c7fff700 1 --2- 172.21.15.112:0/1560276004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0c00ce820 0x7fc0c00c8910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000c4e0 tx=0x7fc0b000c8a0 comp rx=0 tx=0).stop 2023-09-12T16:07:16.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.625+0000 7fc0c7fff700 1 -- 172.21.15.112:0/1560276004 shutdown_connections 2023-09-12T16:07:16.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.625+0000 7fc0c7fff700 1 --2- 172.21.15.112:0/1560276004 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc0a406a580 0x7fc0a406ca40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:16.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.625+0000 7fc0c7fff700 1 --2- 172.21.15.112:0/1560276004 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0c00b0a60 0x7fc0c0156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:16.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.625+0000 7fc0c7fff700 1 --2- 172.21.15.112:0/1560276004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0c015efd0 0x7fc0c0155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:16.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.625+0000 7fc0c7fff700 1 --2- 172.21.15.112:0/1560276004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0c00ce820 0x7fc0c00c8910 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:16.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.625+0000 7fc0c7fff700 1 -- 172.21.15.112:0/1560276004 >> 172.21.15.112:0/1560276004 conn(0x7fc0c009aa90 msgr2=0x7fc0c00b4690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:16.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.625+0000 7fc0c7fff700 1 -- 172.21.15.112:0/1560276004 shutdown_connections 2023-09-12T16:07:16.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.625+0000 7fc0c7fff700 1 -- 172.21.15.112:0/1560276004 wait complete. 2023-09-12T16:07:16.643 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-12T16:07:16.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.845+0000 7f2410bff700 1 -- 172.21.15.112:0/1773444174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f240c15bca0 msgr2=0x7f240c15cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:16.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.845+0000 7f2410bff700 1 --2- 172.21.15.112:0/1773444174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f240c15bca0 0x7f240c15cb90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0098c0 tx=0x7f23fc009bd0 comp rx=0 tx=0).stop 2023-09-12T16:07:16.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.845+0000 7f2410bff700 1 -- 172.21.15.112:0/1773444174 shutdown_connections 2023-09-12T16:07:16.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.845+0000 7f2410bff700 1 --2- 172.21.15.112:0/1773444174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f240c15bca0 0x7f240c15cb90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:16.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.845+0000 7f2410bff700 1 -- 172.21.15.112:0/1773444174 >> 172.21.15.112:0/1773444174 conn(0x7f240c0d17d0 msgr2=0x7f240c0d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:16.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.845+0000 7f2410bff700 1 -- 172.21.15.112:0/1773444174 shutdown_connections 2023-09-12T16:07:16.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.845+0000 7f2410bff700 1 -- 172.21.15.112:0/1773444174 wait complete. 2023-09-12T16:07:16.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.846+0000 7f2410bff700 1 Processor -- start 2023-09-12T16:07:16.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.847+0000 7f2410bff700 1 -- start start 2023-09-12T16:07:16.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.847+0000 7f2410bff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f240c0cfdb0 0x7f240c0c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:16.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.848+0000 7f2410bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f240c15bca0 0x7f240c147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:16.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.848+0000 7f2410bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f240c0c7af0 0x7f240c1453c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:16.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.848+0000 7f2410bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c0c5670 con 0x7f240c0c7af0 2023-09-12T16:07:16.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.848+0000 7f2410bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c0c4f40 con 0x7f240c15bca0 2023-09-12T16:07:16.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.848+0000 7f2410bff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240c1483a0 con 0x7f240c0cfdb0 2023-09-12T16:07:16.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.848+0000 7f240ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f240c0c7af0 0x7f240c1453c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:16.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.848+0000 7f240ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f240c0c7af0 0x7f240c1453c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50116/0 (socket says 172.21.15.112:50116) 2023-09-12T16:07:16.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.848+0000 7f240ad9d700 1 -- 172.21.15.112:0/2708790041 learned_addr learned my addr 172.21.15.112:0/2708790041 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:16.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.848+0000 7f240a59c700 1 --2- 172.21.15.112:0/2708790041 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f240c0cfdb0 0x7f240c0c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:16.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.848+0000 7f2403fff700 1 --2- 172.21.15.112:0/2708790041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f240c15bca0 0x7f240c147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:16.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.848+0000 7f240ad9d700 1 -- 172.21.15.112:0/2708790041 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f240c0cfdb0 msgr2=0x7f240c0c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:16.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.848+0000 7f240ad9d700 1 --2- 172.21.15.112:0/2708790041 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f240c0cfdb0 0x7f240c0c4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:16.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.848+0000 7f240ad9d700 1 -- 172.21.15.112:0/2708790041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f240c15bca0 msgr2=0x7f240c147e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:16.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.848+0000 7f240ad9d700 1 --2- 172.21.15.112:0/2708790041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f240c15bca0 0x7f240c147e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:16.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.848+0000 7f240ad9d700 1 -- 172.21.15.112:0/2708790041 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc009520 con 0x7f240c0c7af0 2023-09-12T16:07:16.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.848+0000 7f2403fff700 1 --2- 172.21.15.112:0/2708790041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f240c15bca0 0x7f240c147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:07:16.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.849+0000 7f240ad9d700 1 --2- 172.21.15.112:0/2708790041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f240c0c7af0 0x7f240c1453c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f240400cbc0 tx=0x7f240400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:16.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.849+0000 7f2402ffd700 1 -- 172.21.15.112:0/2708790041 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240400ab00 con 0x7f240c0c7af0 2023-09-12T16:07:16.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.849+0000 7f2402ffd700 1 -- 172.21.15.112:0/2708790041 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f240400ad50 con 0x7f240c0c7af0 2023-09-12T16:07:16.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.849+0000 7f2410bff700 1 -- 172.21.15.112:0/2708790041 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240c0c7fe0 con 0x7f240c0c7af0 2023-09-12T16:07:16.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.849+0000 7f2402ffd700 1 -- 172.21.15.112:0/2708790041 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2404012680 con 0x7f240c0c7af0 2023-09-12T16:07:16.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.849+0000 7f2410bff700 1 -- 172.21.15.112:0/2708790041 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240c0b29d0 con 0x7f240c0c7af0 2023-09-12T16:07:16.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.850+0000 7f2410bff700 1 -- 172.21.15.112:0/2708790041 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f240c073ea0 con 0x7f240c0c7af0 2023-09-12T16:07:16.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.851+0000 7f2402ffd700 1 -- 172.21.15.112:0/2708790041 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f240401a3b0 con 0x7f240c0c7af0 2023-09-12T16:07:16.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.852+0000 7f2402ffd700 1 --2- 172.21.15.112:0/2708790041 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f23ec06a580 0x7f23ec06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:16.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.852+0000 7f2402ffd700 1 -- 172.21.15.112:0/2708790041 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2404089420 con 0x7f240c0c7af0 2023-09-12T16:07:16.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.852+0000 7f240a59c700 1 --2- 172.21.15.112:0/2708790041 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f23ec06a580 0x7f23ec06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:16.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.853+0000 7f240a59c700 1 --2- 172.21.15.112:0/2708790041 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f23ec06a580 0x7f23ec06ca40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f23fc000c00 tx=0x7f23fc011040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:16.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:16.856+0000 7f2402ffd700 1 -- 172.21.15.112:0/2708790041 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f2404054610 con 0x7f240c0c7af0 2023-09-12T16:07:17.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.054+0000 7f2410bff700 1 -- 172.21.15.112:0/2708790041 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f240c0ce450 con 0x7f240c0c7af0 2023-09-12T16:07:17.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.054+0000 7f2402ffd700 1 -- 172.21.15.112:0/2708790041 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2404057c30 con 0x7f240c0c7af0 2023-09-12T16:07:17.056 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:07:17.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.056+0000 7f2410bff700 1 -- 172.21.15.112:0/2708790041 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f23ec06a580 msgr2=0x7f23ec06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:17.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.056+0000 7f2410bff700 1 --2- 172.21.15.112:0/2708790041 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f23ec06a580 0x7f23ec06ca40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f23fc000c00 tx=0x7f23fc011040 comp rx=0 tx=0).stop 2023-09-12T16:07:17.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.056+0000 7f2410bff700 1 -- 172.21.15.112:0/2708790041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f240c0c7af0 msgr2=0x7f240c1453c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:17.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.056+0000 7f2410bff700 1 --2- 172.21.15.112:0/2708790041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f240c0c7af0 0x7f240c1453c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f240400cbc0 tx=0x7f240400ced0 comp rx=0 tx=0).stop 2023-09-12T16:07:17.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.056+0000 7f2410bff700 1 -- 172.21.15.112:0/2708790041 shutdown_connections 2023-09-12T16:07:17.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.056+0000 7f2410bff700 1 --2- 172.21.15.112:0/2708790041 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f23ec06a580 0x7f23ec06ca40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:17.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.056+0000 7f2410bff700 1 --2- 172.21.15.112:0/2708790041 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f240c0cfdb0 0x7f240c0c4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:17.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.056+0000 7f2410bff700 1 --2- 172.21.15.112:0/2708790041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f240c0c7af0 0x7f240c1453c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:17.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.056+0000 7f2410bff700 1 --2- 172.21.15.112:0/2708790041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f240c15bca0 0x7f240c147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:17.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.056+0000 7f2410bff700 1 -- 172.21.15.112:0/2708790041 >> 172.21.15.112:0/2708790041 conn(0x7f240c0d17d0 msgr2=0x7f240c0af080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:17.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.057+0000 7f2410bff700 1 -- 172.21.15.112:0/2708790041 shutdown_connections 2023-09-12T16:07:17.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.057+0000 7f2410bff700 1 -- 172.21.15.112:0/2708790041 wait complete. 2023-09-12T16:07:17.075 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-12T16:07:17.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.275+0000 7f17f4dff700 1 -- 172.21.15.112:0/3193932754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f015b8b0 msgr2=0x7f17f00aefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:17.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.275+0000 7f17f4dff700 1 --2- 172.21.15.112:0/3193932754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f015b8b0 0x7f17f00aefd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f17f00ac1b0 tx=0x7f17e0009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:17.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.275+0000 7f17f4dff700 1 -- 172.21.15.112:0/3193932754 shutdown_connections 2023-09-12T16:07:17.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.275+0000 7f17f4dff700 1 --2- 172.21.15.112:0/3193932754 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17f00b22a0 0x7f17f015bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:17.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.275+0000 7f17f4dff700 1 --2- 172.21.15.112:0/3193932754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f015b8b0 0x7f17f00aefd0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:17.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.275+0000 7f17f4dff700 1 --2- 172.21.15.112:0/3193932754 >> v2:172.21.15.144:3300/0 conn(0x7f17f00af510 0x7f17f00b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:17.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.275+0000 7f17f4dff700 1 -- 172.21.15.112:0/3193932754 >> 172.21.15.112:0/3193932754 conn(0x7f17f0065fd0 msgr2=0x7f17f006a020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:17.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.275+0000 7f17f4dff700 1 -- 172.21.15.112:0/3193932754 shutdown_connections 2023-09-12T16:07:17.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.275+0000 7f17f4dff700 1 -- 172.21.15.112:0/3193932754 wait complete. 2023-09-12T16:07:17.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.276+0000 7f17f4dff700 1 Processor -- start 2023-09-12T16:07:17.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.277+0000 7f17f4dff700 1 -- start start 2023-09-12T16:07:17.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.278+0000 7f17f4dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f00af510 0x7f17f014dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:17.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.278+0000 7f17f4dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17f00b22a0 0x7f17f01595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:17.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.278+0000 7f17f4dff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17f015b8b0 0x7f17f0151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:17.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.278+0000 7f17f4dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f0157d90 con 0x7f17f00af510 2023-09-12T16:07:17.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.278+0000 7f17f4dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f0158070 con 0x7f17f00b22a0 2023-09-12T16:07:17.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.278+0000 7f17f4dff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f0158350 con 0x7f17f015b8b0 2023-09-12T16:07:17.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.278+0000 7f17ee59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f00af510 0x7f17f014dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:17.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.278+0000 7f17ee59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f00af510 0x7f17f014dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50130/0 (socket says 172.21.15.112:50130) 2023-09-12T16:07:17.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.278+0000 7f17ee59c700 1 -- 172.21.15.112:0/738264640 learned_addr learned my addr 172.21.15.112:0/738264640 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:17.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.278+0000 7f17e7fff700 1 --2- 172.21.15.112:0/738264640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17f00b22a0 0x7f17f01595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:17.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.278+0000 7f17eed9d700 1 --2- 172.21.15.112:0/738264640 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17f015b8b0 0x7f17f0151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:17.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.278+0000 7f17ee59c700 1 -- 172.21.15.112:0/738264640 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17f015b8b0 msgr2=0x7f17f0151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:17.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.278+0000 7f17ee59c700 1 --2- 172.21.15.112:0/738264640 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17f015b8b0 0x7f17f0151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:17.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.278+0000 7f17ee59c700 1 -- 172.21.15.112:0/738264640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17f00b22a0 msgr2=0x7f17f01595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:17.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.278+0000 7f17ee59c700 1 --2- 172.21.15.112:0/738264640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17f00b22a0 0x7f17f01595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:17.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.278+0000 7f17ee59c700 1 -- 172.21.15.112:0/738264640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e00095f0 con 0x7f17f00af510 2023-09-12T16:07:17.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.278+0000 7f17eed9d700 1 --2- 172.21.15.112:0/738264640 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17f015b8b0 0x7f17f0151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:17.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.278+0000 7f17e7fff700 1 --2- 172.21.15.112:0/738264640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17f00b22a0 0x7f17f01595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:07:17.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.278+0000 7f17ee59c700 1 --2- 172.21.15.112:0/738264640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f00af510 0x7f17f014dab0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f17f00afbd0 tx=0x7f17e0009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:17.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.279+0000 7f17e6ffd700 1 -- 172.21.15.112:0/738264640 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e001c070 con 0x7f17f00af510 2023-09-12T16:07:17.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.279+0000 7f17e6ffd700 1 -- 172.21.15.112:0/738264640 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f17e0003e50 con 0x7f17f00af510 2023-09-12T16:07:17.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.279+0000 7f17f4dff700 1 -- 172.21.15.112:0/738264640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f0158630 con 0x7f17f00af510 2023-09-12T16:07:17.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.279+0000 7f17e6ffd700 1 -- 172.21.15.112:0/738264640 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e000b9f0 con 0x7f17f00af510 2023-09-12T16:07:17.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.279+0000 7f17f4dff700 1 -- 172.21.15.112:0/738264640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f014e340 con 0x7f17f00af510 2023-09-12T16:07:17.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.280+0000 7f17f4dff700 1 -- 172.21.15.112:0/738264640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f0158840 con 0x7f17f00af510 2023-09-12T16:07:17.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.281+0000 7f17e6ffd700 1 -- 172.21.15.112:0/738264640 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f17e000bb50 con 0x7f17f00af510 2023-09-12T16:07:17.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.282+0000 7f17e6ffd700 1 --2- 172.21.15.112:0/738264640 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f17d006a580 0x7f17d006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:17.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.282+0000 7f17e6ffd700 1 -- 172.21.15.112:0/738264640 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f17e008a220 con 0x7f17f00af510 2023-09-12T16:07:17.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.282+0000 7f17e7fff700 1 --2- 172.21.15.112:0/738264640 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f17d006a580 0x7f17d006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:17.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.282+0000 7f17e7fff700 1 --2- 172.21.15.112:0/738264640 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f17d006a580 0x7f17d006ca40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f17f014e5b0 tx=0x7f17d8009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:17.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.286+0000 7f17e6ffd700 1 -- 172.21.15.112:0/738264640 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f17f0158840 con 0x7f17f00af510 2023-09-12T16:07:17.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.500+0000 7f17f4dff700 1 -- 172.21.15.112:0/738264640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f17f0073ea0 con 0x7f17f00af510 2023-09-12T16:07:17.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.501+0000 7f17e6ffd700 1 -- 172.21.15.112:0/738264640 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f17e00554a0 con 0x7f17f00af510 2023-09-12T16:07:17.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.503+0000 7f17f4dff700 1 -- 172.21.15.112:0/738264640 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f17d006a580 msgr2=0x7f17d006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:17.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.503+0000 7f17f4dff700 1 --2- 172.21.15.112:0/738264640 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f17d006a580 0x7f17d006ca40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f17f014e5b0 tx=0x7f17d8009260 comp rx=0 tx=0).stop 2023-09-12T16:07:17.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.503+0000 7f17f4dff700 1 -- 172.21.15.112:0/738264640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f00af510 msgr2=0x7f17f014dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:17.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.503+0000 7f17f4dff700 1 --2- 172.21.15.112:0/738264640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f00af510 0x7f17f014dab0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f17f00afbd0 tx=0x7f17e0009570 comp rx=0 tx=0).stop 2023-09-12T16:07:17.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.503+0000 7f17f4dff700 1 -- 172.21.15.112:0/738264640 shutdown_connections 2023-09-12T16:07:17.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.503+0000 7f17f4dff700 1 --2- 172.21.15.112:0/738264640 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f17d006a580 0x7f17d006ca40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:17.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.503+0000 7f17f4dff700 1 --2- 172.21.15.112:0/738264640 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17f015b8b0 0x7f17f0151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:17.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.503+0000 7f17f4dff700 1 --2- 172.21.15.112:0/738264640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f00af510 0x7f17f014dab0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:17.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.503+0000 7f17f4dff700 1 --2- 172.21.15.112:0/738264640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17f00b22a0 0x7f17f01595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:17.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.503+0000 7f17f4dff700 1 -- 172.21.15.112:0/738264640 >> 172.21.15.112:0/738264640 conn(0x7f17f0065fd0 msgr2=0x7f17f0150590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:17.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.503+0000 7f17f4dff700 1 -- 172.21.15.112:0/738264640 shutdown_connections 2023-09-12T16:07:17.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.503+0000 7f17f4dff700 1 -- 172.21.15.112:0/738264640 wait complete. 2023-09-12T16:07:17.507 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2023-09-12T16:07:17.522 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi112.front.sepia.ceph.com... 2023-09-12T16:07:17.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:17.523 DEBUG:teuthology.orchestra.run.smithi112:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-09-12T16:07:17.589 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi112.stderr:ceph-fuse[123790]: fuse finished with error 0 and tester_r 0 2023-09-12T16:07:17.593 INFO:teuthology.orchestra.run:waiting for 300 2023-09-12T16:07:17.692 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-09-12T16:07:17.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:17.693 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-09-12T16:07:17.753 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:07:17.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.952+0000 7f9ad1fff700 1 -- 172.21.15.112:0/1589446060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9acc159e10 msgr2=0x7f9acc06a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:17.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.952+0000 7f9ad1fff700 1 --2- 172.21.15.112:0/1589446060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9acc159e10 0x7f9acc06a020 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9abc005fd0 tx=0x7f9abc009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:17.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.952+0000 7f9ad1fff700 1 -- 172.21.15.112:0/1589446060 shutdown_connections 2023-09-12T16:07:17.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.952+0000 7f9ad1fff700 1 --2- 172.21.15.112:0/1589446060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9acc159e10 0x7f9acc06a020 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:17.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.952+0000 7f9ad1fff700 1 --2- 172.21.15.112:0/1589446060 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9acc06a560 0x7f9acc0b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:17.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.952+0000 7f9ad1fff700 1 -- 172.21.15.112:0/1589446060 >> 172.21.15.112:0/1589446060 conn(0x7f9acc06b760 msgr2=0x7f9acc06d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:17.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.952+0000 7f9ad1fff700 1 -- 172.21.15.112:0/1589446060 shutdown_connections 2023-09-12T16:07:17.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.952+0000 7f9ad1fff700 1 -- 172.21.15.112:0/1589446060 wait complete. 2023-09-12T16:07:17.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.954+0000 7f9ad1fff700 1 Processor -- start 2023-09-12T16:07:17.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.954+0000 7f9ad1fff700 1 -- start start 2023-09-12T16:07:17.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.955+0000 7f9ad1fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9acc06a560 0x7f9acc15acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:17.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.955+0000 7f9ad1fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9acc0b0820 0x7f9acc1f0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:17.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.955+0000 7f9ad1fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9acc159e10 0x7f9acc1f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:17.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.955+0000 7f9ad1fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc1f3480 con 0x7f9acc0b0820 2023-09-12T16:07:17.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.955+0000 7f9ad1fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc15b5b0 con 0x7f9acc06a560 2023-09-12T16:07:17.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.955+0000 7f9ad1fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc15b2d0 con 0x7f9acc159e10 2023-09-12T16:07:17.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.955+0000 7f9ac3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9acc0b0820 0x7f9acc1f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:17.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.955+0000 7f9ac3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9acc0b0820 0x7f9acc1f0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50138/0 (socket says 172.21.15.112:50138) 2023-09-12T16:07:17.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.955+0000 7f9ac3fff700 1 -- 172.21.15.112:0/2123193164 learned_addr learned my addr 172.21.15.112:0/2123193164 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:17.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.955+0000 7f9acb7fe700 1 --2- 172.21.15.112:0/2123193164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9acc06a560 0x7f9acc15acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:17.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.955+0000 7f9acbfff700 1 --2- 172.21.15.112:0/2123193164 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9acc159e10 0x7f9acc1f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:17.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.956+0000 7f9ac3fff700 1 -- 172.21.15.112:0/2123193164 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9acc159e10 msgr2=0x7f9acc1f2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:17.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.956+0000 7f9ac3fff700 1 --2- 172.21.15.112:0/2123193164 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9acc159e10 0x7f9acc1f2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:17.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.956+0000 7f9ac3fff700 1 -- 172.21.15.112:0/2123193164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9acc06a560 msgr2=0x7f9acc15acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:17.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.956+0000 7f9ac3fff700 1 --2- 172.21.15.112:0/2123193164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9acc06a560 0x7f9acc15acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:17.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.956+0000 7f9ac3fff700 1 -- 172.21.15.112:0/2123193164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc0095f0 con 0x7f9acc0b0820 2023-09-12T16:07:17.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.956+0000 7f9acbfff700 1 --2- 172.21.15.112:0/2123193164 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9acc159e10 0x7f9acc1f2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:17.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.956+0000 7f9acb7fe700 1 --2- 172.21.15.112:0/2123193164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9acc06a560 0x7f9acc15acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:07:17.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.956+0000 7f9ac3fff700 1 --2- 172.21.15.112:0/2123193164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9acc0b0820 0x7f9acc1f0100 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400e9a0 tx=0x7f9ab400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:17.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.956+0000 7f9ac8ff9700 1 -- 172.21.15.112:0/2123193164 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4009790 con 0x7f9acc0b0820 2023-09-12T16:07:17.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.956+0000 7f9ac8ff9700 1 -- 172.21.15.112:0/2123193164 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9ab400ccc0 con 0x7f9acc0b0820 2023-09-12T16:07:17.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.956+0000 7f9ad1fff700 1 -- 172.21.15.112:0/2123193164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9acc0c57a0 con 0x7f9acc0b0820 2023-09-12T16:07:17.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.956+0000 7f9ac8ff9700 1 -- 172.21.15.112:0/2123193164 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4010690 con 0x7f9acc0b0820 2023-09-12T16:07:17.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.956+0000 7f9ad1fff700 1 -- 172.21.15.112:0/2123193164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9acc0c5d60 con 0x7f9acc0b0820 2023-09-12T16:07:17.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.957+0000 7f9ad1fff700 1 -- 172.21.15.112:0/2123193164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9acc06ddb0 con 0x7f9acc0b0820 2023-09-12T16:07:17.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.958+0000 7f9ac8ff9700 1 -- 172.21.15.112:0/2123193164 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f9ab40107f0 con 0x7f9acc0b0820 2023-09-12T16:07:17.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.959+0000 7f9ac8ff9700 1 --2- 172.21.15.112:0/2123193164 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9aac06a580 0x7f9aac06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:17.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.959+0000 7f9ac8ff9700 1 -- 172.21.15.112:0/2123193164 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9ab4014070 con 0x7f9acc0b0820 2023-09-12T16:07:17.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.959+0000 7f9acb7fe700 1 --2- 172.21.15.112:0/2123193164 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9aac06a580 0x7f9aac06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:17.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.960+0000 7f9acb7fe700 1 --2- 172.21.15.112:0/2123193164 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9aac06a580 0x7f9aac06ca40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0098e0 tx=0x7f9abc011040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:17.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:17.963+0000 7f9ac8ff9700 1 -- 172.21.15.112:0/2123193164 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f9ab40519b0 con 0x7f9acc0b0820 2023-09-12T16:07:18.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.162+0000 7f9ad1fff700 1 -- 172.21.15.112:0/2123193164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9acc0c5ef0 con 0x7f9acc0b0820 2023-09-12T16:07:18.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.164+0000 7f9ac8ff9700 1 -- 172.21.15.112:0/2123193164 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f9ab4058520 con 0x7f9acc0b0820 2023-09-12T16:07:18.165 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:18.165 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:04.748402+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:07:18.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.166+0000 7f9ad1fff700 1 -- 172.21.15.112:0/2123193164 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9aac06a580 msgr2=0x7f9aac06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:18.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.166+0000 7f9ad1fff700 1 --2- 172.21.15.112:0/2123193164 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9aac06a580 0x7f9aac06ca40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0098e0 tx=0x7f9abc011040 comp rx=0 tx=0).stop 2023-09-12T16:07:18.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.166+0000 7f9ad1fff700 1 -- 172.21.15.112:0/2123193164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9acc0b0820 msgr2=0x7f9acc1f0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:18.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.166+0000 7f9ad1fff700 1 --2- 172.21.15.112:0/2123193164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9acc0b0820 0x7f9acc1f0100 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400e9a0 tx=0x7f9ab400ed60 comp rx=0 tx=0).stop 2023-09-12T16:07:18.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.166+0000 7f9ad1fff700 1 -- 172.21.15.112:0/2123193164 shutdown_connections 2023-09-12T16:07:18.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.166+0000 7f9ad1fff700 1 --2- 172.21.15.112:0/2123193164 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9aac06a580 0x7f9aac06ca40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:18.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.166+0000 7f9ad1fff700 1 --2- 172.21.15.112:0/2123193164 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9acc159e10 0x7f9acc1f2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:18.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.166+0000 7f9ad1fff700 1 --2- 172.21.15.112:0/2123193164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9acc06a560 0x7f9acc15acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:18.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.166+0000 7f9ad1fff700 1 --2- 172.21.15.112:0/2123193164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9acc0b0820 0x7f9acc1f0100 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:18.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.166+0000 7f9ad1fff700 1 -- 172.21.15.112:0/2123193164 >> 172.21.15.112:0/2123193164 conn(0x7f9acc06b760 msgr2=0x7f9acc158740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:18.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.166+0000 7f9ad1fff700 1 -- 172.21.15.112:0/2123193164 shutdown_connections 2023-09-12T16:07:18.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.166+0000 7f9ad1fff700 1 -- 172.21.15.112:0/2123193164 wait complete. 2023-09-12T16:07:18.186 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:07:18.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.384+0000 7f1d57fff700 1 -- 172.21.15.112:0/3849491639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d500b3a60 msgr2=0x7f1d500b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:18.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.384+0000 7f1d57fff700 1 --2- 172.21.15.112:0/3849491639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d500b3a60 0x7f1d500b5330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1d5008b9a0 tx=0x7f1d4800b330 comp rx=0 tx=0).stop 2023-09-12T16:07:18.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.384+0000 7f1d57fff700 1 -- 172.21.15.112:0/3849491639 shutdown_connections 2023-09-12T16:07:18.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.384+0000 7f1d57fff700 1 --2- 172.21.15.112:0/3849491639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d500b3a60 0x7f1d500b5330 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:18.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.384+0000 7f1d57fff700 1 --2- 172.21.15.112:0/3849491639 >> v2:172.21.15.144:3300/0 conn(0x7f1d5015f0d0 0x7f1d500cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:18.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.384+0000 7f1d57fff700 1 -- 172.21.15.112:0/3849491639 >> 172.21.15.112:0/3849491639 conn(0x7f1d5009abe0 msgr2=0x7f1d500d18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:18.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.384+0000 7f1d57fff700 1 -- 172.21.15.112:0/3849491639 shutdown_connections 2023-09-12T16:07:18.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.384+0000 7f1d57fff700 1 -- 172.21.15.112:0/3849491639 wait complete. 2023-09-12T16:07:18.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.386+0000 7f1d57fff700 1 Processor -- start 2023-09-12T16:07:18.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.386+0000 7f1d57fff700 1 -- start start 2023-09-12T16:07:18.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.387+0000 7f1d57fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d500b3a60 0x7f1d500c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:18.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.387+0000 7f1d57fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d500d21f0 0x7f1d500cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:18.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.387+0000 7f1d57fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d5015f0d0 0x7f1d501f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:18.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.387+0000 7f1d57fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5009d1e0 con 0x7f1d5015f0d0 2023-09-12T16:07:18.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.387+0000 7f1d57fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5009c370 con 0x7f1d500d21f0 2023-09-12T16:07:18.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.387+0000 7f1d57fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5009c610 con 0x7f1d500b3a60 2023-09-12T16:07:18.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.387+0000 7f1d5659c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d5015f0d0 0x7f1d501f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:18.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.387+0000 7f1d5659c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d5015f0d0 0x7f1d501f50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50160/0 (socket says 172.21.15.112:50160) 2023-09-12T16:07:18.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.387+0000 7f1d5659c700 1 -- 172.21.15.112:0/3570129063 learned_addr learned my addr 172.21.15.112:0/3570129063 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:18.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.387+0000 7f1d55d9b700 1 --2- 172.21.15.112:0/3570129063 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d500b3a60 0x7f1d500c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:18.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.387+0000 7f1d5559a700 1 --2- 172.21.15.112:0/3570129063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d500d21f0 0x7f1d500cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:18.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.388+0000 7f1d5659c700 1 -- 172.21.15.112:0/3570129063 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d500b3a60 msgr2=0x7f1d500c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:18.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.388+0000 7f1d5659c700 1 --2- 172.21.15.112:0/3570129063 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d500b3a60 0x7f1d500c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:18.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.388+0000 7f1d5659c700 1 -- 172.21.15.112:0/3570129063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d500d21f0 msgr2=0x7f1d500cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:18.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.388+0000 7f1d5659c700 1 --2- 172.21.15.112:0/3570129063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d500d21f0 0x7f1d500cb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:18.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.388+0000 7f1d5659c700 1 -- 172.21.15.112:0/3570129063 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d48009c40 con 0x7f1d5015f0d0 2023-09-12T16:07:18.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.388+0000 7f1d5659c700 1 --2- 172.21.15.112:0/3570129063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d5015f0d0 0x7f1d501f50d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800b730 tx=0x7f1d48007aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:18.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.388+0000 7f1d467fc700 1 -- 172.21.15.112:0/3570129063 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4800e040 con 0x7f1d5015f0d0 2023-09-12T16:07:18.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.388+0000 7f1d467fc700 1 -- 172.21.15.112:0/3570129063 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1d4800be90 con 0x7f1d5015f0d0 2023-09-12T16:07:18.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.388+0000 7f1d467fc700 1 -- 172.21.15.112:0/3570129063 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4801d8e0 con 0x7f1d5015f0d0 2023-09-12T16:07:18.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.388+0000 7f1d57fff700 1 -- 172.21.15.112:0/3570129063 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d500c8040 con 0x7f1d5015f0d0 2023-09-12T16:07:18.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.388+0000 7f1d57fff700 1 -- 172.21.15.112:0/3570129063 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d5009c8b0 con 0x7f1d5015f0d0 2023-09-12T16:07:18.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.389+0000 7f1d57fff700 1 -- 172.21.15.112:0/3570129063 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d5009d350 con 0x7f1d5015f0d0 2023-09-12T16:07:18.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.390+0000 7f1d467fc700 1 -- 172.21.15.112:0/3570129063 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f1d4801da40 con 0x7f1d5015f0d0 2023-09-12T16:07:18.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.391+0000 7f1d467fc700 1 --2- 172.21.15.112:0/3570129063 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f1d3406a580 0x7f1d3406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:18.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.391+0000 7f1d467fc700 1 -- 172.21.15.112:0/3570129063 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1d4808ac80 con 0x7f1d5015f0d0 2023-09-12T16:07:18.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.391+0000 7f1d55d9b700 1 --2- 172.21.15.112:0/3570129063 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f1d3406a580 0x7f1d3406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:18.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.392+0000 7f1d55d9b700 1 --2- 172.21.15.112:0/3570129063 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f1d3406a580 0x7f1d3406ca40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c005fd0 tx=0x7f1d4c00b3c0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:18.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.396+0000 7f1d467fc700 1 -- 172.21.15.112:0/3570129063 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f1d48055f00 con 0x7f1d5015f0d0 2023-09-12T16:07:18.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.591+0000 7f1d57fff700 1 -- 172.21.15.112:0/3570129063 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d5004e300 con 0x7f1d5015f0d0 2023-09-12T16:07:18.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.593+0000 7f1d467fc700 1 -- 172.21.15.112:0/3570129063 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f1d48021020 con 0x7f1d5015f0d0 2023-09-12T16:07:18.594 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:18.594 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:04.748402+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:07:18.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.595+0000 7f1d57fff700 1 -- 172.21.15.112:0/3570129063 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f1d3406a580 msgr2=0x7f1d3406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:18.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.595+0000 7f1d57fff700 1 --2- 172.21.15.112:0/3570129063 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f1d3406a580 0x7f1d3406ca40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c005fd0 tx=0x7f1d4c00b3c0 comp rx=0 tx=0).stop 2023-09-12T16:07:18.597 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.595+0000 7f1d57fff700 1 -- 172.21.15.112:0/3570129063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d5015f0d0 msgr2=0x7f1d501f50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:18.597 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.595+0000 7f1d57fff700 1 --2- 172.21.15.112:0/3570129063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d5015f0d0 0x7f1d501f50d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800b730 tx=0x7f1d48007aa0 comp rx=0 tx=0).stop 2023-09-12T16:07:18.597 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.595+0000 7f1d57fff700 1 -- 172.21.15.112:0/3570129063 shutdown_connections 2023-09-12T16:07:18.597 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.595+0000 7f1d57fff700 1 --2- 172.21.15.112:0/3570129063 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f1d3406a580 0x7f1d3406ca40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:18.597 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.595+0000 7f1d57fff700 1 --2- 172.21.15.112:0/3570129063 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d500b3a60 0x7f1d500c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:18.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.595+0000 7f1d57fff700 1 --2- 172.21.15.112:0/3570129063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d5015f0d0 0x7f1d501f50d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:18.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.595+0000 7f1d57fff700 1 --2- 172.21.15.112:0/3570129063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d500d21f0 0x7f1d500cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:18.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.595+0000 7f1d57fff700 1 -- 172.21.15.112:0/3570129063 >> 172.21.15.112:0/3570129063 conn(0x7f1d5009abe0 msgr2=0x7f1d500cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:18.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.595+0000 7f1d57fff700 1 -- 172.21.15.112:0/3570129063 shutdown_connections 2023-09-12T16:07:18.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.595+0000 7f1d57fff700 1 -- 172.21.15.112:0/3570129063 wait complete. 2023-09-12T16:07:18.614 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-12T16:07:18.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.815+0000 7f6d103ff700 1 -- 172.21.15.112:0/2234746023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d08143080 msgr2=0x7f6d080c9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:18.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.815+0000 7f6d103ff700 1 --2- 172.21.15.112:0/2234746023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d08143080 0x7f6d080c9d60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6d08070f70 tx=0x7f6cf8009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:18.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.815+0000 7f6d103ff700 1 -- 172.21.15.112:0/2234746023 shutdown_connections 2023-09-12T16:07:18.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.815+0000 7f6d103ff700 1 --2- 172.21.15.112:0/2234746023 >> v2:172.21.15.144:3300/0 conn(0x7f6d080ca2a0 0x7f6d080cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:18.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.815+0000 7f6d103ff700 1 --2- 172.21.15.112:0/2234746023 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d08142ca0 0x7f6d0815dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:18.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.815+0000 7f6d103ff700 1 --2- 172.21.15.112:0/2234746023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d08143080 0x7f6d080c9d60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:18.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.815+0000 7f6d103ff700 1 -- 172.21.15.112:0/2234746023 >> 172.21.15.112:0/2234746023 conn(0x7f6d0806a200 msgr2=0x7f6d0806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:18.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.815+0000 7f6d103ff700 1 -- 172.21.15.112:0/2234746023 shutdown_connections 2023-09-12T16:07:18.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.815+0000 7f6d103ff700 1 -- 172.21.15.112:0/2234746023 wait complete. 2023-09-12T16:07:18.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.817+0000 7f6d103ff700 1 Processor -- start 2023-09-12T16:07:18.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.817+0000 7f6d103ff700 1 -- start start 2023-09-12T16:07:18.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.818+0000 7f6d103ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d080ca2a0 0x7f6d0813bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:18.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.818+0000 7f6d103ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d08142ca0 0x7f6d0813cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:18.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.818+0000 7f6d103ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d08143080 0x7f6d080b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:18.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.818+0000 7f6d103ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0813afa0 con 0x7f6d080ca2a0 2023-09-12T16:07:18.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.818+0000 7f6d103ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0813b280 con 0x7f6d08142ca0 2023-09-12T16:07:18.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.818+0000 7f6d103ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0813b560 con 0x7f6d08143080 2023-09-12T16:07:18.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.818+0000 7f6d0e19b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d080ca2a0 0x7f6d0813bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:18.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.818+0000 7f6d0e19b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d080ca2a0 0x7f6d0813bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50182/0 (socket says 172.21.15.112:50182) 2023-09-12T16:07:18.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.818+0000 7f6d0e19b700 1 -- 172.21.15.112:0/428105594 learned_addr learned my addr 172.21.15.112:0/428105594 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:18.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.818+0000 7f6d0d99a700 1 --2- 172.21.15.112:0/428105594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d08142ca0 0x7f6d0813cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:18.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.818+0000 7f6d0e99c700 1 --2- 172.21.15.112:0/428105594 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d08143080 0x7f6d080b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:18.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.818+0000 7f6d0e19b700 1 -- 172.21.15.112:0/428105594 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d08143080 msgr2=0x7f6d080b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:18.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.819+0000 7f6d0e19b700 1 --2- 172.21.15.112:0/428105594 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d08143080 0x7f6d080b1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:18.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.819+0000 7f6d0e19b700 1 -- 172.21.15.112:0/428105594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d08142ca0 msgr2=0x7f6d0813cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:18.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.819+0000 7f6d0e19b700 1 --2- 172.21.15.112:0/428105594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d08142ca0 0x7f6d0813cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:18.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.819+0000 7f6d0e19b700 1 -- 172.21.15.112:0/428105594 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf80095f0 con 0x7f6d080ca2a0 2023-09-12T16:07:18.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.819+0000 7f6d0d99a700 1 --2- 172.21.15.112:0/428105594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d08142ca0 0x7f6d0813cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:18.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.819+0000 7f6d0e99c700 1 --2- 172.21.15.112:0/428105594 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d08143080 0x7f6d080b1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:18.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.819+0000 7f6d0e19b700 1 --2- 172.21.15.112:0/428105594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d080ca2a0 0x7f6d0813bd60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400d950 tx=0x7f6d0400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:18.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.819+0000 7f6cfeffd700 1 -- 172.21.15.112:0/428105594 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d04009b40 con 0x7f6d080ca2a0 2023-09-12T16:07:18.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.819+0000 7f6cfeffd700 1 -- 172.21.15.112:0/428105594 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6d04009d90 con 0x7f6d080ca2a0 2023-09-12T16:07:18.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.819+0000 7f6cfeffd700 1 -- 172.21.15.112:0/428105594 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d040106c0 con 0x7f6d080ca2a0 2023-09-12T16:07:18.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.819+0000 7f6d103ff700 1 -- 172.21.15.112:0/428105594 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d0813b840 con 0x7f6d080ca2a0 2023-09-12T16:07:18.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.819+0000 7f6d103ff700 1 -- 172.21.15.112:0/428105594 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d080b16c0 con 0x7f6d080ca2a0 2023-09-12T16:07:18.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.820+0000 7f6d103ff700 1 -- 172.21.15.112:0/428105594 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d0813bbb0 con 0x7f6d080ca2a0 2023-09-12T16:07:18.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.821+0000 7f6cfeffd700 1 -- 172.21.15.112:0/428105594 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f6d04010820 con 0x7f6d080ca2a0 2023-09-12T16:07:18.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.822+0000 7f6cfeffd700 1 --2- 172.21.15.112:0/428105594 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6cec06a550 0x7f6cec06ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:18.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.822+0000 7f6cfeffd700 1 -- 172.21.15.112:0/428105594 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6d04089450 con 0x7f6d080ca2a0 2023-09-12T16:07:18.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.822+0000 7f6d0d99a700 1 --2- 172.21.15.112:0/428105594 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6cec06a550 0x7f6cec06ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:18.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.823+0000 7f6d0d99a700 1 --2- 172.21.15.112:0/428105594 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6cec06a550 0x7f6cec06ca10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6d08070f70 tx=0x7f6cf8011040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:18.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:18.826+0000 7f6cfeffd700 1 -- 172.21.15.112:0/428105594 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6d04054640 con 0x7f6d080ca2a0 2023-09-12T16:07:19.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:19.069+0000 7f6d103ff700 1 -- 172.21.15.112:0/428105594 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6d0813b0e0 con 0x7f6d080ca2a0 2023-09-12T16:07:19.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:19.901+0000 7f6cfeffd700 1 -- 172.21.15.112:0/428105594 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6d0813b0e0 con 0x7f6d080ca2a0 2023-09-12T16:07:19.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:19.904+0000 7f6d103ff700 1 -- 172.21.15.112:0/428105594 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6cec06a550 msgr2=0x7f6cec06ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:19.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:19.904+0000 7f6d103ff700 1 --2- 172.21.15.112:0/428105594 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6cec06a550 0x7f6cec06ca10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6d08070f70 tx=0x7f6cf8011040 comp rx=0 tx=0).stop 2023-09-12T16:07:19.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:19.904+0000 7f6d103ff700 1 -- 172.21.15.112:0/428105594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d080ca2a0 msgr2=0x7f6d0813bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:19.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:19.904+0000 7f6d103ff700 1 --2- 172.21.15.112:0/428105594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d080ca2a0 0x7f6d0813bd60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400d950 tx=0x7f6d0400dd10 comp rx=0 tx=0).stop 2023-09-12T16:07:19.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:19.904+0000 7f6d103ff700 1 -- 172.21.15.112:0/428105594 shutdown_connections 2023-09-12T16:07:19.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:19.904+0000 7f6d103ff700 1 --2- 172.21.15.112:0/428105594 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6cec06a550 0x7f6cec06ca10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:19.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:19.904+0000 7f6d103ff700 1 --2- 172.21.15.112:0/428105594 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d08143080 0x7f6d080b1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:19.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:19.904+0000 7f6d103ff700 1 --2- 172.21.15.112:0/428105594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d080ca2a0 0x7f6d0813bd60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:19.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:19.904+0000 7f6d103ff700 1 --2- 172.21.15.112:0/428105594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d08142ca0 0x7f6d0813cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:19.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:19.904+0000 7f6d103ff700 1 -- 172.21.15.112:0/428105594 >> 172.21.15.112:0/428105594 conn(0x7f6d0806a200 msgr2=0x7f6d08141e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:19.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:19.904+0000 7f6d103ff700 1 -- 172.21.15.112:0/428105594 shutdown_connections 2023-09-12T16:07:19.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:19.904+0000 7f6d103ff700 1 -- 172.21.15.112:0/428105594 wait complete. 2023-09-12T16:07:19.926 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-09-12T16:07:19.927 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-12T16:07:20.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.133+0000 7f11b67ff700 1 -- 172.21.15.112:0/3345797270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11b015f9b0 msgr2=0x7f11b00b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:20.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.133+0000 7f11b67ff700 1 --2- 172.21.15.112:0/3345797270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11b015f9b0 0x7f11b00b54e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009f60 tx=0x7f11a8009f90 comp rx=0 tx=0).stop 2023-09-12T16:07:20.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.133+0000 7f11b67ff700 1 -- 172.21.15.112:0/3345797270 shutdown_connections 2023-09-12T16:07:20.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.133+0000 7f11b67ff700 1 --2- 172.21.15.112:0/3345797270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11b015f9b0 0x7f11b00b54e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:20.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.133+0000 7f11b67ff700 1 -- 172.21.15.112:0/3345797270 >> 172.21.15.112:0/3345797270 conn(0x7f11b009aa90 msgr2=0x7f11b00d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:20.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.133+0000 7f11b67ff700 1 -- 172.21.15.112:0/3345797270 shutdown_connections 2023-09-12T16:07:20.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.133+0000 7f11b67ff700 1 -- 172.21.15.112:0/3345797270 wait complete. 2023-09-12T16:07:20.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.134+0000 7f11b67ff700 1 Processor -- start 2023-09-12T16:07:20.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.135+0000 7f11b67ff700 1 -- start start 2023-09-12T16:07:20.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.135+0000 7f11b67ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11b015bb40 0x7f11b015ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:20.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.135+0000 7f11b67ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11b015f530 0x7f11b01f1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:20.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.135+0000 7f11b67ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11b015f9b0 0x7f11b015e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:20.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.135+0000 7f11b67ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b0157450 con 0x7f11b015f530 2023-09-12T16:07:20.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.135+0000 7f11b67ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b01565c0 con 0x7f11b015bb40 2023-09-12T16:07:20.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.135+0000 7f11b67ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b015cf80 con 0x7f11b015f9b0 2023-09-12T16:07:20.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.136+0000 7f11af7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11b015f530 0x7f11b01f1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:20.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.136+0000 7f11af7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11b015f530 0x7f11b01f1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50208/0 (socket says 172.21.15.112:50208) 2023-09-12T16:07:20.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.136+0000 7f11af7fe700 1 -- 172.21.15.112:0/2050421349 learned_addr learned my addr 172.21.15.112:0/2050421349 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:20.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.136+0000 7f11affff700 1 --2- 172.21.15.112:0/2050421349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11b015bb40 0x7f11b015ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:20.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.136+0000 7f11b4d9c700 1 --2- 172.21.15.112:0/2050421349 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11b015f9b0 0x7f11b015e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:20.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.136+0000 7f11af7fe700 1 -- 172.21.15.112:0/2050421349 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11b015f9b0 msgr2=0x7f11b015e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:20.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.136+0000 7f11af7fe700 1 --2- 172.21.15.112:0/2050421349 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11b015f9b0 0x7f11b015e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:20.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.136+0000 7f11af7fe700 1 -- 172.21.15.112:0/2050421349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11b015bb40 msgr2=0x7f11b015ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:20.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.136+0000 7f11af7fe700 1 --2- 172.21.15.112:0/2050421349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11b015bb40 0x7f11b015ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:20.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.136+0000 7f11af7fe700 1 -- 172.21.15.112:0/2050421349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a8009c40 con 0x7f11b015f530 2023-09-12T16:07:20.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.136+0000 7f11af7fe700 1 --2- 172.21.15.112:0/2050421349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11b015f530 0x7f11b01f1bc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f11a400c4e0 tx=0x7f11a400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:20.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.137+0000 7f11acff9700 1 -- 172.21.15.112:0/2050421349 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a40052d0 con 0x7f11b015f530 2023-09-12T16:07:20.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.137+0000 7f11acff9700 1 -- 172.21.15.112:0/2050421349 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f11a4005520 con 0x7f11b015f530 2023-09-12T16:07:20.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.137+0000 7f11b67ff700 1 -- 172.21.15.112:0/2050421349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b01567d0 con 0x7f11b015f530 2023-09-12T16:07:20.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.137+0000 7f11acff9700 1 -- 172.21.15.112:0/2050421349 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a40038e0 con 0x7f11b015f530 2023-09-12T16:07:20.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.137+0000 7f11b67ff700 1 -- 172.21.15.112:0/2050421349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b0156d90 con 0x7f11b015f530 2023-09-12T16:07:20.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.138+0000 7f11b67ff700 1 -- 172.21.15.112:0/2050421349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b0073ea0 con 0x7f11b015f530 2023-09-12T16:07:20.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.139+0000 7f11acff9700 1 -- 172.21.15.112:0/2050421349 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f11a4003a40 con 0x7f11b015f530 2023-09-12T16:07:20.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.139+0000 7f11acff9700 1 --2- 172.21.15.112:0/2050421349 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f119c06a580 0x7f119c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:20.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.140+0000 7f11acff9700 1 -- 172.21.15.112:0/2050421349 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f11a4088500 con 0x7f11b015f530 2023-09-12T16:07:20.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.140+0000 7f11affff700 1 --2- 172.21.15.112:0/2050421349 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f119c06a580 0x7f119c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:20.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.140+0000 7f11affff700 1 --2- 172.21.15.112:0/2050421349 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f119c06a580 0x7f119c06ca40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f11a0000f60 tx=0x7f11a0009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:20.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.144+0000 7f11acff9700 1 -- 172.21.15.112:0/2050421349 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f11a4053780 con 0x7f11b015f530 2023-09-12T16:07:20.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:20.391+0000 7f11b67ff700 1 -- 172.21.15.112:0/2050421349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f11b00b3e40 con 0x7f11b015f530 2023-09-12T16:07:21.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.331+0000 7f11acff9700 1 -- 172.21.15.112:0/2050421349 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f11a4056da0 con 0x7f11b015f530 2023-09-12T16:07:21.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.334+0000 7f11b67ff700 1 -- 172.21.15.112:0/2050421349 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f119c06a580 msgr2=0x7f119c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:21.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.334+0000 7f11b67ff700 1 --2- 172.21.15.112:0/2050421349 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f119c06a580 0x7f119c06ca40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f11a0000f60 tx=0x7f11a0009040 comp rx=0 tx=0).stop 2023-09-12T16:07:21.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.334+0000 7f11b67ff700 1 -- 172.21.15.112:0/2050421349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11b015f530 msgr2=0x7f11b01f1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:21.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.334+0000 7f11b67ff700 1 --2- 172.21.15.112:0/2050421349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11b015f530 0x7f11b01f1bc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f11a400c4e0 tx=0x7f11a400c8a0 comp rx=0 tx=0).stop 2023-09-12T16:07:21.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.334+0000 7f11b67ff700 1 -- 172.21.15.112:0/2050421349 shutdown_connections 2023-09-12T16:07:21.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.334+0000 7f11b67ff700 1 --2- 172.21.15.112:0/2050421349 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f119c06a580 0x7f119c06ca40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:21.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.334+0000 7f11b67ff700 1 --2- 172.21.15.112:0/2050421349 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11b015f9b0 0x7f11b015e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:21.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.334+0000 7f11b67ff700 1 --2- 172.21.15.112:0/2050421349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11b015bb40 0x7f11b015ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:21.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.334+0000 7f11b67ff700 1 --2- 172.21.15.112:0/2050421349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11b015f530 0x7f11b01f1bc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:21.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.334+0000 7f11b67ff700 1 -- 172.21.15.112:0/2050421349 >> 172.21.15.112:0/2050421349 conn(0x7f11b009aa90 msgr2=0x7f11b006c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:21.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.334+0000 7f11b67ff700 1 -- 172.21.15.112:0/2050421349 shutdown_connections 2023-09-12T16:07:21.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.334+0000 7f11b67ff700 1 -- 172.21.15.112:0/2050421349 wait complete. 2023-09-12T16:07:21.356 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-12T16:07:21.356 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-12T16:07:21.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.557+0000 7f9c82bff700 1 -- 172.21.15.112:0/3902042666 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c7c0cdfb0 msgr2=0x7f9c7c0cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:21.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.557+0000 7f9c82bff700 1 --2- 172.21.15.112:0/3902042666 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c7c0cdfb0 0x7f9c7c0cc3b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9c680098f0 tx=0x7f9c68009c00 comp rx=0 tx=0).stop 2023-09-12T16:07:21.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.557+0000 7f9c82bff700 1 -- 172.21.15.112:0/3902042666 shutdown_connections 2023-09-12T16:07:21.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.557+0000 7f9c82bff700 1 --2- 172.21.15.112:0/3902042666 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c7c0cdfb0 0x7f9c7c0cc3b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:21.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.557+0000 7f9c82bff700 1 -- 172.21.15.112:0/3902042666 >> 172.21.15.112:0/3902042666 conn(0x7f9c7c0d1930 msgr2=0x7f9c7c0d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:21.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.557+0000 7f9c82bff700 1 -- 172.21.15.112:0/3902042666 shutdown_connections 2023-09-12T16:07:21.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.557+0000 7f9c82bff700 1 -- 172.21.15.112:0/3902042666 wait complete. 2023-09-12T16:07:21.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.559+0000 7f9c82bff700 1 Processor -- start 2023-09-12T16:07:21.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.559+0000 7f9c82bff700 1 -- start start 2023-09-12T16:07:21.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.560+0000 7f9c82bff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c7c0cdfb0 0x7f9c7c0b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:21.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.560+0000 7f9c82bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c7c0d0590 0x7f9c7c0b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:21.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.560+0000 7f9c82bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c7c15f480 0x7f9c7c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:21.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.560+0000 7f9c82bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c0b56c0 con 0x7f9c7c0d0590 2023-09-12T16:07:21.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.560+0000 7f9c82bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c157bc0 con 0x7f9c7c15f480 2023-09-12T16:07:21.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.560+0000 7f9c82bff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c0c8e80 con 0x7f9c7c0cdfb0 2023-09-12T16:07:21.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.560+0000 7f9c7bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c7c0d0590 0x7f9c7c0b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:21.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.560+0000 7f9c7bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c7c0d0590 0x7f9c7c0b6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50210/0 (socket says 172.21.15.112:50210) 2023-09-12T16:07:21.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.560+0000 7f9c7bfff700 1 -- 172.21.15.112:0/1754180286 learned_addr learned my addr 172.21.15.112:0/1754180286 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:21.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.560+0000 7f9c8119c700 1 --2- 172.21.15.112:0/1754180286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c7c15f480 0x7f9c7c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:21.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.560+0000 7f9c8099b700 1 --2- 172.21.15.112:0/1754180286 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c7c0cdfb0 0x7f9c7c0b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:21.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.560+0000 7f9c7bfff700 1 -- 172.21.15.112:0/1754180286 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c7c0cdfb0 msgr2=0x7f9c7c0b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:21.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.560+0000 7f9c7bfff700 1 --2- 172.21.15.112:0/1754180286 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c7c0cdfb0 0x7f9c7c0b6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:21.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.560+0000 7f9c7bfff700 1 -- 172.21.15.112:0/1754180286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c7c15f480 msgr2=0x7f9c7c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:21.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.560+0000 7f9c7bfff700 1 --2- 172.21.15.112:0/1754180286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c7c15f480 0x7f9c7c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:21.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.560+0000 7f9c7bfff700 1 -- 172.21.15.112:0/1754180286 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c68009520 con 0x7f9c7c0d0590 2023-09-12T16:07:21.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.560+0000 7f9c8099b700 1 --2- 172.21.15.112:0/1754180286 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c7c0cdfb0 0x7f9c7c0b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:21.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.561+0000 7f9c7bfff700 1 --2- 172.21.15.112:0/1754180286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c7c0d0590 0x7f9c7c0b6c30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c08b1f0 tx=0x7f9c6800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:21.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.561+0000 7f9c797fa700 1 -- 172.21.15.112:0/1754180286 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c68025070 con 0x7f9c7c0d0590 2023-09-12T16:07:21.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.561+0000 7f9c797fa700 1 -- 172.21.15.112:0/1754180286 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9c6800bb20 con 0x7f9c7c0d0590 2023-09-12T16:07:21.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.561+0000 7f9c82bff700 1 -- 172.21.15.112:0/1754180286 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c7c0b2ba0 con 0x7f9c7c0d0590 2023-09-12T16:07:21.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.561+0000 7f9c797fa700 1 -- 172.21.15.112:0/1754180286 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6801b040 con 0x7f9c7c0d0590 2023-09-12T16:07:21.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.561+0000 7f9c82bff700 1 -- 172.21.15.112:0/1754180286 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7c155440 con 0x7f9c7c0d0590 2023-09-12T16:07:21.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.562+0000 7f9c82bff700 1 -- 172.21.15.112:0/1754180286 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c7c0c9010 con 0x7f9c7c0d0590 2023-09-12T16:07:21.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.563+0000 7f9c797fa700 1 -- 172.21.15.112:0/1754180286 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f9c6802a410 con 0x7f9c7c0d0590 2023-09-12T16:07:21.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.564+0000 7f9c797fa700 1 --2- 172.21.15.112:0/1754180286 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9c6006a580 0x7f9c6006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:21.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.564+0000 7f9c797fa700 1 -- 172.21.15.112:0/1754180286 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9c6808ab10 con 0x7f9c7c0d0590 2023-09-12T16:07:21.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.564+0000 7f9c8099b700 1 --2- 172.21.15.112:0/1754180286 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9c6006a580 0x7f9c6006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:21.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.565+0000 7f9c8099b700 1 --2- 172.21.15.112:0/1754180286 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9c6006a580 0x7f9c6006ca40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c09f810 tx=0x7f9c70009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:21.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.568+0000 7f9c797fa700 1 -- 172.21.15.112:0/1754180286 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f9c68055ed0 con 0x7f9c7c0d0590 2023-09-12T16:07:21.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.806+0000 7f9c82bff700 1 -- 172.21.15.112:0/1754180286 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c7c061c30 con 0x7f9c7c0d0590 2023-09-12T16:07:21.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.807+0000 7f9c797fa700 1 -- 172.21.15.112:0/1754180286 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f9c680594f0 con 0x7f9c7c0d0590 2023-09-12T16:07:21.808 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:21.808 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3995117138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3995117138},{"type":"v1","addr":"172.21.15.112:6836","nonce":3995117138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3233826602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3233826602},{"type":"v1","addr":"172.21.15.112:6837","nonce":3233826602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1854265710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1854265710},{"type":"v1","addr":"172.21.15.144:6834","nonce":1854265710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-12T16:06:59.697334+0000","modified":"2023-09-12T16:07:20.393475+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4396":{"gid":4396,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/2785398652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2785398652},{"type":"v1","addr":"172.21.15.144:6835","nonce":2785398652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-12T16:07:21.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.809+0000 7f9c82bff700 1 -- 172.21.15.112:0/1754180286 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9c6006a580 msgr2=0x7f9c6006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:21.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.809+0000 7f9c82bff700 1 --2- 172.21.15.112:0/1754180286 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9c6006a580 0x7f9c6006ca40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c09f810 tx=0x7f9c70009040 comp rx=0 tx=0).stop 2023-09-12T16:07:21.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.809+0000 7f9c82bff700 1 -- 172.21.15.112:0/1754180286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c7c0d0590 msgr2=0x7f9c7c0b6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:21.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.809+0000 7f9c82bff700 1 --2- 172.21.15.112:0/1754180286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c7c0d0590 0x7f9c7c0b6c30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c08b1f0 tx=0x7f9c6800ff90 comp rx=0 tx=0).stop 2023-09-12T16:07:21.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.809+0000 7f9c82bff700 1 -- 172.21.15.112:0/1754180286 shutdown_connections 2023-09-12T16:07:21.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.809+0000 7f9c82bff700 1 --2- 172.21.15.112:0/1754180286 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9c6006a580 0x7f9c6006ca40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:21.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.809+0000 7f9c82bff700 1 --2- 172.21.15.112:0/1754180286 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c7c0cdfb0 0x7f9c7c0b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:21.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.809+0000 7f9c82bff700 1 --2- 172.21.15.112:0/1754180286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c7c15f480 0x7f9c7c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:21.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.809+0000 7f9c82bff700 1 --2- 172.21.15.112:0/1754180286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c7c0d0590 0x7f9c7c0b6c30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:21.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.809+0000 7f9c82bff700 1 -- 172.21.15.112:0/1754180286 >> 172.21.15.112:0/1754180286 conn(0x7f9c7c0d1930 msgr2=0x7f9c7c155f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:21.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.809+0000 7f9c82bff700 1 -- 172.21.15.112:0/1754180286 shutdown_connections 2023-09-12T16:07:21.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:21.809+0000 7f9c82bff700 1 -- 172.21.15.112:0/1754180286 wait complete. 2023-09-12T16:07:21.814 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 9 2023-09-12T16:07:21.828 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:07:22.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.026+0000 7fb9e1fff700 1 -- 172.21.15.112:0/301032827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9dc0ce5f0 msgr2=0x7fb9dc0ce9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:22.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.026+0000 7fb9e1fff700 1 --2- 172.21.15.112:0/301032827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9dc0ce5f0 0x7fb9dc0ce9d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc005fd0 tx=0x7fb9cc009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:22.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.026+0000 7fb9e1fff700 1 -- 172.21.15.112:0/301032827 shutdown_connections 2023-09-12T16:07:22.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.026+0000 7fb9e1fff700 1 --2- 172.21.15.112:0/301032827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9dc0ce5f0 0x7fb9dc0ce9d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.026+0000 7fb9e1fff700 1 --2- 172.21.15.112:0/301032827 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9dc0b02a0 0x7fb9dc0d1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.026+0000 7fb9e1fff700 1 -- 172.21.15.112:0/301032827 >> 172.21.15.112:0/301032827 conn(0x7fb9dc071ba0 msgr2=0x7fb9dc071fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:22.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.027+0000 7fb9e1fff700 1 -- 172.21.15.112:0/301032827 shutdown_connections 2023-09-12T16:07:22.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.027+0000 7fb9e1fff700 1 -- 172.21.15.112:0/301032827 wait complete. 2023-09-12T16:07:22.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.029+0000 7fb9e1fff700 1 Processor -- start 2023-09-12T16:07:22.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.029+0000 7fb9e1fff700 1 -- start start 2023-09-12T16:07:22.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.030+0000 7fb9e1fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9dc0b02a0 0x7fb9dc156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:22.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.030+0000 7fb9e1fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9dc0ce5f0 0x7fb9dc154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:22.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.030+0000 7fb9e1fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9dc0d21f0 0x7fb9dc0c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:22.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.030+0000 7fb9e1fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc158920 con 0x7fb9dc0b02a0 2023-09-12T16:07:22.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.030+0000 7fb9e1fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc157880 con 0x7fb9dc0ce5f0 2023-09-12T16:07:22.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.030+0000 7fb9e1fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc157b60 con 0x7fb9dc0d21f0 2023-09-12T16:07:22.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.030+0000 7fb9db7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9dc0b02a0 0x7fb9dc156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:22.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.030+0000 7fb9db7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9dc0b02a0 0x7fb9dc156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50228/0 (socket says 172.21.15.112:50228) 2023-09-12T16:07:22.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.031+0000 7fb9db7fe700 1 -- 172.21.15.112:0/888516025 learned_addr learned my addr 172.21.15.112:0/888516025 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:22.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.031+0000 7fb9daffd700 1 --2- 172.21.15.112:0/888516025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9dc0ce5f0 0x7fb9dc154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:22.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.031+0000 7fb9db7fe700 1 -- 172.21.15.112:0/888516025 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9dc0d21f0 msgr2=0x7fb9dc0c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:22.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.031+0000 7fb9dbfff700 1 --2- 172.21.15.112:0/888516025 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9dc0d21f0 0x7fb9dc0c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:22.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.031+0000 7fb9db7fe700 1 --2- 172.21.15.112:0/888516025 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9dc0d21f0 0x7fb9dc0c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.031+0000 7fb9db7fe700 1 -- 172.21.15.112:0/888516025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9dc0ce5f0 msgr2=0x7fb9dc154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:22.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.031+0000 7fb9db7fe700 1 --2- 172.21.15.112:0/888516025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9dc0ce5f0 0x7fb9dc154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.031+0000 7fb9db7fe700 1 -- 172.21.15.112:0/888516025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc0095f0 con 0x7fb9dc0b02a0 2023-09-12T16:07:22.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.031+0000 7fb9daffd700 1 --2- 172.21.15.112:0/888516025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9dc0ce5f0 0x7fb9dc154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:22.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.031+0000 7fb9dbfff700 1 --2- 172.21.15.112:0/888516025 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9dc0d21f0 0x7fb9dc0c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:22.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.031+0000 7fb9db7fe700 1 --2- 172.21.15.112:0/888516025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9dc0b02a0 0x7fb9dc156fa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0098e0 tx=0x7fb9cc00bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:22.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.031+0000 7fb9c3fff700 1 -- 172.21.15.112:0/888516025 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc01d070 con 0x7fb9dc0b02a0 2023-09-12T16:07:22.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.031+0000 7fb9c3fff700 1 -- 172.21.15.112:0/888516025 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb9cc003890 con 0x7fb9dc0b02a0 2023-09-12T16:07:22.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.031+0000 7fb9e1fff700 1 -- 172.21.15.112:0/888516025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9dc157e40 con 0x7fb9dc0b02a0 2023-09-12T16:07:22.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.031+0000 7fb9c3fff700 1 -- 172.21.15.112:0/888516025 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc003ca0 con 0x7fb9dc0b02a0 2023-09-12T16:07:22.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.032+0000 7fb9e1fff700 1 -- 172.21.15.112:0/888516025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9dc158400 con 0x7fb9dc0b02a0 2023-09-12T16:07:22.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.033+0000 7fb9e1fff700 1 -- 172.21.15.112:0/888516025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9dc073ea0 con 0x7fb9dc0b02a0 2023-09-12T16:07:22.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.033+0000 7fb9c3fff700 1 -- 172.21.15.112:0/888516025 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fb9cc022470 con 0x7fb9dc0b02a0 2023-09-12T16:07:22.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.034+0000 7fb9c3fff700 1 --2- 172.21.15.112:0/888516025 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb9c806a580 0x7fb9c806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:22.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.034+0000 7fb9c3fff700 1 -- 172.21.15.112:0/888516025 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb9cc08a5a0 con 0x7fb9dc0b02a0 2023-09-12T16:07:22.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.035+0000 7fb9daffd700 1 --2- 172.21.15.112:0/888516025 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb9c806a580 0x7fb9c806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:22.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.035+0000 7fb9daffd700 1 --2- 172.21.15.112:0/888516025 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb9c806a580 0x7fb9c806ca40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0005e10 tx=0x7fb9d0005d20 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:22.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.038+0000 7fb9c3fff700 1 -- 172.21.15.112:0/888516025 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb9cc0558c0 con 0x7fb9dc0b02a0 2023-09-12T16:07:22.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.237+0000 7fb9e1fff700 1 -- 172.21.15.112:0/888516025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9dc0b4930 con 0x7fb9dc0b02a0 2023-09-12T16:07:22.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.238+0000 7fb9c3fff700 1 -- 172.21.15.112:0/888516025 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fb9cc058ee0 con 0x7fb9dc0b02a0 2023-09-12T16:07:22.240 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:22.240 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:04.748402+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:07:22.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.242+0000 7fb9e1fff700 1 -- 172.21.15.112:0/888516025 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb9c806a580 msgr2=0x7fb9c806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:22.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.242+0000 7fb9e1fff700 1 --2- 172.21.15.112:0/888516025 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb9c806a580 0x7fb9c806ca40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0005e10 tx=0x7fb9d0005d20 comp rx=0 tx=0).stop 2023-09-12T16:07:22.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.242+0000 7fb9e1fff700 1 -- 172.21.15.112:0/888516025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9dc0b02a0 msgr2=0x7fb9dc156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:22.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.242+0000 7fb9e1fff700 1 --2- 172.21.15.112:0/888516025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9dc0b02a0 0x7fb9dc156fa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0098e0 tx=0x7fb9cc00bee0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.242+0000 7fb9e1fff700 1 -- 172.21.15.112:0/888516025 shutdown_connections 2023-09-12T16:07:22.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.242+0000 7fb9e1fff700 1 --2- 172.21.15.112:0/888516025 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb9c806a580 0x7fb9c806ca40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.242+0000 7fb9e1fff700 1 --2- 172.21.15.112:0/888516025 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9dc0d21f0 0x7fb9dc0c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.242+0000 7fb9e1fff700 1 --2- 172.21.15.112:0/888516025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9dc0b02a0 0x7fb9dc156fa0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.242+0000 7fb9e1fff700 1 --2- 172.21.15.112:0/888516025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9dc0ce5f0 0x7fb9dc154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.242+0000 7fb9e1fff700 1 -- 172.21.15.112:0/888516025 >> 172.21.15.112:0/888516025 conn(0x7fb9dc071ba0 msgr2=0x7fb9dc0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:22.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.242+0000 7fb9e1fff700 1 -- 172.21.15.112:0/888516025 shutdown_connections 2023-09-12T16:07:22.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.242+0000 7fb9e1fff700 1 -- 172.21.15.112:0/888516025 wait complete. 2023-09-12T16:07:22.260 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-12T16:07:22.260 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-12T16:07:22.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.459+0000 7f36c77ff700 1 -- 172.21.15.112:0/7458034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36c015f480 msgr2=0x7f36c00cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:22.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.459+0000 7f36c77ff700 1 --2- 172.21.15.112:0/7458034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36c015f480 0x7f36c00cfe80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f36c0089340 tx=0x7f36bc009b90 comp rx=0 tx=0).stop 2023-09-12T16:07:22.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.459+0000 7f36c77ff700 1 -- 172.21.15.112:0/7458034 shutdown_connections 2023-09-12T16:07:22.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.459+0000 7f36c77ff700 1 --2- 172.21.15.112:0/7458034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36c015f480 0x7f36c00cfe80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.459+0000 7f36c77ff700 1 --2- 172.21.15.112:0/7458034 >> v2:172.21.15.144:3300/0 conn(0x7f36c00cdfb0 0x7f36c00d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.459+0000 7f36c77ff700 1 -- 172.21.15.112:0/7458034 >> 172.21.15.112:0/7458034 conn(0x7f36c00d1930 msgr2=0x7f36c00d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:22.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.459+0000 7f36c77ff700 1 -- 172.21.15.112:0/7458034 shutdown_connections 2023-09-12T16:07:22.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.459+0000 7f36c77ff700 1 -- 172.21.15.112:0/7458034 wait complete. 2023-09-12T16:07:22.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.461+0000 7f36c77ff700 1 Processor -- start 2023-09-12T16:07:22.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.461+0000 7f36c77ff700 1 -- start start 2023-09-12T16:07:22.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.462+0000 7f36c77ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36c00b28f0 0x7f36c00b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:22.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.462+0000 7f36c77ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36c00cdfb0 0x7f36c0157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:22.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.462+0000 7f36c77ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36c015f480 0x7f36c0158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:22.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.462+0000 7f36c77ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c01f20f0 con 0x7f36c015f480 2023-09-12T16:07:22.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.462+0000 7f36c77ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c00b5f80 con 0x7f36c00cdfb0 2023-09-12T16:07:22.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.462+0000 7f36c77ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c00b6260 con 0x7f36c00b28f0 2023-09-12T16:07:22.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.462+0000 7f36c5d9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36c015f480 0x7f36c0158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:22.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.462+0000 7f36c5d9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36c015f480 0x7f36c0158020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50246/0 (socket says 172.21.15.112:50246) 2023-09-12T16:07:22.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.462+0000 7f36c5d9c700 1 -- 172.21.15.112:0/1299307074 learned_addr learned my addr 172.21.15.112:0/1299307074 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:22.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.462+0000 7f36c4d9a700 1 --2- 172.21.15.112:0/1299307074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36c00cdfb0 0x7f36c0157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:22.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.462+0000 7f36c559b700 1 --2- 172.21.15.112:0/1299307074 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36c00b28f0 0x7f36c00b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:22.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.462+0000 7f36c5d9c700 1 -- 172.21.15.112:0/1299307074 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36c00b28f0 msgr2=0x7f36c00b55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:22.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.462+0000 7f36c5d9c700 1 --2- 172.21.15.112:0/1299307074 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36c00b28f0 0x7f36c00b55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.462+0000 7f36c5d9c700 1 -- 172.21.15.112:0/1299307074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36c00cdfb0 msgr2=0x7f36c0157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:22.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.462+0000 7f36c5d9c700 1 --2- 172.21.15.112:0/1299307074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36c00cdfb0 0x7f36c0157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.462+0000 7f36c5d9c700 1 -- 172.21.15.112:0/1299307074 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36bc0094c0 con 0x7f36c015f480 2023-09-12T16:07:22.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.462+0000 7f36c559b700 1 --2- 172.21.15.112:0/1299307074 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36c00b28f0 0x7f36c00b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:07:22.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.463+0000 7f36c5d9c700 1 --2- 172.21.15.112:0/1299307074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36c015f480 0x7f36c0158020 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f36b800c820 tx=0x7f36b800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:22.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.463+0000 7f36b5ffb700 1 -- 172.21.15.112:0/1299307074 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b8003e30 con 0x7f36c015f480 2023-09-12T16:07:22.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.463+0000 7f36b5ffb700 1 -- 172.21.15.112:0/1299307074 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f36b80050f0 con 0x7f36c015f480 2023-09-12T16:07:22.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.463+0000 7f36b5ffb700 1 -- 172.21.15.112:0/1299307074 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b8005500 con 0x7f36c015f480 2023-09-12T16:07:22.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.463+0000 7f36c77ff700 1 -- 172.21.15.112:0/1299307074 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c00b6540 con 0x7f36c015f480 2023-09-12T16:07:22.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.463+0000 7f36c77ff700 1 -- 172.21.15.112:0/1299307074 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c00b6b00 con 0x7f36c015f480 2023-09-12T16:07:22.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.464+0000 7f36c77ff700 1 -- 172.21.15.112:0/1299307074 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c004e300 con 0x7f36c015f480 2023-09-12T16:07:22.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.465+0000 7f36b5ffb700 1 -- 172.21.15.112:0/1299307074 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f36b8005660 con 0x7f36c015f480 2023-09-12T16:07:22.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.466+0000 7f36b5ffb700 1 --2- 172.21.15.112:0/1299307074 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f36a406a580 0x7f36a406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:22.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.466+0000 7f36b5ffb700 1 -- 172.21.15.112:0/1299307074 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f36b8088700 con 0x7f36c015f480 2023-09-12T16:07:22.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.466+0000 7f36c559b700 1 --2- 172.21.15.112:0/1299307074 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f36a406a580 0x7f36a406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:22.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.467+0000 7f36c559b700 1 --2- 172.21.15.112:0/1299307074 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f36a406a580 0x7f36a406ca40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f36bc009800 tx=0x7f36bc0047c0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:22.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.470+0000 7f36b5ffb700 1 -- 172.21.15.112:0/1299307074 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f36b8053980 con 0x7f36c015f480 2023-09-12T16:07:22.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.661+0000 7f36c77ff700 1 -- 172.21.15.112:0/1299307074 --> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f36c00b4300 con 0x7f36a406a580 2023-09-12T16:07:22.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.674+0000 7f36b5ffb700 1 -- 172.21.15.112:0/1299307074 <== mgr.4176 v2:172.21.15.112:6832/1000013333 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345260 (secure 0 0 0) 0x7f36c00b4300 con 0x7f36a406a580 2023-09-12T16:07:22.679 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:22.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.679+0000 7f36c77ff700 1 -- 172.21.15.112:0/1299307074 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f36a406a580 msgr2=0x7f36a406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:22.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.679+0000 7f36c77ff700 1 --2- 172.21.15.112:0/1299307074 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f36a406a580 0x7f36a406ca40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f36bc009800 tx=0x7f36bc0047c0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.679+0000 7f36c77ff700 1 -- 172.21.15.112:0/1299307074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36c015f480 msgr2=0x7f36c0158020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:22.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.679+0000 7f36c77ff700 1 --2- 172.21.15.112:0/1299307074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36c015f480 0x7f36c0158020 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f36b800c820 tx=0x7f36b800cb30 comp rx=0 tx=0).stop 2023-09-12T16:07:22.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.679+0000 7f36c77ff700 1 -- 172.21.15.112:0/1299307074 shutdown_connections 2023-09-12T16:07:22.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.679+0000 7f36c77ff700 1 --2- 172.21.15.112:0/1299307074 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f36a406a580 0x7f36a406ca40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.679+0000 7f36c77ff700 1 --2- 172.21.15.112:0/1299307074 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36c00b28f0 0x7f36c00b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.679+0000 7f36c77ff700 1 --2- 172.21.15.112:0/1299307074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36c015f480 0x7f36c0158020 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.679+0000 7f36c77ff700 1 --2- 172.21.15.112:0/1299307074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36c00cdfb0 0x7f36c0157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.679+0000 7f36c77ff700 1 -- 172.21.15.112:0/1299307074 >> 172.21.15.112:0/1299307074 conn(0x7f36c00d1930 msgr2=0x7f36c006c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:22.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.679+0000 7f36c77ff700 1 -- 172.21.15.112:0/1299307074 shutdown_connections 2023-09-12T16:07:22.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.679+0000 7f36c77ff700 1 -- 172.21.15.112:0/1299307074 wait complete. 2023-09-12T16:07:22.685 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-09-12T16:07:22.698 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-09-12T16:07:20.818171+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219376,"kb_used_data":3204,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755344,"statfs":{"total":773094113280,"available":772869472256,"internally_reserved":0,"allocated":3280896,"data_stored":1987237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002646"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.617354+0000","last_change":"2023-09-12T16:07:00.253786+0000","last_active":"2023-09-12T16:07:04.617354+0000","last_peered":"2023-09-12T16:07:04.617354+0000","last_clean":"2023-09-12T16:07:04.617354+0000","last_became_active":"2023-09-12T16:07:00.251978+0000","last_became_peered":"2023-09-12T16:07:00.251978+0000","last_unstale":"2023-09-12T16:07:04.617354+0000","last_undegraded":"2023-09-12T16:07:04.617354+0000","last_fullsized":"2023-09-12T16:07:04.617354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:19:17.260974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251964+0000","last_change":"2023-09-12T16:07:00.245299+0000","last_active":"2023-09-12T16:07:04.251964+0000","last_peered":"2023-09-12T16:07:04.251964+0000","last_clean":"2023-09-12T16:07:04.251964+0000","last_became_active":"2023-09-12T16:07:00.245040+0000","last_became_peered":"2023-09-12T16:07:00.245040+0000","last_unstale":"2023-09-12T16:07:04.251964+0000","last_undegraded":"2023-09-12T16:07:04.251964+0000","last_fullsized":"2023-09-12T16:07:04.251964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:38:37.389648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257391+0000","last_change":"2023-09-12T16:07:00.219173+0000","last_active":"2023-09-12T16:07:04.257391+0000","last_peered":"2023-09-12T16:07:04.257391+0000","last_clean":"2023-09-12T16:07:04.257391+0000","last_became_active":"2023-09-12T16:07:00.218882+0000","last_became_peered":"2023-09-12T16:07:00.218882+0000","last_unstale":"2023-09-12T16:07:04.257391+0000","last_undegraded":"2023-09-12T16:07:04.257391+0000","last_fullsized":"2023-09-12T16:07:04.257391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:37.582798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262241+0000","last_change":"2023-09-12T16:07:00.246106+0000","last_active":"2023-09-12T16:07:04.262241+0000","last_peered":"2023-09-12T16:07:04.262241+0000","last_clean":"2023-09-12T16:07:04.262241+0000","last_became_active":"2023-09-12T16:07:00.245639+0000","last_became_peered":"2023-09-12T16:07:00.245639+0000","last_unstale":"2023-09-12T16:07:04.262241+0000","last_undegraded":"2023-09-12T16:07:04.262241+0000","last_fullsized":"2023-09-12T16:07:04.262241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:41:27.002114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616202+0000","last_change":"2023-09-12T16:07:00.246089+0000","last_active":"2023-09-12T16:07:04.616202+0000","last_peered":"2023-09-12T16:07:04.616202+0000","last_clean":"2023-09-12T16:07:04.616202+0000","last_became_active":"2023-09-12T16:07:00.245831+0000","last_became_peered":"2023-09-12T16:07:00.245831+0000","last_unstale":"2023-09-12T16:07:04.616202+0000","last_undegraded":"2023-09-12T16:07:04.616202+0000","last_fullsized":"2023-09-12T16:07:04.616202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:11:30.292559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262233+0000","last_change":"2023-09-12T16:07:00.246840+0000","last_active":"2023-09-12T16:07:04.262233+0000","last_peered":"2023-09-12T16:07:04.262233+0000","last_clean":"2023-09-12T16:07:04.262233+0000","last_became_active":"2023-09-12T16:07:00.246570+0000","last_became_peered":"2023-09-12T16:07:00.246570+0000","last_unstale":"2023-09-12T16:07:04.262233+0000","last_undegraded":"2023-09-12T16:07:04.262233+0000","last_fullsized":"2023-09-12T16:07:04.262233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:42:25.200461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616003+0000","last_change":"2023-09-12T16:07:00.251283+0000","last_active":"2023-09-12T16:07:04.616003+0000","last_peered":"2023-09-12T16:07:04.616003+0000","last_clean":"2023-09-12T16:07:04.616003+0000","last_became_active":"2023-09-12T16:07:00.250953+0000","last_became_peered":"2023-09-12T16:07:00.250953+0000","last_unstale":"2023-09-12T16:07:04.616003+0000","last_undegraded":"2023-09-12T16:07:04.616003+0000","last_fullsized":"2023-09-12T16:07:04.616003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:38:37.389648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259047+0000","last_change":"2023-09-12T16:07:00.247292+0000","last_active":"2023-09-12T16:07:04.259047+0000","last_peered":"2023-09-12T16:07:04.259047+0000","last_clean":"2023-09-12T16:07:04.259047+0000","last_became_active":"2023-09-12T16:07:00.246988+0000","last_became_peered":"2023-09-12T16:07:00.246988+0000","last_unstale":"2023-09-12T16:07:04.259047+0000","last_undegraded":"2023-09-12T16:07:04.259047+0000","last_fullsized":"2023-09-12T16:07:04.259047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:55:23.361221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.617248+0000","last_change":"2023-09-12T16:07:00.248892+0000","last_active":"2023-09-12T16:07:04.617248+0000","last_peered":"2023-09-12T16:07:04.617248+0000","last_clean":"2023-09-12T16:07:04.617248+0000","last_became_active":"2023-09-12T16:07:00.248600+0000","last_became_peered":"2023-09-12T16:07:00.248600+0000","last_unstale":"2023-09-12T16:07:04.617248+0000","last_undegraded":"2023-09-12T16:07:04.617248+0000","last_fullsized":"2023-09-12T16:07:04.617248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:42:25.200461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.266142+0000","last_change":"2023-09-12T16:07:00.247355+0000","last_active":"2023-09-12T16:07:04.266142+0000","last_peered":"2023-09-12T16:07:04.266142+0000","last_clean":"2023-09-12T16:07:04.266142+0000","last_became_active":"2023-09-12T16:07:00.247057+0000","last_became_peered":"2023-09-12T16:07:00.247057+0000","last_unstale":"2023-09-12T16:07:04.266142+0000","last_undegraded":"2023-09-12T16:07:04.266142+0000","last_fullsized":"2023-09-12T16:07:04.266142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:14:21.195478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.265053+0000","last_change":"2023-09-12T16:07:00.249260+0000","last_active":"2023-09-12T16:07:04.265053+0000","last_peered":"2023-09-12T16:07:04.265053+0000","last_clean":"2023-09-12T16:07:04.265053+0000","last_became_active":"2023-09-12T16:07:00.248927+0000","last_became_peered":"2023-09-12T16:07:00.248927+0000","last_unstale":"2023-09-12T16:07:04.265053+0000","last_undegraded":"2023-09-12T16:07:04.265053+0000","last_fullsized":"2023-09-12T16:07:04.265053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:37.582798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259993+0000","last_change":"2023-09-12T16:07:00.242778+0000","last_active":"2023-09-12T16:07:04.259993+0000","last_peered":"2023-09-12T16:07:04.259993+0000","last_clean":"2023-09-12T16:07:04.259993+0000","last_became_active":"2023-09-12T16:07:00.242486+0000","last_became_peered":"2023-09-12T16:07:00.242486+0000","last_unstale":"2023-09-12T16:07:04.259993+0000","last_undegraded":"2023-09-12T16:07:04.259993+0000","last_fullsized":"2023-09-12T16:07:04.259993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:44:50.756697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257289+0000","last_change":"2023-09-12T16:07:00.243909+0000","last_active":"2023-09-12T16:07:04.257289+0000","last_peered":"2023-09-12T16:07:04.257289+0000","last_clean":"2023-09-12T16:07:04.257289+0000","last_became_active":"2023-09-12T16:07:00.243407+0000","last_became_peered":"2023-09-12T16:07:00.243407+0000","last_unstale":"2023-09-12T16:07:04.257289+0000","last_undegraded":"2023-09-12T16:07:04.257289+0000","last_fullsized":"2023-09-12T16:07:04.257289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:14:21.195478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257539+0000","last_change":"2023-09-12T16:07:00.238637+0000","last_active":"2023-09-12T16:07:04.257539+0000","last_peered":"2023-09-12T16:07:04.257539+0000","last_clean":"2023-09-12T16:07:04.257539+0000","last_became_active":"2023-09-12T16:07:00.238391+0000","last_became_peered":"2023-09-12T16:07:00.238391+0000","last_unstale":"2023-09-12T16:07:04.257539+0000","last_undegraded":"2023-09-12T16:07:04.257539+0000","last_fullsized":"2023-09-12T16:07:04.257539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:53:20.853979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251492+0000","last_change":"2023-09-12T16:07:00.242098+0000","last_active":"2023-09-12T16:07:04.251492+0000","last_peered":"2023-09-12T16:07:04.251492+0000","last_clean":"2023-09-12T16:07:04.251492+0000","last_became_active":"2023-09-12T16:07:00.241773+0000","last_became_peered":"2023-09-12T16:07:00.241773+0000","last_unstale":"2023-09-12T16:07:04.251492+0000","last_undegraded":"2023-09-12T16:07:04.251492+0000","last_fullsized":"2023-09-12T16:07:04.251492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:53:20.853979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262541+0000","last_change":"2023-09-12T16:07:00.241891+0000","last_active":"2023-09-12T16:07:04.262541+0000","last_peered":"2023-09-12T16:07:04.262541+0000","last_clean":"2023-09-12T16:07:04.262541+0000","last_became_active":"2023-09-12T16:07:00.241300+0000","last_became_peered":"2023-09-12T16:07:00.241300+0000","last_unstale":"2023-09-12T16:07:04.262541+0000","last_undegraded":"2023-09-12T16:07:04.262541+0000","last_fullsized":"2023-09-12T16:07:04.262541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:58.775088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262201+0000","last_change":"2023-09-12T16:07:00.250157+0000","last_active":"2023-09-12T16:07:04.262201+0000","last_peered":"2023-09-12T16:07:04.262201+0000","last_clean":"2023-09-12T16:07:04.262201+0000","last_became_active":"2023-09-12T16:07:00.249481+0000","last_became_peered":"2023-09-12T16:07:00.249481+0000","last_unstale":"2023-09-12T16:07:04.262201+0000","last_undegraded":"2023-09-12T16:07:04.262201+0000","last_fullsized":"2023-09-12T16:07:04.262201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:31.336670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262823+0000","last_change":"2023-09-12T16:07:00.219775+0000","last_active":"2023-09-12T16:07:04.262823+0000","last_peered":"2023-09-12T16:07:04.262823+0000","last_clean":"2023-09-12T16:07:04.262823+0000","last_became_active":"2023-09-12T16:07:00.219459+0000","last_became_peered":"2023-09-12T16:07:00.219459+0000","last_unstale":"2023-09-12T16:07:04.262823+0000","last_undegraded":"2023-09-12T16:07:04.262823+0000","last_fullsized":"2023-09-12T16:07:04.262823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:53:29.565994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.617208+0000","last_change":"2023-09-12T16:07:00.246535+0000","last_active":"2023-09-12T16:07:04.617208+0000","last_peered":"2023-09-12T16:07:04.617208+0000","last_clean":"2023-09-12T16:07:04.617208+0000","last_became_active":"2023-09-12T16:07:00.245971+0000","last_became_peered":"2023-09-12T16:07:00.245971+0000","last_unstale":"2023-09-12T16:07:04.617208+0000","last_undegraded":"2023-09-12T16:07:04.617208+0000","last_fullsized":"2023-09-12T16:07:04.617208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:27:58.457682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.270033+0000","last_change":"2023-09-12T16:07:04.623483+0000","last_active":"2023-09-12T16:07:05.270033+0000","last_peered":"2023-09-12T16:07:05.270033+0000","last_clean":"2023-09-12T16:07:05.270033+0000","last_became_active":"2023-09-12T16:07:04.622859+0000","last_became_peered":"2023-09-12T16:07:04.622859+0000","last_unstale":"2023-09-12T16:07:05.270033+0000","last_undegraded":"2023-09-12T16:07:05.270033+0000","last_fullsized":"2023-09-12T16:07:05.270033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:13:05.956723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257878+0000","last_change":"2023-09-12T16:06:59.234835+0000","last_active":"2023-09-12T16:07:04.257878+0000","last_peered":"2023-09-12T16:07:04.257878+0000","last_clean":"2023-09-12T16:07:04.257878+0000","last_became_active":"2023-09-12T16:06:59.234575+0000","last_became_peered":"2023-09-12T16:06:59.234575+0000","last_unstale":"2023-09-12T16:07:04.257878+0000","last_undegraded":"2023-09-12T16:07:04.257878+0000","last_fullsized":"2023-09-12T16:07:04.257878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:53:28.559875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259666+0000","last_change":"2023-09-12T16:07:00.251627+0000","last_active":"2023-09-12T16:07:04.259666+0000","last_peered":"2023-09-12T16:07:04.259666+0000","last_clean":"2023-09-12T16:07:04.259666+0000","last_became_active":"2023-09-12T16:07:00.251369+0000","last_became_peered":"2023-09-12T16:07:00.251369+0000","last_unstale":"2023-09-12T16:07:04.259666+0000","last_undegraded":"2023-09-12T16:07:04.259666+0000","last_fullsized":"2023-09-12T16:07:04.259666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:13:06.582191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872052+0000","last_change":"2023-09-12T16:07:04.280718+0000","last_active":"2023-09-12T16:07:05.872052+0000","last_peered":"2023-09-12T16:07:05.872052+0000","last_clean":"2023-09-12T16:07:05.872052+0000","last_became_active":"2023-09-12T16:07:04.280197+0000","last_became_peered":"2023-09-12T16:07:04.280197+0000","last_unstale":"2023-09-12T16:07:05.872052+0000","last_undegraded":"2023-09-12T16:07:05.872052+0000","last_fullsized":"2023-09-12T16:07:05.872052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:35.376110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259751+0000","last_change":"2023-09-12T16:06:59.231242+0000","last_active":"2023-09-12T16:07:04.259751+0000","last_peered":"2023-09-12T16:07:04.259751+0000","last_clean":"2023-09-12T16:07:04.259751+0000","last_became_active":"2023-09-12T16:06:59.230937+0000","last_became_peered":"2023-09-12T16:06:59.230937+0000","last_unstale":"2023-09-12T16:07:04.259751+0000","last_undegraded":"2023-09-12T16:07:04.259751+0000","last_fullsized":"2023-09-12T16:07:04.259751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:09:05.056699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257787+0000","last_change":"2023-09-12T16:07:00.248417+0000","last_active":"2023-09-12T16:07:04.257787+0000","last_peered":"2023-09-12T16:07:04.257787+0000","last_clean":"2023-09-12T16:07:04.257787+0000","last_became_active":"2023-09-12T16:07:00.247991+0000","last_became_peered":"2023-09-12T16:07:00.247991+0000","last_unstale":"2023-09-12T16:07:04.257787+0000","last_undegraded":"2023-09-12T16:07:04.257787+0000","last_fullsized":"2023-09-12T16:07:04.257787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:46:52.188371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872328+0000","last_change":"2023-09-12T16:07:04.280463+0000","last_active":"2023-09-12T16:07:05.872328+0000","last_peered":"2023-09-12T16:07:05.872328+0000","last_clean":"2023-09-12T16:07:05.872328+0000","last_became_active":"2023-09-12T16:07:04.279988+0000","last_became_peered":"2023-09-12T16:07:04.279988+0000","last_unstale":"2023-09-12T16:07:05.872328+0000","last_undegraded":"2023-09-12T16:07:05.872328+0000","last_fullsized":"2023-09-12T16:07:05.872328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:41:31.041554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616494+0000","last_change":"2023-09-12T16:06:59.242596+0000","last_active":"2023-09-12T16:07:04.616494+0000","last_peered":"2023-09-12T16:07:04.616494+0000","last_clean":"2023-09-12T16:07:04.616494+0000","last_became_active":"2023-09-12T16:06:59.242307+0000","last_became_peered":"2023-09-12T16:06:59.242307+0000","last_unstale":"2023-09-12T16:07:04.616494+0000","last_undegraded":"2023-09-12T16:07:04.616494+0000","last_fullsized":"2023-09-12T16:07:04.616494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:36.576680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261954+0000","last_change":"2023-09-12T16:07:00.246505+0000","last_active":"2023-09-12T16:07:04.261954+0000","last_peered":"2023-09-12T16:07:04.261954+0000","last_clean":"2023-09-12T16:07:04.261954+0000","last_became_active":"2023-09-12T16:07:00.246205+0000","last_became_peered":"2023-09-12T16:07:00.246205+0000","last_unstale":"2023-09-12T16:07:04.261954+0000","last_undegraded":"2023-09-12T16:07:04.261954+0000","last_fullsized":"2023-09-12T16:07:04.261954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:38:37.389648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.873485+0000","last_change":"2023-09-12T16:07:04.280831+0000","last_active":"2023-09-12T16:07:05.873485+0000","last_peered":"2023-09-12T16:07:05.873485+0000","last_clean":"2023-09-12T16:07:05.873485+0000","last_became_active":"2023-09-12T16:07:04.280464+0000","last_became_peered":"2023-09-12T16:07:04.280464+0000","last_unstale":"2023-09-12T16:07:05.873485+0000","last_undegraded":"2023-09-12T16:07:05.873485+0000","last_fullsized":"2023-09-12T16:07:05.873485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:19:21.300414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616218+0000","last_change":"2023-09-12T16:06:59.241342+0000","last_active":"2023-09-12T16:07:04.616218+0000","last_peered":"2023-09-12T16:07:04.616218+0000","last_clean":"2023-09-12T16:07:04.616218+0000","last_became_active":"2023-09-12T16:06:59.241022+0000","last_became_peered":"2023-09-12T16:06:59.241022+0000","last_unstale":"2023-09-12T16:07:04.616218+0000","last_undegraded":"2023-09-12T16:07:04.616218+0000","last_fullsized":"2023-09-12T16:07:04.616218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:06:29.925466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262524+0000","last_change":"2023-09-12T16:07:00.244619+0000","last_active":"2023-09-12T16:07:04.262524+0000","last_peered":"2023-09-12T16:07:04.262524+0000","last_clean":"2023-09-12T16:07:04.262524+0000","last_became_active":"2023-09-12T16:07:00.244333+0000","last_became_peered":"2023-09-12T16:07:00.244333+0000","last_unstale":"2023-09-12T16:07:04.262524+0000","last_undegraded":"2023-09-12T16:07:04.262524+0000","last_fullsized":"2023-09-12T16:07:04.262524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:36:27.893363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.270612+0000","last_change":"2023-09-12T16:07:04.275913+0000","last_active":"2023-09-12T16:07:05.270612+0000","last_peered":"2023-09-12T16:07:05.270612+0000","last_clean":"2023-09-12T16:07:05.270612+0000","last_became_active":"2023-09-12T16:07:04.275487+0000","last_became_peered":"2023-09-12T16:07:04.275487+0000","last_unstale":"2023-09-12T16:07:05.270612+0000","last_undegraded":"2023-09-12T16:07:05.270612+0000","last_fullsized":"2023-09-12T16:07:05.270612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:09:51.094691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257445+0000","last_change":"2023-09-12T16:06:59.239289+0000","last_active":"2023-09-12T16:07:04.257445+0000","last_peered":"2023-09-12T16:07:04.257445+0000","last_clean":"2023-09-12T16:07:04.257445+0000","last_became_active":"2023-09-12T16:06:59.239069+0000","last_became_peered":"2023-09-12T16:06:59.239069+0000","last_unstale":"2023-09-12T16:07:04.257445+0000","last_undegraded":"2023-09-12T16:07:04.257445+0000","last_fullsized":"2023-09-12T16:07:04.257445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:09:08.619023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259404+0000","last_change":"2023-09-12T16:07:00.238894+0000","last_active":"2023-09-12T16:07:04.259404+0000","last_peered":"2023-09-12T16:07:04.259404+0000","last_clean":"2023-09-12T16:07:04.259404+0000","last_became_active":"2023-09-12T16:07:00.238601+0000","last_became_peered":"2023-09-12T16:07:00.238601+0000","last_unstale":"2023-09-12T16:07:04.259404+0000","last_undegraded":"2023-09-12T16:07:04.259404+0000","last_fullsized":"2023-09-12T16:07:04.259404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:34:50.390861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.272943+0000","last_change":"2023-09-12T16:07:04.280769+0000","last_active":"2023-09-12T16:07:05.272943+0000","last_peered":"2023-09-12T16:07:05.272943+0000","last_clean":"2023-09-12T16:07:05.272943+0000","last_became_active":"2023-09-12T16:07:04.280409+0000","last_became_peered":"2023-09-12T16:07:04.280409+0000","last_unstale":"2023-09-12T16:07:05.272943+0000","last_undegraded":"2023-09-12T16:07:05.272943+0000","last_fullsized":"2023-09-12T16:07:05.272943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:41.622238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.264295+0000","last_change":"2023-09-12T16:06:59.239375+0000","last_active":"2023-09-12T16:07:04.264295+0000","last_peered":"2023-09-12T16:07:04.264295+0000","last_clean":"2023-09-12T16:07:04.264295+0000","last_became_active":"2023-09-12T16:06:59.239006+0000","last_became_peered":"2023-09-12T16:06:59.239006+0000","last_unstale":"2023-09-12T16:07:04.264295+0000","last_undegraded":"2023-09-12T16:07:04.264295+0000","last_fullsized":"2023-09-12T16:07:04.264295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:34:49.384742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257984+0000","last_change":"2023-09-12T16:07:00.235720+0000","last_active":"2023-09-12T16:07:04.257984+0000","last_peered":"2023-09-12T16:07:04.257984+0000","last_clean":"2023-09-12T16:07:04.257984+0000","last_became_active":"2023-09-12T16:07:00.235413+0000","last_became_peered":"2023-09-12T16:07:00.235413+0000","last_unstale":"2023-09-12T16:07:04.257984+0000","last_undegraded":"2023-09-12T16:07:04.257984+0000","last_fullsized":"2023-09-12T16:07:04.257984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:58.775088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.273910+0000","last_change":"2023-09-12T16:07:04.285511+0000","last_active":"2023-09-12T16:07:05.273910+0000","last_peered":"2023-09-12T16:07:05.273910+0000","last_clean":"2023-09-12T16:07:05.273910+0000","last_became_active":"2023-09-12T16:07:04.284941+0000","last_became_peered":"2023-09-12T16:07:04.284941+0000","last_unstale":"2023-09-12T16:07:05.273910+0000","last_undegraded":"2023-09-12T16:07:05.273910+0000","last_fullsized":"2023-09-12T16:07:05.273910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:36:31.932803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258379+0000","last_change":"2023-09-12T16:06:59.238189+0000","last_active":"2023-09-12T16:07:04.258379+0000","last_peered":"2023-09-12T16:07:04.258379+0000","last_clean":"2023-09-12T16:07:04.258379+0000","last_became_active":"2023-09-12T16:06:59.237927+0000","last_became_peered":"2023-09-12T16:06:59.237927+0000","last_unstale":"2023-09-12T16:07:04.258379+0000","last_undegraded":"2023-09-12T16:07:04.258379+0000","last_fullsized":"2023-09-12T16:07:04.258379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:05:48.783727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258852+0000","last_change":"2023-09-12T16:07:00.237348+0000","last_active":"2023-09-12T16:07:04.258852+0000","last_peered":"2023-09-12T16:07:04.258852+0000","last_clean":"2023-09-12T16:07:04.258852+0000","last_became_active":"2023-09-12T16:07:00.237064+0000","last_became_peered":"2023-09-12T16:07:00.237064+0000","last_unstale":"2023-09-12T16:07:04.258852+0000","last_undegraded":"2023-09-12T16:07:04.258852+0000","last_fullsized":"2023-09-12T16:07:04.258852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:46:52.188371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.873074+0000","last_change":"2023-09-12T16:07:04.623981+0000","last_active":"2023-09-12T16:07:05.873074+0000","last_peered":"2023-09-12T16:07:05.873074+0000","last_clean":"2023-09-12T16:07:05.873074+0000","last_became_active":"2023-09-12T16:07:04.623554+0000","last_became_peered":"2023-09-12T16:07:04.623554+0000","last_unstale":"2023-09-12T16:07:05.873074+0000","last_undegraded":"2023-09-12T16:07:05.873074+0000","last_fullsized":"2023-09-12T16:07:05.873074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:07:23.213336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262386+0000","last_change":"2023-09-12T16:06:59.231146+0000","last_active":"2023-09-12T16:07:04.262386+0000","last_peered":"2023-09-12T16:07:04.262386+0000","last_clean":"2023-09-12T16:07:04.262386+0000","last_became_active":"2023-09-12T16:06:59.230810+0000","last_became_peered":"2023-09-12T16:06:59.230810+0000","last_unstale":"2023-09-12T16:07:04.262386+0000","last_undegraded":"2023-09-12T16:07:04.262386+0000","last_fullsized":"2023-09-12T16:07:04.262386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:57:34.819094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251603+0000","last_change":"2023-09-12T16:07:00.240426+0000","last_active":"2023-09-12T16:07:04.251603+0000","last_peered":"2023-09-12T16:07:04.251603+0000","last_clean":"2023-09-12T16:07:04.251603+0000","last_became_active":"2023-09-12T16:07:00.240156+0000","last_became_peered":"2023-09-12T16:07:00.240156+0000","last_unstale":"2023-09-12T16:07:04.251603+0000","last_undegraded":"2023-09-12T16:07:04.251603+0000","last_fullsized":"2023-09-12T16:07:04.251603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:08:00.209264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.269958+0000","last_change":"2023-09-12T16:07:04.622076+0000","last_active":"2023-09-12T16:07:05.269958+0000","last_peered":"2023-09-12T16:07:05.269958+0000","last_clean":"2023-09-12T16:07:05.269958+0000","last_became_active":"2023-09-12T16:07:04.621688+0000","last_became_peered":"2023-09-12T16:07:04.621688+0000","last_unstale":"2023-09-12T16:07:05.269958+0000","last_undegraded":"2023-09-12T16:07:05.269958+0000","last_fullsized":"2023-09-12T16:07:05.269958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:14:22.302046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.265441+0000","last_change":"2023-09-12T16:06:59.240104+0000","last_active":"2023-09-12T16:07:04.265441+0000","last_peered":"2023-09-12T16:07:04.265441+0000","last_clean":"2023-09-12T16:07:04.265441+0000","last_became_active":"2023-09-12T16:06:59.239833+0000","last_became_peered":"2023-09-12T16:06:59.239833+0000","last_unstale":"2023-09-12T16:07:04.265441+0000","last_undegraded":"2023-09-12T16:07:04.265441+0000","last_fullsized":"2023-09-12T16:07:04.265441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:44:49.750579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262969+0000","last_change":"2023-09-12T16:07:00.243340+0000","last_active":"2023-09-12T16:07:04.262969+0000","last_peered":"2023-09-12T16:07:04.262969+0000","last_clean":"2023-09-12T16:07:04.262969+0000","last_became_active":"2023-09-12T16:07:00.243070+0000","last_became_peered":"2023-09-12T16:07:00.243070+0000","last_unstale":"2023-09-12T16:07:04.262969+0000","last_undegraded":"2023-09-12T16:07:04.262969+0000","last_fullsized":"2023-09-12T16:07:04.262969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:11:30.292559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.269916+0000","last_change":"2023-09-12T16:07:04.276182+0000","last_active":"2023-09-12T16:07:05.269916+0000","last_peered":"2023-09-12T16:07:05.269916+0000","last_clean":"2023-09-12T16:07:05.269916+0000","last_became_active":"2023-09-12T16:07:04.275578+0000","last_became_peered":"2023-09-12T16:07:04.275578+0000","last_unstale":"2023-09-12T16:07:05.269916+0000","last_undegraded":"2023-09-12T16:07:05.269916+0000","last_fullsized":"2023-09-12T16:07:05.269916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:40.671615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262877+0000","last_change":"2023-09-12T16:06:59.239648+0000","last_active":"2023-09-12T16:07:04.262877+0000","last_peered":"2023-09-12T16:07:04.262877+0000","last_clean":"2023-09-12T16:07:04.262877+0000","last_became_active":"2023-09-12T16:06:59.238170+0000","last_became_peered":"2023-09-12T16:06:59.238170+0000","last_unstale":"2023-09-12T16:07:04.262877+0000","last_undegraded":"2023-09-12T16:07:04.262877+0000","last_fullsized":"2023-09-12T16:07:04.262877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:53:19.847861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258027+0000","last_change":"2023-09-12T16:07:00.248255+0000","last_active":"2023-09-12T16:07:04.258027+0000","last_peered":"2023-09-12T16:07:04.258027+0000","last_clean":"2023-09-12T16:07:04.258027+0000","last_became_active":"2023-09-12T16:07:00.247645+0000","last_became_peered":"2023-09-12T16:07:00.247645+0000","last_unstale":"2023-09-12T16:07:04.258027+0000","last_undegraded":"2023-09-12T16:07:04.258027+0000","last_fullsized":"2023-09-12T16:07:04.258027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:08:00.209264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.873715+0000","last_change":"2023-09-12T16:07:04.272173+0000","last_active":"2023-09-12T16:07:05.873715+0000","last_peered":"2023-09-12T16:07:05.873715+0000","last_clean":"2023-09-12T16:07:05.873715+0000","last_became_active":"2023-09-12T16:07:04.271748+0000","last_became_peered":"2023-09-12T16:07:04.271748+0000","last_unstale":"2023-09-12T16:07:05.873715+0000","last_undegraded":"2023-09-12T16:07:05.873715+0000","last_fullsized":"2023-09-12T16:07:05.873715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:12:22.733151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.252189+0000","last_change":"2023-09-12T16:06:59.230783+0000","last_active":"2023-09-12T16:07:04.252189+0000","last_peered":"2023-09-12T16:07:04.252189+0000","last_clean":"2023-09-12T16:07:04.252189+0000","last_became_active":"2023-09-12T16:06:59.229319+0000","last_became_peered":"2023-09-12T16:06:59.229319+0000","last_unstale":"2023-09-12T16:07:04.252189+0000","last_undegraded":"2023-09-12T16:07:04.252189+0000","last_fullsized":"2023-09-12T16:07:04.252189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:09:05.056699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259921+0000","last_change":"2023-09-12T16:07:00.242166+0000","last_active":"2023-09-12T16:07:04.259921+0000","last_peered":"2023-09-12T16:07:04.259921+0000","last_clean":"2023-09-12T16:07:04.259921+0000","last_became_active":"2023-09-12T16:07:00.241914+0000","last_became_peered":"2023-09-12T16:07:00.241914+0000","last_unstale":"2023-09-12T16:07:04.259921+0000","last_undegraded":"2023-09-12T16:07:04.259921+0000","last_fullsized":"2023-09-12T16:07:04.259921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:09:09.625141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.871620+0000","last_change":"2023-09-12T16:07:04.275261+0000","last_active":"2023-09-12T16:07:05.871620+0000","last_peered":"2023-09-12T16:07:05.871620+0000","last_clean":"2023-09-12T16:07:05.871620+0000","last_became_active":"2023-09-12T16:07:04.274860+0000","last_became_peered":"2023-09-12T16:07:04.274860+0000","last_unstale":"2023-09-12T16:07:05.871620+0000","last_undegraded":"2023-09-12T16:07:05.871620+0000","last_fullsized":"2023-09-12T16:07:05.871620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:29:33.285508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:17.593597+0000","last_change":"2023-09-12T16:06:59.236346+0000","last_active":"2023-09-12T16:07:17.593597+0000","last_peered":"2023-09-12T16:07:17.593597+0000","last_clean":"2023-09-12T16:07:17.593597+0000","last_became_active":"2023-09-12T16:06:59.235979+0000","last_became_peered":"2023-09-12T16:06:59.235979+0000","last_unstale":"2023-09-12T16:07:17.593597+0000","last_undegraded":"2023-09-12T16:07:17.593597+0000","last_fullsized":"2023-09-12T16:07:17.593597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:06:29.925466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.617193+0000","last_change":"2023-09-12T16:07:00.246722+0000","last_active":"2023-09-12T16:07:04.617193+0000","last_peered":"2023-09-12T16:07:04.617193+0000","last_clean":"2023-09-12T16:07:04.617193+0000","last_became_active":"2023-09-12T16:07:00.246249+0000","last_became_peered":"2023-09-12T16:07:00.246249+0000","last_unstale":"2023-09-12T16:07:04.617193+0000","last_undegraded":"2023-09-12T16:07:04.617193+0000","last_fullsized":"2023-09-12T16:07:04.617193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:41:27.002114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872920+0000","last_change":"2023-09-12T16:07:04.624400+0000","last_active":"2023-09-12T16:07:05.872920+0000","last_peered":"2023-09-12T16:07:05.872920+0000","last_clean":"2023-09-12T16:07:05.872920+0000","last_became_active":"2023-09-12T16:07:04.623377+0000","last_became_peered":"2023-09-12T16:07:04.623377+0000","last_unstale":"2023-09-12T16:07:05.872920+0000","last_undegraded":"2023-09-12T16:07:05.872920+0000","last_fullsized":"2023-09-12T16:07:05.872920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:14:22.302046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258240+0000","last_change":"2023-09-12T16:06:59.235950+0000","last_active":"2023-09-12T16:07:04.258240+0000","last_peered":"2023-09-12T16:07:04.258240+0000","last_clean":"2023-09-12T16:07:04.258240+0000","last_became_active":"2023-09-12T16:06:59.235661+0000","last_became_peered":"2023-09-12T16:06:59.235661+0000","last_unstale":"2023-09-12T16:07:04.258240+0000","last_undegraded":"2023-09-12T16:07:04.258240+0000","last_fullsized":"2023-09-12T16:07:04.258240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:54:02.241554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257618+0000","last_change":"2023-09-12T16:07:00.246401+0000","last_active":"2023-09-12T16:07:04.257618+0000","last_peered":"2023-09-12T16:07:04.257618+0000","last_clean":"2023-09-12T16:07:04.257618+0000","last_became_active":"2023-09-12T16:07:00.246137+0000","last_became_peered":"2023-09-12T16:07:00.246137+0000","last_unstale":"2023-09-12T16:07:04.257618+0000","last_undegraded":"2023-09-12T16:07:04.257618+0000","last_fullsized":"2023-09-12T16:07:04.257618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:57:35.825213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.270749+0000","last_change":"2023-09-12T16:07:04.619237+0000","last_active":"2023-09-12T16:07:05.270749+0000","last_peered":"2023-09-12T16:07:05.270749+0000","last_clean":"2023-09-12T16:07:05.270749+0000","last_became_active":"2023-09-12T16:07:04.618830+0000","last_became_peered":"2023-09-12T16:07:04.618830+0000","last_unstale":"2023-09-12T16:07:05.270749+0000","last_undegraded":"2023-09-12T16:07:05.270749+0000","last_fullsized":"2023-09-12T16:07:05.270749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T16:16:29.162777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261955+0000","last_change":"2023-09-12T16:06:59.232841+0000","last_active":"2023-09-12T16:07:04.261955+0000","last_peered":"2023-09-12T16:07:04.261955+0000","last_clean":"2023-09-12T16:07:04.261955+0000","last_became_active":"2023-09-12T16:06:59.232536+0000","last_became_peered":"2023-09-12T16:06:59.232536+0000","last_unstale":"2023-09-12T16:07:04.261955+0000","last_undegraded":"2023-09-12T16:07:04.261955+0000","last_fullsized":"2023-09-12T16:07:04.261955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:46:51.182253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616294+0000","last_change":"2023-09-12T16:07:00.255342+0000","last_active":"2023-09-12T16:07:04.616294+0000","last_peered":"2023-09-12T16:07:04.616294+0000","last_clean":"2023-09-12T16:07:04.616294+0000","last_became_active":"2023-09-12T16:07:00.255010+0000","last_became_peered":"2023-09-12T16:07:00.255010+0000","last_unstale":"2023-09-12T16:07:04.616294+0000","last_undegraded":"2023-09-12T16:07:04.616294+0000","last_fullsized":"2023-09-12T16:07:04.616294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:45:15.386898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.270784+0000","last_change":"2023-09-12T16:07:04.622772+0000","last_active":"2023-09-12T16:07:05.270784+0000","last_peered":"2023-09-12T16:07:05.270784+0000","last_clean":"2023-09-12T16:07:05.270784+0000","last_became_active":"2023-09-12T16:07:04.622386+0000","last_became_peered":"2023-09-12T16:07:04.622386+0000","last_unstale":"2023-09-12T16:07:05.270784+0000","last_undegraded":"2023-09-12T16:07:05.270784+0000","last_fullsized":"2023-09-12T16:07:05.270784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:11:56.544503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.267852+0000","last_change":"2023-09-12T16:06:59.236957+0000","last_active":"2023-09-12T16:07:04.267852+0000","last_peered":"2023-09-12T16:07:04.267852+0000","last_clean":"2023-09-12T16:07:04.267852+0000","last_became_active":"2023-09-12T16:06:59.236675+0000","last_became_peered":"2023-09-12T16:06:59.236675+0000","last_unstale":"2023-09-12T16:07:04.267852+0000","last_undegraded":"2023-09-12T16:07:04.267852+0000","last_fullsized":"2023-09-12T16:07:04.267852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:09:08.619023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.264778+0000","last_change":"2023-09-12T16:07:00.239896+0000","last_active":"2023-09-12T16:07:04.264778+0000","last_peered":"2023-09-12T16:07:04.264778+0000","last_clean":"2023-09-12T16:07:04.264778+0000","last_became_active":"2023-09-12T16:07:00.239523+0000","last_became_peered":"2023-09-12T16:07:00.239523+0000","last_unstale":"2023-09-12T16:07:04.264778+0000","last_undegraded":"2023-09-12T16:07:04.264778+0000","last_fullsized":"2023-09-12T16:07:04.264778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:57:35.825213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872900+0000","last_change":"2023-09-12T16:07:04.276870+0000","last_active":"2023-09-12T16:07:05.872900+0000","last_peered":"2023-09-12T16:07:05.872900+0000","last_clean":"2023-09-12T16:07:05.872900+0000","last_became_active":"2023-09-12T16:07:04.276394+0000","last_became_peered":"2023-09-12T16:07:04.276394+0000","last_unstale":"2023-09-12T16:07:05.872900+0000","last_undegraded":"2023-09-12T16:07:05.872900+0000","last_fullsized":"2023-09-12T16:07:05.872900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:12:22.733151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259472+0000","last_change":"2023-09-12T16:06:59.233084+0000","last_active":"2023-09-12T16:07:04.259472+0000","last_peered":"2023-09-12T16:07:04.259472+0000","last_clean":"2023-09-12T16:07:04.259472+0000","last_became_active":"2023-09-12T16:06:59.232748+0000","last_became_peered":"2023-09-12T16:06:59.232748+0000","last_unstale":"2023-09-12T16:07:04.259472+0000","last_undegraded":"2023-09-12T16:07:04.259472+0000","last_fullsized":"2023-09-12T16:07:04.259472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:55:00.108889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616161+0000","last_change":"2023-09-12T16:07:00.245561+0000","last_active":"2023-09-12T16:07:04.616161+0000","last_peered":"2023-09-12T16:07:04.616161+0000","last_clean":"2023-09-12T16:07:04.616161+0000","last_became_active":"2023-09-12T16:07:00.245297+0000","last_became_peered":"2023-09-12T16:07:00.245297+0000","last_unstale":"2023-09-12T16:07:04.616161+0000","last_undegraded":"2023-09-12T16:07:04.616161+0000","last_fullsized":"2023-09-12T16:07:04.616161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:13:06.582191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872174+0000","last_change":"2023-09-12T16:07:04.276692+0000","last_active":"2023-09-12T16:07:05.872174+0000","last_peered":"2023-09-12T16:07:05.872174+0000","last_clean":"2023-09-12T16:07:05.872174+0000","last_became_active":"2023-09-12T16:07:04.276305+0000","last_became_peered":"2023-09-12T16:07:04.276305+0000","last_unstale":"2023-09-12T16:07:05.872174+0000","last_undegraded":"2023-09-12T16:07:05.872174+0000","last_fullsized":"2023-09-12T16:07:05.872174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:28:02.497121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.260584+0000","last_change":"2023-09-12T16:06:59.228623+0000","last_active":"2023-09-12T16:07:04.260584+0000","last_peered":"2023-09-12T16:07:04.260584+0000","last_clean":"2023-09-12T16:07:04.260584+0000","last_became_active":"2023-09-12T16:06:59.228249+0000","last_became_peered":"2023-09-12T16:06:59.228249+0000","last_unstale":"2023-09-12T16:07:04.260584+0000","last_undegraded":"2023-09-12T16:07:04.260584+0000","last_fullsized":"2023-09-12T16:07:04.260584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:49:47.563558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616629+0000","last_change":"2023-09-12T16:07:00.252935+0000","last_active":"2023-09-12T16:07:04.616629+0000","last_peered":"2023-09-12T16:07:04.616629+0000","last_clean":"2023-09-12T16:07:04.616629+0000","last_became_active":"2023-09-12T16:07:00.252647+0000","last_became_peered":"2023-09-12T16:07:00.252647+0000","last_unstale":"2023-09-12T16:07:04.616629+0000","last_undegraded":"2023-09-12T16:07:04.616629+0000","last_fullsized":"2023-09-12T16:07:04.616629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:31.336670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.871785+0000","last_change":"2023-09-12T16:07:04.270006+0000","last_active":"2023-09-12T16:07:05.871785+0000","last_peered":"2023-09-12T16:07:05.871785+0000","last_clean":"2023-09-12T16:07:05.871785+0000","last_became_active":"2023-09-12T16:07:04.269505+0000","last_became_peered":"2023-09-12T16:07:04.269505+0000","last_unstale":"2023-09-12T16:07:05.871785+0000","last_undegraded":"2023-09-12T16:07:05.871785+0000","last_fullsized":"2023-09-12T16:07:05.871785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:07:23.213336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251774+0000","last_change":"2023-09-12T16:06:59.234205+0000","last_active":"2023-09-12T16:07:04.251774+0000","last_peered":"2023-09-12T16:07:04.251774+0000","last_clean":"2023-09-12T16:07:04.251774+0000","last_became_active":"2023-09-12T16:06:59.233923+0000","last_became_peered":"2023-09-12T16:06:59.233923+0000","last_unstale":"2023-09-12T16:07:04.251774+0000","last_undegraded":"2023-09-12T16:07:04.251774+0000","last_fullsized":"2023-09-12T16:07:04.251774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:09:08.619023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262579+0000","last_change":"2023-09-12T16:07:00.242588+0000","last_active":"2023-09-12T16:07:04.262579+0000","last_peered":"2023-09-12T16:07:04.262579+0000","last_clean":"2023-09-12T16:07:04.262579+0000","last_became_active":"2023-09-12T16:07:00.242329+0000","last_became_peered":"2023-09-12T16:07:00.242329+0000","last_unstale":"2023-09-12T16:07:04.262579+0000","last_undegraded":"2023-09-12T16:07:04.262579+0000","last_fullsized":"2023-09-12T16:07:04.262579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:45:15.386898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.871795+0000","last_change":"2023-09-12T16:07:04.277502+0000","last_active":"2023-09-12T16:07:05.871795+0000","last_peered":"2023-09-12T16:07:05.871795+0000","last_clean":"2023-09-12T16:07:05.871795+0000","last_became_active":"2023-09-12T16:07:04.277124+0000","last_became_peered":"2023-09-12T16:07:04.277124+0000","last_unstale":"2023-09-12T16:07:05.871795+0000","last_undegraded":"2023-09-12T16:07:05.871795+0000","last_fullsized":"2023-09-12T16:07:05.871795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:08:08.942117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261852+0000","last_change":"2023-09-12T16:06:59.230496+0000","last_active":"2023-09-12T16:07:04.261852+0000","last_peered":"2023-09-12T16:07:04.261852+0000","last_clean":"2023-09-12T16:07:04.261852+0000","last_became_active":"2023-09-12T16:06:59.229861+0000","last_became_peered":"2023-09-12T16:06:59.229861+0000","last_unstale":"2023-09-12T16:07:04.261852+0000","last_undegraded":"2023-09-12T16:07:04.261852+0000","last_fullsized":"2023-09-12T16:07:04.261852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:36.576680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259685+0000","last_change":"2023-09-12T16:07:00.238162+0000","last_active":"2023-09-12T16:07:04.259685+0000","last_peered":"2023-09-12T16:07:04.259685+0000","last_clean":"2023-09-12T16:07:04.259685+0000","last_became_active":"2023-09-12T16:07:00.237811+0000","last_became_peered":"2023-09-12T16:07:00.237811+0000","last_unstale":"2023-09-12T16:07:04.259685+0000","last_undegraded":"2023-09-12T16:07:04.259685+0000","last_fullsized":"2023-09-12T16:07:04.259685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:53:29.565994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872588+0000","last_change":"2023-09-12T16:07:04.277513+0000","last_active":"2023-09-12T16:07:05.872588+0000","last_peered":"2023-09-12T16:07:05.872588+0000","last_clean":"2023-09-12T16:07:05.872588+0000","last_became_active":"2023-09-12T16:07:04.277127+0000","last_became_peered":"2023-09-12T16:07:04.277127+0000","last_unstale":"2023-09-12T16:07:05.872588+0000","last_undegraded":"2023-09-12T16:07:05.872588+0000","last_fullsized":"2023-09-12T16:07:05.872588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:35:14.402111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251417+0000","last_change":"2023-09-12T16:07:00.241609+0000","last_active":"2023-09-12T16:07:04.251417+0000","last_peered":"2023-09-12T16:07:04.251417+0000","last_clean":"2023-09-12T16:07:04.251417+0000","last_became_active":"2023-09-12T16:07:00.241320+0000","last_became_peered":"2023-09-12T16:07:00.241320+0000","last_unstale":"2023-09-12T16:07:04.251417+0000","last_undegraded":"2023-09-12T16:07:04.251417+0000","last_fullsized":"2023-09-12T16:07:04.251417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:58:37.106438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259080+0000","last_change":"2023-09-12T16:06:59.234032+0000","last_active":"2023-09-12T16:07:04.259080+0000","last_peered":"2023-09-12T16:07:04.259080+0000","last_clean":"2023-09-12T16:07:04.259080+0000","last_became_active":"2023-09-12T16:06:59.233608+0000","last_became_peered":"2023-09-12T16:06:59.233608+0000","last_unstale":"2023-09-12T16:07:04.259080+0000","last_undegraded":"2023-09-12T16:07:04.259080+0000","last_fullsized":"2023-09-12T16:07:04.259080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:02:44.404892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.273604+0000","last_change":"2023-09-12T16:07:04.619647+0000","last_active":"2023-09-12T16:07:05.273604+0000","last_peered":"2023-09-12T16:07:05.273604+0000","last_clean":"2023-09-12T16:07:05.273604+0000","last_became_active":"2023-09-12T16:07:04.618758+0000","last_became_peered":"2023-09-12T16:07:04.618758+0000","last_unstale":"2023-09-12T16:07:05.273604+0000","last_undegraded":"2023-09-12T16:07:05.273604+0000","last_fullsized":"2023-09-12T16:07:05.273604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:11:34.331999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257837+0000","last_change":"2023-09-12T16:07:00.247265+0000","last_active":"2023-09-12T16:07:04.257837+0000","last_peered":"2023-09-12T16:07:04.257837+0000","last_clean":"2023-09-12T16:07:04.257837+0000","last_became_active":"2023-09-12T16:07:00.246967+0000","last_became_peered":"2023-09-12T16:07:00.246967+0000","last_unstale":"2023-09-12T16:07:04.257837+0000","last_undegraded":"2023-09-12T16:07:04.257837+0000","last_fullsized":"2023-09-12T16:07:04.257837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:58:37.106438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261947+0000","last_change":"2023-09-12T16:06:59.232424+0000","last_active":"2023-09-12T16:07:04.261947+0000","last_peered":"2023-09-12T16:07:04.261947+0000","last_clean":"2023-09-12T16:07:04.261947+0000","last_became_active":"2023-09-12T16:06:59.232084+0000","last_became_peered":"2023-09-12T16:06:59.232084+0000","last_unstale":"2023-09-12T16:07:04.261947+0000","last_undegraded":"2023-09-12T16:07:04.261947+0000","last_fullsized":"2023-09-12T16:07:04.261947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:55:22.355102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.615901+0000","last_change":"2023-09-12T16:06:50.214088+0000","last_active":"2023-09-12T16:07:04.615901+0000","last_peered":"2023-09-12T16:07:04.615901+0000","last_clean":"2023-09-12T16:07:04.615901+0000","last_became_active":"2023-09-12T16:06:50.213622+0000","last_became_peered":"2023-09-12T16:06:50.213622+0000","last_unstale":"2023-09-12T16:07:04.615901+0000","last_undegraded":"2023-09-12T16:07:04.615901+0000","last_fullsized":"2023-09-12T16:07:04.615901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:49.077619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:49.077619+0000","last_clean_scrub_stamp":"2023-09-12T16:06:49.077619+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:18:36.870572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.873037+0000","last_change":"2023-09-12T16:07:04.619724+0000","last_active":"2023-09-12T16:07:05.873037+0000","last_peered":"2023-09-12T16:07:05.873037+0000","last_clean":"2023-09-12T16:07:05.873037+0000","last_became_active":"2023-09-12T16:07:04.619332+0000","last_became_peered":"2023-09-12T16:07:04.619332+0000","last_unstale":"2023-09-12T16:07:05.873037+0000","last_undegraded":"2023-09-12T16:07:05.873037+0000","last_fullsized":"2023-09-12T16:07:05.873037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:29:33.285508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257135+0000","last_change":"2023-09-12T16:07:00.235625+0000","last_active":"2023-09-12T16:07:04.257135+0000","last_peered":"2023-09-12T16:07:04.257135+0000","last_clean":"2023-09-12T16:07:04.257135+0000","last_became_active":"2023-09-12T16:07:00.235331+0000","last_became_peered":"2023-09-12T16:07:00.235331+0000","last_unstale":"2023-09-12T16:07:04.257135+0000","last_undegraded":"2023-09-12T16:07:04.257135+0000","last_fullsized":"2023-09-12T16:07:04.257135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:05:49.789846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616019+0000","last_change":"2023-09-12T16:06:59.235516+0000","last_active":"2023-09-12T16:07:04.616019+0000","last_peered":"2023-09-12T16:07:04.616019+0000","last_clean":"2023-09-12T16:07:04.616019+0000","last_became_active":"2023-09-12T16:06:59.235199+0000","last_became_peered":"2023-09-12T16:06:59.235199+0000","last_unstale":"2023-09-12T16:07:04.616019+0000","last_undegraded":"2023-09-12T16:07:04.616019+0000","last_fullsized":"2023-09-12T16:07:04.616019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:55:00.108889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872606+0000","last_change":"2023-09-12T16:07:04.619215+0000","last_active":"2023-09-12T16:07:05.872606+0000","last_peered":"2023-09-12T16:07:05.872606+0000","last_clean":"2023-09-12T16:07:05.872606+0000","last_became_active":"2023-09-12T16:07:04.618728+0000","last_became_peered":"2023-09-12T16:07:04.618728+0000","last_unstale":"2023-09-12T16:07:05.872606+0000","last_undegraded":"2023-09-12T16:07:05.872606+0000","last_fullsized":"2023-09-12T16:07:05.872606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:19:21.300414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616251+0000","last_change":"2023-09-12T16:06:59.243165+0000","last_active":"2023-09-12T16:07:04.616251+0000","last_peered":"2023-09-12T16:07:04.616251+0000","last_clean":"2023-09-12T16:07:04.616251+0000","last_became_active":"2023-09-12T16:06:59.242849+0000","last_became_peered":"2023-09-12T16:06:59.242849+0000","last_unstale":"2023-09-12T16:07:04.616251+0000","last_undegraded":"2023-09-12T16:07:04.616251+0000","last_fullsized":"2023-09-12T16:07:04.616251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:55:22.355102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251893+0000","last_change":"2023-09-12T16:07:00.246431+0000","last_active":"2023-09-12T16:07:04.251893+0000","last_peered":"2023-09-12T16:07:04.251893+0000","last_clean":"2023-09-12T16:07:04.251893+0000","last_became_active":"2023-09-12T16:07:00.246167+0000","last_became_peered":"2023-09-12T16:07:00.246167+0000","last_unstale":"2023-09-12T16:07:04.251893+0000","last_undegraded":"2023-09-12T16:07:04.251893+0000","last_fullsized":"2023-09-12T16:07:04.251893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:14:21.195478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.269732+0000","last_change":"2023-09-12T16:07:04.619600+0000","last_active":"2023-09-12T16:07:05.269732+0000","last_peered":"2023-09-12T16:07:05.269732+0000","last_clean":"2023-09-12T16:07:05.269732+0000","last_became_active":"2023-09-12T16:07:04.619212+0000","last_became_peered":"2023-09-12T16:07:04.619212+0000","last_unstale":"2023-09-12T16:07:05.269732+0000","last_undegraded":"2023-09-12T16:07:05.269732+0000","last_fullsized":"2023-09-12T16:07:05.269732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:35:14.402111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.200180+0000","last_change":"2023-09-12T16:06:59.238333+0000","last_active":"2023-09-12T16:07:05.200180+0000","last_peered":"2023-09-12T16:07:05.200180+0000","last_clean":"2023-09-12T16:07:05.200180+0000","last_became_active":"2023-09-12T16:06:59.237813+0000","last_became_peered":"2023-09-12T16:06:59.237813+0000","last_unstale":"2023-09-12T16:07:05.200180+0000","last_undegraded":"2023-09-12T16:07:05.200180+0000","last_fullsized":"2023-09-12T16:07:05.200180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:05:48.783727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261856+0000","last_change":"2023-09-12T16:07:00.243068+0000","last_active":"2023-09-12T16:07:04.261856+0000","last_peered":"2023-09-12T16:07:04.261856+0000","last_clean":"2023-09-12T16:07:04.261856+0000","last_became_active":"2023-09-12T16:07:00.242602+0000","last_became_peered":"2023-09-12T16:07:00.242602+0000","last_unstale":"2023-09-12T16:07:04.261856+0000","last_undegraded":"2023-09-12T16:07:04.261856+0000","last_fullsized":"2023-09-12T16:07:04.261856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:31.336670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872330+0000","last_change":"2023-09-12T16:07:04.619568+0000","last_active":"2023-09-12T16:07:05.872330+0000","last_peered":"2023-09-12T16:07:05.872330+0000","last_clean":"2023-09-12T16:07:05.872330+0000","last_became_active":"2023-09-12T16:07:04.619080+0000","last_became_peered":"2023-09-12T16:07:04.619080+0000","last_unstale":"2023-09-12T16:07:05.872330+0000","last_undegraded":"2023-09-12T16:07:05.872330+0000","last_fullsized":"2023-09-12T16:07:05.872330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:45:19.426338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.265308+0000","last_change":"2023-09-12T16:06:59.239587+0000","last_active":"2023-09-12T16:07:04.265308+0000","last_peered":"2023-09-12T16:07:04.265308+0000","last_clean":"2023-09-12T16:07:04.265308+0000","last_became_active":"2023-09-12T16:06:59.239216+0000","last_became_peered":"2023-09-12T16:06:59.239216+0000","last_unstale":"2023-09-12T16:07:04.265308+0000","last_undegraded":"2023-09-12T16:07:04.265308+0000","last_fullsized":"2023-09-12T16:07:04.265308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:53:28.559875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257463+0000","last_change":"2023-09-12T16:07:00.240585+0000","last_active":"2023-09-12T16:07:04.257463+0000","last_peered":"2023-09-12T16:07:04.257463+0000","last_clean":"2023-09-12T16:07:04.257463+0000","last_became_active":"2023-09-12T16:07:00.240323+0000","last_became_peered":"2023-09-12T16:07:00.240323+0000","last_unstale":"2023-09-12T16:07:04.257463+0000","last_undegraded":"2023-09-12T16:07:04.257463+0000","last_fullsized":"2023-09-12T16:07:04.257463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:55:23.361221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872379+0000","last_change":"2023-09-12T16:07:04.281034+0000","last_active":"2023-09-12T16:07:05.872379+0000","last_peered":"2023-09-12T16:07:05.872379+0000","last_clean":"2023-09-12T16:07:05.872379+0000","last_became_active":"2023-09-12T16:07:04.280525+0000","last_became_peered":"2023-09-12T16:07:04.280525+0000","last_unstale":"2023-09-12T16:07:05.872379+0000","last_undegraded":"2023-09-12T16:07:05.872379+0000","last_fullsized":"2023-09-12T16:07:05.872379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:42:29.239901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.615895+0000","last_change":"2023-09-12T16:06:59.236011+0000","last_active":"2023-09-12T16:07:04.615895+0000","last_peered":"2023-09-12T16:07:04.615895+0000","last_clean":"2023-09-12T16:07:04.615895+0000","last_became_active":"2023-09-12T16:06:59.235750+0000","last_became_peered":"2023-09-12T16:06:59.235750+0000","last_unstale":"2023-09-12T16:07:04.615895+0000","last_undegraded":"2023-09-12T16:07:04.615895+0000","last_fullsized":"2023-09-12T16:07:04.615895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:44:49.750579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259787+0000","last_change":"2023-09-12T16:07:00.232052+0000","last_active":"2023-09-12T16:07:04.259787+0000","last_peered":"2023-09-12T16:07:04.259787+0000","last_clean":"2023-09-12T16:07:04.259787+0000","last_became_active":"2023-09-12T16:07:00.231763+0000","last_became_peered":"2023-09-12T16:07:00.231763+0000","last_unstale":"2023-09-12T16:07:04.259787+0000","last_undegraded":"2023-09-12T16:07:04.259787+0000","last_fullsized":"2023-09-12T16:07:04.259787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:06:30.931584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872351+0000","last_change":"2023-09-12T16:07:04.619604+0000","last_active":"2023-09-12T16:07:05.872351+0000","last_peered":"2023-09-12T16:07:05.872351+0000","last_clean":"2023-09-12T16:07:05.872351+0000","last_became_active":"2023-09-12T16:07:04.619196+0000","last_became_peered":"2023-09-12T16:07:04.619196+0000","last_unstale":"2023-09-12T16:07:05.872351+0000","last_undegraded":"2023-09-12T16:07:05.872351+0000","last_fullsized":"2023-09-12T16:07:05.872351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:27:51.938138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251490+0000","last_change":"2023-09-12T16:06:59.235568+0000","last_active":"2023-09-12T16:07:04.251490+0000","last_peered":"2023-09-12T16:07:04.251490+0000","last_clean":"2023-09-12T16:07:04.251490+0000","last_became_active":"2023-09-12T16:06:59.235300+0000","last_became_peered":"2023-09-12T16:06:59.235300+0000","last_unstale":"2023-09-12T16:07:04.251490+0000","last_undegraded":"2023-09-12T16:07:04.251490+0000","last_fullsized":"2023-09-12T16:07:04.251490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:34:49.384742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258950+0000","last_change":"2023-09-12T16:07:00.244717+0000","last_active":"2023-09-12T16:07:04.258950+0000","last_peered":"2023-09-12T16:07:04.258950+0000","last_clean":"2023-09-12T16:07:04.258950+0000","last_became_active":"2023-09-12T16:07:00.244448+0000","last_became_peered":"2023-09-12T16:07:00.244448+0000","last_unstale":"2023-09-12T16:07:04.258950+0000","last_undegraded":"2023-09-12T16:07:04.258950+0000","last_fullsized":"2023-09-12T16:07:04.258950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:37.582798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872677+0000","last_change":"2023-09-12T16:07:04.280641+0000","last_active":"2023-09-12T16:07:05.872677+0000","last_peered":"2023-09-12T16:07:05.872677+0000","last_clean":"2023-09-12T16:07:05.872677+0000","last_became_active":"2023-09-12T16:07:04.280192+0000","last_became_peered":"2023-09-12T16:07:04.280192+0000","last_unstale":"2023-09-12T16:07:05.872677+0000","last_undegraded":"2023-09-12T16:07:05.872677+0000","last_fullsized":"2023-09-12T16:07:05.872677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:36:31.932803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.252402+0000","last_change":"2023-09-12T16:06:59.226827+0000","last_active":"2023-09-12T16:07:04.252402+0000","last_peered":"2023-09-12T16:07:04.252402+0000","last_clean":"2023-09-12T16:07:04.252402+0000","last_became_active":"2023-09-12T16:06:59.226354+0000","last_became_peered":"2023-09-12T16:06:59.226354+0000","last_unstale":"2023-09-12T16:07:04.252402+0000","last_undegraded":"2023-09-12T16:07:04.252402+0000","last_fullsized":"2023-09-12T16:07:04.252402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:57:34.819094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257528+0000","last_change":"2023-09-12T16:07:00.243653+0000","last_active":"2023-09-12T16:07:04.257528+0000","last_peered":"2023-09-12T16:07:04.257528+0000","last_clean":"2023-09-12T16:07:04.257528+0000","last_became_active":"2023-09-12T16:07:00.243093+0000","last_became_peered":"2023-09-12T16:07:00.243093+0000","last_unstale":"2023-09-12T16:07:04.257528+0000","last_undegraded":"2023-09-12T16:07:04.257528+0000","last_fullsized":"2023-09-12T16:07:04.257528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:58.775088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872439+0000","last_change":"2023-09-12T16:07:04.274627+0000","last_active":"2023-09-12T16:07:05.872439+0000","last_peered":"2023-09-12T16:07:05.872439+0000","last_clean":"2023-09-12T16:07:05.872439+0000","last_became_active":"2023-09-12T16:07:04.274161+0000","last_became_peered":"2023-09-12T16:07:04.274161+0000","last_unstale":"2023-09-12T16:07:05.872439+0000","last_undegraded":"2023-09-12T16:07:05.872439+0000","last_fullsized":"2023-09-12T16:07:05.872439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:11:34.331999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616307+0000","last_change":"2023-09-12T16:06:59.238849+0000","last_active":"2023-09-12T16:07:04.616307+0000","last_peered":"2023-09-12T16:07:04.616307+0000","last_clean":"2023-09-12T16:07:04.616307+0000","last_became_active":"2023-09-12T16:06:59.238511+0000","last_became_peered":"2023-09-12T16:06:59.238511+0000","last_unstale":"2023-09-12T16:07:04.616307+0000","last_undegraded":"2023-09-12T16:07:04.616307+0000","last_fullsized":"2023-09-12T16:07:04.616307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:09:05.056699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.266098+0000","last_change":"2023-09-12T16:07:00.236595+0000","last_active":"2023-09-12T16:07:04.266098+0000","last_peered":"2023-09-12T16:07:04.266098+0000","last_clean":"2023-09-12T16:07:04.266098+0000","last_became_active":"2023-09-12T16:07:00.236274+0000","last_became_peered":"2023-09-12T16:07:00.236274+0000","last_unstale":"2023-09-12T16:07:04.266098+0000","last_undegraded":"2023-09-12T16:07:04.266098+0000","last_fullsized":"2023-09-12T16:07:04.266098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:55:23.361221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.273966+0000","last_change":"2023-09-12T16:07:04.619296+0000","last_active":"2023-09-12T16:07:05.273966+0000","last_peered":"2023-09-12T16:07:05.273966+0000","last_clean":"2023-09-12T16:07:05.273966+0000","last_became_active":"2023-09-12T16:07:04.618720+0000","last_became_peered":"2023-09-12T16:07:04.618720+0000","last_unstale":"2023-09-12T16:07:05.273966+0000","last_undegraded":"2023-09-12T16:07:05.273966+0000","last_fullsized":"2023-09-12T16:07:05.273966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:45:19.426338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261342+0000","last_change":"2023-09-12T16:06:59.238054+0000","last_active":"2023-09-12T16:07:04.261342+0000","last_peered":"2023-09-12T16:07:04.261342+0000","last_clean":"2023-09-12T16:07:04.261342+0000","last_became_active":"2023-09-12T16:06:59.237786+0000","last_became_peered":"2023-09-12T16:06:59.237786+0000","last_unstale":"2023-09-12T16:07:04.261342+0000","last_undegraded":"2023-09-12T16:07:04.261342+0000","last_fullsized":"2023-09-12T16:07:04.261342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:49:47.563558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616530+0000","last_change":"2023-09-12T16:07:00.249587+0000","last_active":"2023-09-12T16:07:04.616530+0000","last_peered":"2023-09-12T16:07:04.616530+0000","last_clean":"2023-09-12T16:07:04.616530+0000","last_became_active":"2023-09-12T16:07:00.249288+0000","last_became_peered":"2023-09-12T16:07:00.249288+0000","last_unstale":"2023-09-12T16:07:04.616530+0000","last_undegraded":"2023-09-12T16:07:04.616530+0000","last_fullsized":"2023-09-12T16:07:04.616530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:36:27.893363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872455+0000","last_change":"2023-09-12T16:07:04.269929+0000","last_active":"2023-09-12T16:07:05.872455+0000","last_peered":"2023-09-12T16:07:05.872455+0000","last_clean":"2023-09-12T16:07:05.872455+0000","last_became_active":"2023-09-12T16:07:04.269553+0000","last_became_peered":"2023-09-12T16:07:04.269553+0000","last_unstale":"2023-09-12T16:07:05.872455+0000","last_undegraded":"2023-09-12T16:07:05.872455+0000","last_fullsized":"2023-09-12T16:07:05.872455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:42:29.239901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.252147+0000","last_change":"2023-09-12T16:06:59.222437+0000","last_active":"2023-09-12T16:07:04.252147+0000","last_peered":"2023-09-12T16:07:04.252147+0000","last_clean":"2023-09-12T16:07:04.252147+0000","last_became_active":"2023-09-12T16:06:59.222099+0000","last_became_peered":"2023-09-12T16:06:59.222099+0000","last_unstale":"2023-09-12T16:07:04.252147+0000","last_undegraded":"2023-09-12T16:07:04.252147+0000","last_fullsized":"2023-09-12T16:07:04.252147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:44:49.750579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262052+0000","last_change":"2023-09-12T16:07:00.246299+0000","last_active":"2023-09-12T16:07:04.262052+0000","last_peered":"2023-09-12T16:07:04.262052+0000","last_clean":"2023-09-12T16:07:04.262052+0000","last_became_active":"2023-09-12T16:07:00.245786+0000","last_became_peered":"2023-09-12T16:07:00.245786+0000","last_unstale":"2023-09-12T16:07:04.262052+0000","last_undegraded":"2023-09-12T16:07:04.262052+0000","last_fullsized":"2023-09-12T16:07:04.262052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:27:58.457682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.871863+0000","last_change":"2023-09-12T16:07:04.619216+0000","last_active":"2023-09-12T16:07:05.871863+0000","last_peered":"2023-09-12T16:07:05.871863+0000","last_clean":"2023-09-12T16:07:05.871863+0000","last_became_active":"2023-09-12T16:07:04.618772+0000","last_became_peered":"2023-09-12T16:07:04.618772+0000","last_unstale":"2023-09-12T16:07:05.871863+0000","last_undegraded":"2023-09-12T16:07:05.871863+0000","last_fullsized":"2023-09-12T16:07:05.871863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:40.671615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262737+0000","last_change":"2023-09-12T16:06:59.237315+0000","last_active":"2023-09-12T16:07:04.262737+0000","last_peered":"2023-09-12T16:07:04.262737+0000","last_clean":"2023-09-12T16:07:04.262737+0000","last_became_active":"2023-09-12T16:06:59.237042+0000","last_became_peered":"2023-09-12T16:06:59.237042+0000","last_unstale":"2023-09-12T16:07:04.262737+0000","last_undegraded":"2023-09-12T16:07:04.262737+0000","last_fullsized":"2023-09-12T16:07:04.262737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:34:01.502780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.617354+0000","last_change":"2023-09-12T16:07:00.252987+0000","last_active":"2023-09-12T16:07:04.617354+0000","last_peered":"2023-09-12T16:07:04.617354+0000","last_clean":"2023-09-12T16:07:04.617354+0000","last_became_active":"2023-09-12T16:07:00.252715+0000","last_became_peered":"2023-09-12T16:07:00.252715+0000","last_unstale":"2023-09-12T16:07:04.617354+0000","last_undegraded":"2023-09-12T16:07:04.617354+0000","last_fullsized":"2023-09-12T16:07:04.617354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:12:18.693711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.264873+0000","last_change":"2023-09-12T16:07:00.239692+0000","last_active":"2023-09-12T16:07:04.264873+0000","last_peered":"2023-09-12T16:07:04.264873+0000","last_clean":"2023-09-12T16:07:04.264873+0000","last_became_active":"2023-09-12T16:07:00.239382+0000","last_became_peered":"2023-09-12T16:07:00.239382+0000","last_unstale":"2023-09-12T16:07:04.264873+0000","last_undegraded":"2023-09-12T16:07:04.264873+0000","last_fullsized":"2023-09-12T16:07:04.264873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:58:37.106438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258921+0000","last_change":"2023-09-12T16:07:00.243624+0000","last_active":"2023-09-12T16:07:04.258921+0000","last_peered":"2023-09-12T16:07:04.258921+0000","last_clean":"2023-09-12T16:07:04.258921+0000","last_became_active":"2023-09-12T16:07:00.243363+0000","last_became_peered":"2023-09-12T16:07:00.243363+0000","last_unstale":"2023-09-12T16:07:04.258921+0000","last_undegraded":"2023-09-12T16:07:04.258921+0000","last_fullsized":"2023-09-12T16:07:04.258921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:06:30.931584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262048+0000","last_change":"2023-09-12T16:07:00.247135+0000","last_active":"2023-09-12T16:07:04.262048+0000","last_peered":"2023-09-12T16:07:04.262048+0000","last_clean":"2023-09-12T16:07:04.262048+0000","last_became_active":"2023-09-12T16:07:00.245531+0000","last_became_peered":"2023-09-12T16:07:00.245531+0000","last_unstale":"2023-09-12T16:07:04.262048+0000","last_undegraded":"2023-09-12T16:07:04.262048+0000","last_fullsized":"2023-09-12T16:07:04.262048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:12:18.693711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258068+0000","last_change":"2023-09-12T16:07:00.235877+0000","last_active":"2023-09-12T16:07:04.258068+0000","last_peered":"2023-09-12T16:07:04.258068+0000","last_clean":"2023-09-12T16:07:04.258068+0000","last_became_active":"2023-09-12T16:07:00.235463+0000","last_became_peered":"2023-09-12T16:07:00.235463+0000","last_unstale":"2023-09-12T16:07:04.258068+0000","last_undegraded":"2023-09-12T16:07:04.258068+0000","last_fullsized":"2023-09-12T16:07:04.258068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:14:21.195478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261764+0000","last_change":"2023-09-12T16:07:00.239178+0000","last_active":"2023-09-12T16:07:04.261764+0000","last_peered":"2023-09-12T16:07:04.261764+0000","last_clean":"2023-09-12T16:07:04.261764+0000","last_became_active":"2023-09-12T16:07:00.237641+0000","last_became_peered":"2023-09-12T16:07:00.237641+0000","last_unstale":"2023-09-12T16:07:04.261764+0000","last_undegraded":"2023-09-12T16:07:04.261764+0000","last_fullsized":"2023-09-12T16:07:04.261764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:08:00.209264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.252078+0000","last_change":"2023-09-12T16:07:00.240120+0000","last_active":"2023-09-12T16:07:04.252078+0000","last_peered":"2023-09-12T16:07:04.252078+0000","last_clean":"2023-09-12T16:07:04.252078+0000","last_became_active":"2023-09-12T16:07:00.239826+0000","last_became_peered":"2023-09-12T16:07:00.239826+0000","last_unstale":"2023-09-12T16:07:04.252078+0000","last_undegraded":"2023-09-12T16:07:04.252078+0000","last_fullsized":"2023-09-12T16:07:04.252078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:58.775088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.266947+0000","last_change":"2023-09-12T16:07:00.242920+0000","last_active":"2023-09-12T16:07:04.266947+0000","last_peered":"2023-09-12T16:07:04.266947+0000","last_clean":"2023-09-12T16:07:04.266947+0000","last_became_active":"2023-09-12T16:07:00.242640+0000","last_became_peered":"2023-09-12T16:07:00.242640+0000","last_unstale":"2023-09-12T16:07:04.266947+0000","last_undegraded":"2023-09-12T16:07:04.266947+0000","last_fullsized":"2023-09-12T16:07:04.266947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:46:52.188371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261946+0000","last_change":"2023-09-12T16:07:00.236628+0000","last_active":"2023-09-12T16:07:04.261946+0000","last_peered":"2023-09-12T16:07:04.261946+0000","last_clean":"2023-09-12T16:07:04.261946+0000","last_became_active":"2023-09-12T16:07:00.236285+0000","last_became_peered":"2023-09-12T16:07:00.236285+0000","last_unstale":"2023-09-12T16:07:04.261946+0000","last_undegraded":"2023-09-12T16:07:04.261946+0000","last_fullsized":"2023-09-12T16:07:04.261946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:38:37.389648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262483+0000","last_change":"2023-09-12T16:07:00.242101+0000","last_active":"2023-09-12T16:07:04.262483+0000","last_peered":"2023-09-12T16:07:04.262483+0000","last_clean":"2023-09-12T16:07:04.262483+0000","last_became_active":"2023-09-12T16:07:00.241617+0000","last_became_peered":"2023-09-12T16:07:00.241617+0000","last_unstale":"2023-09-12T16:07:04.262483+0000","last_undegraded":"2023-09-12T16:07:04.262483+0000","last_fullsized":"2023-09-12T16:07:04.262483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:13:06.582191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258456+0000","last_change":"2023-09-12T16:07:00.236987+0000","last_active":"2023-09-12T16:07:04.258456+0000","last_peered":"2023-09-12T16:07:04.258456+0000","last_clean":"2023-09-12T16:07:04.258456+0000","last_became_active":"2023-09-12T16:07:00.236642+0000","last_became_peered":"2023-09-12T16:07:00.236642+0000","last_unstale":"2023-09-12T16:07:04.258456+0000","last_undegraded":"2023-09-12T16:07:04.258456+0000","last_fullsized":"2023-09-12T16:07:04.258456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:53:20.853979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262134+0000","last_change":"2023-09-12T16:07:00.246004+0000","last_active":"2023-09-12T16:07:04.262134+0000","last_peered":"2023-09-12T16:07:04.262134+0000","last_clean":"2023-09-12T16:07:04.262134+0000","last_became_active":"2023-09-12T16:07:00.245625+0000","last_became_peered":"2023-09-12T16:07:00.245625+0000","last_unstale":"2023-09-12T16:07:04.262134+0000","last_undegraded":"2023-09-12T16:07:04.262134+0000","last_fullsized":"2023-09-12T16:07:04.262134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:19:17.260974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258148+0000","last_change":"2023-09-12T16:07:00.246340+0000","last_active":"2023-09-12T16:07:04.258148+0000","last_peered":"2023-09-12T16:07:04.258148+0000","last_clean":"2023-09-12T16:07:04.258148+0000","last_became_active":"2023-09-12T16:07:00.246060+0000","last_became_peered":"2023-09-12T16:07:00.246060+0000","last_unstale":"2023-09-12T16:07:04.258148+0000","last_undegraded":"2023-09-12T16:07:04.258148+0000","last_fullsized":"2023-09-12T16:07:04.258148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:58:37.106438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.266833+0000","last_change":"2023-09-12T16:07:00.238100+0000","last_active":"2023-09-12T16:07:04.266833+0000","last_peered":"2023-09-12T16:07:04.266833+0000","last_clean":"2023-09-12T16:07:04.266833+0000","last_became_active":"2023-09-12T16:07:00.237802+0000","last_became_peered":"2023-09-12T16:07:00.237802+0000","last_unstale":"2023-09-12T16:07:04.266833+0000","last_undegraded":"2023-09-12T16:07:04.266833+0000","last_fullsized":"2023-09-12T16:07:04.266833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:53:20.853979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":689767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-12T16:07:22.706 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-12T16:07:22.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.937+0000 7f9a957ff700 1 -- 172.21.15.112:0/1618626941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a9015f480 msgr2=0x7f9a900cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:22.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.937+0000 7f9a957ff700 1 --2- 172.21.15.112:0/1618626941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a9015f480 0x7f9a900cfe80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9a90089340 tx=0x7f9a80009c50 comp rx=0 tx=0).stop 2023-09-12T16:07:22.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.937+0000 7f9a957ff700 1 -- 172.21.15.112:0/1618626941 shutdown_connections 2023-09-12T16:07:22.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.937+0000 7f9a957ff700 1 --2- 172.21.15.112:0/1618626941 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a900b28f0 0x7f9a900c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.937+0000 7f9a957ff700 1 --2- 172.21.15.112:0/1618626941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a9015f480 0x7f9a900cfe80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.937+0000 7f9a957ff700 1 --2- 172.21.15.112:0/1618626941 >> v2:172.21.15.144:3300/0 conn(0x7f9a900cdfb0 0x7f9a900d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.937+0000 7f9a957ff700 1 -- 172.21.15.112:0/1618626941 >> 172.21.15.112:0/1618626941 conn(0x7f9a900d1930 msgr2=0x7f9a900d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:22.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.937+0000 7f9a957ff700 1 -- 172.21.15.112:0/1618626941 shutdown_connections 2023-09-12T16:07:22.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.937+0000 7f9a957ff700 1 -- 172.21.15.112:0/1618626941 wait complete. 2023-09-12T16:07:22.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.939+0000 7f9a957ff700 1 Processor -- start 2023-09-12T16:07:22.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.939+0000 7f9a957ff700 1 -- start start 2023-09-12T16:07:22.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.940+0000 7f9a957ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a900b28f0 0x7f9a900c4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:22.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.940+0000 7f9a957ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a900cdfb0 0x7f9a90158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:22.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.940+0000 7f9a957ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a9015f480 0x7f9a9015a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:22.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.940+0000 7f9a957ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9015a320 con 0x7f9a900b28f0 2023-09-12T16:07:22.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.940+0000 7f9a957ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a901591f0 con 0x7f9a9015f480 2023-09-12T16:07:22.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.940+0000 7f9a957ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a901594d0 con 0x7f9a900cdfb0 2023-09-12T16:07:22.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.940+0000 7f9a8effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a900b28f0 0x7f9a900c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:22.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.940+0000 7f9a8effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a900b28f0 0x7f9a900c4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50278/0 (socket says 172.21.15.112:50278) 2023-09-12T16:07:22.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.940+0000 7f9a8effd700 1 -- 172.21.15.112:0/3772388746 learned_addr learned my addr 172.21.15.112:0/3772388746 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:22.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.940+0000 7f9a8e7fc700 1 --2- 172.21.15.112:0/3772388746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a900cdfb0 0x7f9a90158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:22.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.940+0000 7f9a8f7fe700 1 --2- 172.21.15.112:0/3772388746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a9015f480 0x7f9a9015a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:22.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.941+0000 7f9a8effd700 1 -- 172.21.15.112:0/3772388746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a900cdfb0 msgr2=0x7f9a90158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:22.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.941+0000 7f9a8effd700 1 --2- 172.21.15.112:0/3772388746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a900cdfb0 0x7f9a90158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.941+0000 7f9a8effd700 1 -- 172.21.15.112:0/3772388746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a9015f480 msgr2=0x7f9a9015a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:22.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.941+0000 7f9a8effd700 1 --2- 172.21.15.112:0/3772388746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a9015f480 0x7f9a9015a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:22.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.941+0000 7f9a8effd700 1 -- 172.21.15.112:0/3772388746 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a80009580 con 0x7f9a900b28f0 2023-09-12T16:07:22.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.941+0000 7f9a8effd700 1 --2- 172.21.15.112:0/3772388746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a900b28f0 0x7f9a900c4680 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9a9008b1f0 tx=0x7f9a80019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:22.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.941+0000 7f9a777fe700 1 -- 172.21.15.112:0/3772388746 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8001e070 con 0x7f9a900b28f0 2023-09-12T16:07:22.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.941+0000 7f9a777fe700 1 -- 172.21.15.112:0/3772388746 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9a8000bed0 con 0x7f9a900b28f0 2023-09-12T16:07:22.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.941+0000 7f9a957ff700 1 -- 172.21.15.112:0/3772388746 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a901597b0 con 0x7f9a900b28f0 2023-09-12T16:07:22.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.941+0000 7f9a777fe700 1 -- 172.21.15.112:0/3772388746 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a80019c50 con 0x7f9a900b28f0 2023-09-12T16:07:22.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.941+0000 7f9a957ff700 1 -- 172.21.15.112:0/3772388746 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a90158d90 con 0x7f9a900b28f0 2023-09-12T16:07:22.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.943+0000 7f9a957ff700 1 -- 172.21.15.112:0/3772388746 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a9015a600 con 0x7f9a900b28f0 2023-09-12T16:07:22.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.943+0000 7f9a777fe700 1 -- 172.21.15.112:0/3772388746 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f9a8000f460 con 0x7f9a900b28f0 2023-09-12T16:07:22.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.944+0000 7f9a777fe700 1 --2- 172.21.15.112:0/3772388746 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9a7c06a580 0x7f9a7c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:22.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.944+0000 7f9a777fe700 1 -- 172.21.15.112:0/3772388746 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9a8008a450 con 0x7f9a900b28f0 2023-09-12T16:07:22.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.944+0000 7f9a8e7fc700 1 --2- 172.21.15.112:0/3772388746 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9a7c06a580 0x7f9a7c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:22.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.945+0000 7f9a8e7fc700 1 --2- 172.21.15.112:0/3772388746 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9a7c06a580 0x7f9a7c06ca40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9a901f51f0 tx=0x7f9a8400b410 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:22.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:22.948+0000 7f9a777fe700 1 -- 172.21.15.112:0/3772388746 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f9a80055770 con 0x7f9a900b28f0 2023-09-12T16:07:23.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.141+0000 7f9a957ff700 1 -- 172.21.15.112:0/3772388746 --> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9a9015a460 con 0x7f9a7c06a580 2023-09-12T16:07:23.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.150+0000 7f9a777fe700 1 -- 172.21.15.112:0/3772388746 <== mgr.4176 v2:172.21.15.112:6832/1000013333 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345260 (secure 0 0 0) 0x7f9a84015070 con 0x7f9a7c06a580 2023-09-12T16:07:23.155 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:23.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.155+0000 7f9a957ff700 1 -- 172.21.15.112:0/3772388746 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9a7c06a580 msgr2=0x7f9a7c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:23.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.155+0000 7f9a957ff700 1 --2- 172.21.15.112:0/3772388746 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9a7c06a580 0x7f9a7c06ca40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9a901f51f0 tx=0x7f9a8400b410 comp rx=0 tx=0).stop 2023-09-12T16:07:23.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.155+0000 7f9a957ff700 1 -- 172.21.15.112:0/3772388746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a900b28f0 msgr2=0x7f9a900c4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:23.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.155+0000 7f9a957ff700 1 --2- 172.21.15.112:0/3772388746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a900b28f0 0x7f9a900c4680 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9a9008b1f0 tx=0x7f9a80019690 comp rx=0 tx=0).stop 2023-09-12T16:07:23.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.155+0000 7f9a957ff700 1 -- 172.21.15.112:0/3772388746 shutdown_connections 2023-09-12T16:07:23.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.155+0000 7f9a957ff700 1 --2- 172.21.15.112:0/3772388746 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9a7c06a580 0x7f9a7c06ca40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:23.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.155+0000 7f9a957ff700 1 --2- 172.21.15.112:0/3772388746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a9015f480 0x7f9a9015a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:23.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.155+0000 7f9a957ff700 1 --2- 172.21.15.112:0/3772388746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a900b28f0 0x7f9a900c4680 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:23.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.155+0000 7f9a957ff700 1 --2- 172.21.15.112:0/3772388746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a900cdfb0 0x7f9a90158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:23.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.155+0000 7f9a957ff700 1 -- 172.21.15.112:0/3772388746 >> 172.21.15.112:0/3772388746 conn(0x7f9a900d1930 msgr2=0x7f9a900cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:23.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.155+0000 7f9a957ff700 1 -- 172.21.15.112:0/3772388746 shutdown_connections 2023-09-12T16:07:23.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.155+0000 7f9a957ff700 1 -- 172.21.15.112:0/3772388746 wait complete. 2023-09-12T16:07:23.160 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-09-12T16:07:23.166 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:07:23.170 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:07:23.173 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-09-12T16:07:22.818699+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219376,"kb_used_data":3204,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755344,"statfs":{"total":773094113280,"available":772869472256,"internally_reserved":0,"allocated":3280896,"data_stored":1987237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002816"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.617354+0000","last_change":"2023-09-12T16:07:00.253786+0000","last_active":"2023-09-12T16:07:04.617354+0000","last_peered":"2023-09-12T16:07:04.617354+0000","last_clean":"2023-09-12T16:07:04.617354+0000","last_became_active":"2023-09-12T16:07:00.251978+0000","last_became_peered":"2023-09-12T16:07:00.251978+0000","last_unstale":"2023-09-12T16:07:04.617354+0000","last_undegraded":"2023-09-12T16:07:04.617354+0000","last_fullsized":"2023-09-12T16:07:04.617354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:19:17.260974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251964+0000","last_change":"2023-09-12T16:07:00.245299+0000","last_active":"2023-09-12T16:07:04.251964+0000","last_peered":"2023-09-12T16:07:04.251964+0000","last_clean":"2023-09-12T16:07:04.251964+0000","last_became_active":"2023-09-12T16:07:00.245040+0000","last_became_peered":"2023-09-12T16:07:00.245040+0000","last_unstale":"2023-09-12T16:07:04.251964+0000","last_undegraded":"2023-09-12T16:07:04.251964+0000","last_fullsized":"2023-09-12T16:07:04.251964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:38:37.389648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257391+0000","last_change":"2023-09-12T16:07:00.219173+0000","last_active":"2023-09-12T16:07:04.257391+0000","last_peered":"2023-09-12T16:07:04.257391+0000","last_clean":"2023-09-12T16:07:04.257391+0000","last_became_active":"2023-09-12T16:07:00.218882+0000","last_became_peered":"2023-09-12T16:07:00.218882+0000","last_unstale":"2023-09-12T16:07:04.257391+0000","last_undegraded":"2023-09-12T16:07:04.257391+0000","last_fullsized":"2023-09-12T16:07:04.257391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:37.582798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262241+0000","last_change":"2023-09-12T16:07:00.246106+0000","last_active":"2023-09-12T16:07:04.262241+0000","last_peered":"2023-09-12T16:07:04.262241+0000","last_clean":"2023-09-12T16:07:04.262241+0000","last_became_active":"2023-09-12T16:07:00.245639+0000","last_became_peered":"2023-09-12T16:07:00.245639+0000","last_unstale":"2023-09-12T16:07:04.262241+0000","last_undegraded":"2023-09-12T16:07:04.262241+0000","last_fullsized":"2023-09-12T16:07:04.262241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:41:27.002114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616202+0000","last_change":"2023-09-12T16:07:00.246089+0000","last_active":"2023-09-12T16:07:04.616202+0000","last_peered":"2023-09-12T16:07:04.616202+0000","last_clean":"2023-09-12T16:07:04.616202+0000","last_became_active":"2023-09-12T16:07:00.245831+0000","last_became_peered":"2023-09-12T16:07:00.245831+0000","last_unstale":"2023-09-12T16:07:04.616202+0000","last_undegraded":"2023-09-12T16:07:04.616202+0000","last_fullsized":"2023-09-12T16:07:04.616202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:11:30.292559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262233+0000","last_change":"2023-09-12T16:07:00.246840+0000","last_active":"2023-09-12T16:07:04.262233+0000","last_peered":"2023-09-12T16:07:04.262233+0000","last_clean":"2023-09-12T16:07:04.262233+0000","last_became_active":"2023-09-12T16:07:00.246570+0000","last_became_peered":"2023-09-12T16:07:00.246570+0000","last_unstale":"2023-09-12T16:07:04.262233+0000","last_undegraded":"2023-09-12T16:07:04.262233+0000","last_fullsized":"2023-09-12T16:07:04.262233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:42:25.200461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616003+0000","last_change":"2023-09-12T16:07:00.251283+0000","last_active":"2023-09-12T16:07:04.616003+0000","last_peered":"2023-09-12T16:07:04.616003+0000","last_clean":"2023-09-12T16:07:04.616003+0000","last_became_active":"2023-09-12T16:07:00.250953+0000","last_became_peered":"2023-09-12T16:07:00.250953+0000","last_unstale":"2023-09-12T16:07:04.616003+0000","last_undegraded":"2023-09-12T16:07:04.616003+0000","last_fullsized":"2023-09-12T16:07:04.616003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:38:37.389648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259047+0000","last_change":"2023-09-12T16:07:00.247292+0000","last_active":"2023-09-12T16:07:04.259047+0000","last_peered":"2023-09-12T16:07:04.259047+0000","last_clean":"2023-09-12T16:07:04.259047+0000","last_became_active":"2023-09-12T16:07:00.246988+0000","last_became_peered":"2023-09-12T16:07:00.246988+0000","last_unstale":"2023-09-12T16:07:04.259047+0000","last_undegraded":"2023-09-12T16:07:04.259047+0000","last_fullsized":"2023-09-12T16:07:04.259047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:55:23.361221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.617248+0000","last_change":"2023-09-12T16:07:00.248892+0000","last_active":"2023-09-12T16:07:04.617248+0000","last_peered":"2023-09-12T16:07:04.617248+0000","last_clean":"2023-09-12T16:07:04.617248+0000","last_became_active":"2023-09-12T16:07:00.248600+0000","last_became_peered":"2023-09-12T16:07:00.248600+0000","last_unstale":"2023-09-12T16:07:04.617248+0000","last_undegraded":"2023-09-12T16:07:04.617248+0000","last_fullsized":"2023-09-12T16:07:04.617248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:42:25.200461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.266142+0000","last_change":"2023-09-12T16:07:00.247355+0000","last_active":"2023-09-12T16:07:04.266142+0000","last_peered":"2023-09-12T16:07:04.266142+0000","last_clean":"2023-09-12T16:07:04.266142+0000","last_became_active":"2023-09-12T16:07:00.247057+0000","last_became_peered":"2023-09-12T16:07:00.247057+0000","last_unstale":"2023-09-12T16:07:04.266142+0000","last_undegraded":"2023-09-12T16:07:04.266142+0000","last_fullsized":"2023-09-12T16:07:04.266142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:14:21.195478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.265053+0000","last_change":"2023-09-12T16:07:00.249260+0000","last_active":"2023-09-12T16:07:04.265053+0000","last_peered":"2023-09-12T16:07:04.265053+0000","last_clean":"2023-09-12T16:07:04.265053+0000","last_became_active":"2023-09-12T16:07:00.248927+0000","last_became_peered":"2023-09-12T16:07:00.248927+0000","last_unstale":"2023-09-12T16:07:04.265053+0000","last_undegraded":"2023-09-12T16:07:04.265053+0000","last_fullsized":"2023-09-12T16:07:04.265053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:37.582798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259993+0000","last_change":"2023-09-12T16:07:00.242778+0000","last_active":"2023-09-12T16:07:04.259993+0000","last_peered":"2023-09-12T16:07:04.259993+0000","last_clean":"2023-09-12T16:07:04.259993+0000","last_became_active":"2023-09-12T16:07:00.242486+0000","last_became_peered":"2023-09-12T16:07:00.242486+0000","last_unstale":"2023-09-12T16:07:04.259993+0000","last_undegraded":"2023-09-12T16:07:04.259993+0000","last_fullsized":"2023-09-12T16:07:04.259993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:44:50.756697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257289+0000","last_change":"2023-09-12T16:07:00.243909+0000","last_active":"2023-09-12T16:07:04.257289+0000","last_peered":"2023-09-12T16:07:04.257289+0000","last_clean":"2023-09-12T16:07:04.257289+0000","last_became_active":"2023-09-12T16:07:00.243407+0000","last_became_peered":"2023-09-12T16:07:00.243407+0000","last_unstale":"2023-09-12T16:07:04.257289+0000","last_undegraded":"2023-09-12T16:07:04.257289+0000","last_fullsized":"2023-09-12T16:07:04.257289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:14:21.195478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257539+0000","last_change":"2023-09-12T16:07:00.238637+0000","last_active":"2023-09-12T16:07:04.257539+0000","last_peered":"2023-09-12T16:07:04.257539+0000","last_clean":"2023-09-12T16:07:04.257539+0000","last_became_active":"2023-09-12T16:07:00.238391+0000","last_became_peered":"2023-09-12T16:07:00.238391+0000","last_unstale":"2023-09-12T16:07:04.257539+0000","last_undegraded":"2023-09-12T16:07:04.257539+0000","last_fullsized":"2023-09-12T16:07:04.257539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:53:20.853979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251492+0000","last_change":"2023-09-12T16:07:00.242098+0000","last_active":"2023-09-12T16:07:04.251492+0000","last_peered":"2023-09-12T16:07:04.251492+0000","last_clean":"2023-09-12T16:07:04.251492+0000","last_became_active":"2023-09-12T16:07:00.241773+0000","last_became_peered":"2023-09-12T16:07:00.241773+0000","last_unstale":"2023-09-12T16:07:04.251492+0000","last_undegraded":"2023-09-12T16:07:04.251492+0000","last_fullsized":"2023-09-12T16:07:04.251492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:53:20.853979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262541+0000","last_change":"2023-09-12T16:07:00.241891+0000","last_active":"2023-09-12T16:07:04.262541+0000","last_peered":"2023-09-12T16:07:04.262541+0000","last_clean":"2023-09-12T16:07:04.262541+0000","last_became_active":"2023-09-12T16:07:00.241300+0000","last_became_peered":"2023-09-12T16:07:00.241300+0000","last_unstale":"2023-09-12T16:07:04.262541+0000","last_undegraded":"2023-09-12T16:07:04.262541+0000","last_fullsized":"2023-09-12T16:07:04.262541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:58.775088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262201+0000","last_change":"2023-09-12T16:07:00.250157+0000","last_active":"2023-09-12T16:07:04.262201+0000","last_peered":"2023-09-12T16:07:04.262201+0000","last_clean":"2023-09-12T16:07:04.262201+0000","last_became_active":"2023-09-12T16:07:00.249481+0000","last_became_peered":"2023-09-12T16:07:00.249481+0000","last_unstale":"2023-09-12T16:07:04.262201+0000","last_undegraded":"2023-09-12T16:07:04.262201+0000","last_fullsized":"2023-09-12T16:07:04.262201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:31.336670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262823+0000","last_change":"2023-09-12T16:07:00.219775+0000","last_active":"2023-09-12T16:07:04.262823+0000","last_peered":"2023-09-12T16:07:04.262823+0000","last_clean":"2023-09-12T16:07:04.262823+0000","last_became_active":"2023-09-12T16:07:00.219459+0000","last_became_peered":"2023-09-12T16:07:00.219459+0000","last_unstale":"2023-09-12T16:07:04.262823+0000","last_undegraded":"2023-09-12T16:07:04.262823+0000","last_fullsized":"2023-09-12T16:07:04.262823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:53:29.565994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.617208+0000","last_change":"2023-09-12T16:07:00.246535+0000","last_active":"2023-09-12T16:07:04.617208+0000","last_peered":"2023-09-12T16:07:04.617208+0000","last_clean":"2023-09-12T16:07:04.617208+0000","last_became_active":"2023-09-12T16:07:00.245971+0000","last_became_peered":"2023-09-12T16:07:00.245971+0000","last_unstale":"2023-09-12T16:07:04.617208+0000","last_undegraded":"2023-09-12T16:07:04.617208+0000","last_fullsized":"2023-09-12T16:07:04.617208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:27:58.457682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.270033+0000","last_change":"2023-09-12T16:07:04.623483+0000","last_active":"2023-09-12T16:07:05.270033+0000","last_peered":"2023-09-12T16:07:05.270033+0000","last_clean":"2023-09-12T16:07:05.270033+0000","last_became_active":"2023-09-12T16:07:04.622859+0000","last_became_peered":"2023-09-12T16:07:04.622859+0000","last_unstale":"2023-09-12T16:07:05.270033+0000","last_undegraded":"2023-09-12T16:07:05.270033+0000","last_fullsized":"2023-09-12T16:07:05.270033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:13:05.956723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257878+0000","last_change":"2023-09-12T16:06:59.234835+0000","last_active":"2023-09-12T16:07:04.257878+0000","last_peered":"2023-09-12T16:07:04.257878+0000","last_clean":"2023-09-12T16:07:04.257878+0000","last_became_active":"2023-09-12T16:06:59.234575+0000","last_became_peered":"2023-09-12T16:06:59.234575+0000","last_unstale":"2023-09-12T16:07:04.257878+0000","last_undegraded":"2023-09-12T16:07:04.257878+0000","last_fullsized":"2023-09-12T16:07:04.257878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:53:28.559875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259666+0000","last_change":"2023-09-12T16:07:00.251627+0000","last_active":"2023-09-12T16:07:04.259666+0000","last_peered":"2023-09-12T16:07:04.259666+0000","last_clean":"2023-09-12T16:07:04.259666+0000","last_became_active":"2023-09-12T16:07:00.251369+0000","last_became_peered":"2023-09-12T16:07:00.251369+0000","last_unstale":"2023-09-12T16:07:04.259666+0000","last_undegraded":"2023-09-12T16:07:04.259666+0000","last_fullsized":"2023-09-12T16:07:04.259666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:13:06.582191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872052+0000","last_change":"2023-09-12T16:07:04.280718+0000","last_active":"2023-09-12T16:07:05.872052+0000","last_peered":"2023-09-12T16:07:05.872052+0000","last_clean":"2023-09-12T16:07:05.872052+0000","last_became_active":"2023-09-12T16:07:04.280197+0000","last_became_peered":"2023-09-12T16:07:04.280197+0000","last_unstale":"2023-09-12T16:07:05.872052+0000","last_undegraded":"2023-09-12T16:07:05.872052+0000","last_fullsized":"2023-09-12T16:07:05.872052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:35.376110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259751+0000","last_change":"2023-09-12T16:06:59.231242+0000","last_active":"2023-09-12T16:07:04.259751+0000","last_peered":"2023-09-12T16:07:04.259751+0000","last_clean":"2023-09-12T16:07:04.259751+0000","last_became_active":"2023-09-12T16:06:59.230937+0000","last_became_peered":"2023-09-12T16:06:59.230937+0000","last_unstale":"2023-09-12T16:07:04.259751+0000","last_undegraded":"2023-09-12T16:07:04.259751+0000","last_fullsized":"2023-09-12T16:07:04.259751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:09:05.056699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257787+0000","last_change":"2023-09-12T16:07:00.248417+0000","last_active":"2023-09-12T16:07:04.257787+0000","last_peered":"2023-09-12T16:07:04.257787+0000","last_clean":"2023-09-12T16:07:04.257787+0000","last_became_active":"2023-09-12T16:07:00.247991+0000","last_became_peered":"2023-09-12T16:07:00.247991+0000","last_unstale":"2023-09-12T16:07:04.257787+0000","last_undegraded":"2023-09-12T16:07:04.257787+0000","last_fullsized":"2023-09-12T16:07:04.257787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:46:52.188371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872328+0000","last_change":"2023-09-12T16:07:04.280463+0000","last_active":"2023-09-12T16:07:05.872328+0000","last_peered":"2023-09-12T16:07:05.872328+0000","last_clean":"2023-09-12T16:07:05.872328+0000","last_became_active":"2023-09-12T16:07:04.279988+0000","last_became_peered":"2023-09-12T16:07:04.279988+0000","last_unstale":"2023-09-12T16:07:05.872328+0000","last_undegraded":"2023-09-12T16:07:05.872328+0000","last_fullsized":"2023-09-12T16:07:05.872328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:41:31.041554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616494+0000","last_change":"2023-09-12T16:06:59.242596+0000","last_active":"2023-09-12T16:07:04.616494+0000","last_peered":"2023-09-12T16:07:04.616494+0000","last_clean":"2023-09-12T16:07:04.616494+0000","last_became_active":"2023-09-12T16:06:59.242307+0000","last_became_peered":"2023-09-12T16:06:59.242307+0000","last_unstale":"2023-09-12T16:07:04.616494+0000","last_undegraded":"2023-09-12T16:07:04.616494+0000","last_fullsized":"2023-09-12T16:07:04.616494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:36.576680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261954+0000","last_change":"2023-09-12T16:07:00.246505+0000","last_active":"2023-09-12T16:07:04.261954+0000","last_peered":"2023-09-12T16:07:04.261954+0000","last_clean":"2023-09-12T16:07:04.261954+0000","last_became_active":"2023-09-12T16:07:00.246205+0000","last_became_peered":"2023-09-12T16:07:00.246205+0000","last_unstale":"2023-09-12T16:07:04.261954+0000","last_undegraded":"2023-09-12T16:07:04.261954+0000","last_fullsized":"2023-09-12T16:07:04.261954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:38:37.389648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.873485+0000","last_change":"2023-09-12T16:07:04.280831+0000","last_active":"2023-09-12T16:07:05.873485+0000","last_peered":"2023-09-12T16:07:05.873485+0000","last_clean":"2023-09-12T16:07:05.873485+0000","last_became_active":"2023-09-12T16:07:04.280464+0000","last_became_peered":"2023-09-12T16:07:04.280464+0000","last_unstale":"2023-09-12T16:07:05.873485+0000","last_undegraded":"2023-09-12T16:07:05.873485+0000","last_fullsized":"2023-09-12T16:07:05.873485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:19:21.300414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616218+0000","last_change":"2023-09-12T16:06:59.241342+0000","last_active":"2023-09-12T16:07:04.616218+0000","last_peered":"2023-09-12T16:07:04.616218+0000","last_clean":"2023-09-12T16:07:04.616218+0000","last_became_active":"2023-09-12T16:06:59.241022+0000","last_became_peered":"2023-09-12T16:06:59.241022+0000","last_unstale":"2023-09-12T16:07:04.616218+0000","last_undegraded":"2023-09-12T16:07:04.616218+0000","last_fullsized":"2023-09-12T16:07:04.616218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:06:29.925466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262524+0000","last_change":"2023-09-12T16:07:00.244619+0000","last_active":"2023-09-12T16:07:04.262524+0000","last_peered":"2023-09-12T16:07:04.262524+0000","last_clean":"2023-09-12T16:07:04.262524+0000","last_became_active":"2023-09-12T16:07:00.244333+0000","last_became_peered":"2023-09-12T16:07:00.244333+0000","last_unstale":"2023-09-12T16:07:04.262524+0000","last_undegraded":"2023-09-12T16:07:04.262524+0000","last_fullsized":"2023-09-12T16:07:04.262524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:36:27.893363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.270612+0000","last_change":"2023-09-12T16:07:04.275913+0000","last_active":"2023-09-12T16:07:05.270612+0000","last_peered":"2023-09-12T16:07:05.270612+0000","last_clean":"2023-09-12T16:07:05.270612+0000","last_became_active":"2023-09-12T16:07:04.275487+0000","last_became_peered":"2023-09-12T16:07:04.275487+0000","last_unstale":"2023-09-12T16:07:05.270612+0000","last_undegraded":"2023-09-12T16:07:05.270612+0000","last_fullsized":"2023-09-12T16:07:05.270612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:09:51.094691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257445+0000","last_change":"2023-09-12T16:06:59.239289+0000","last_active":"2023-09-12T16:07:04.257445+0000","last_peered":"2023-09-12T16:07:04.257445+0000","last_clean":"2023-09-12T16:07:04.257445+0000","last_became_active":"2023-09-12T16:06:59.239069+0000","last_became_peered":"2023-09-12T16:06:59.239069+0000","last_unstale":"2023-09-12T16:07:04.257445+0000","last_undegraded":"2023-09-12T16:07:04.257445+0000","last_fullsized":"2023-09-12T16:07:04.257445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:09:08.619023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259404+0000","last_change":"2023-09-12T16:07:00.238894+0000","last_active":"2023-09-12T16:07:04.259404+0000","last_peered":"2023-09-12T16:07:04.259404+0000","last_clean":"2023-09-12T16:07:04.259404+0000","last_became_active":"2023-09-12T16:07:00.238601+0000","last_became_peered":"2023-09-12T16:07:00.238601+0000","last_unstale":"2023-09-12T16:07:04.259404+0000","last_undegraded":"2023-09-12T16:07:04.259404+0000","last_fullsized":"2023-09-12T16:07:04.259404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:34:50.390861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.272943+0000","last_change":"2023-09-12T16:07:04.280769+0000","last_active":"2023-09-12T16:07:05.272943+0000","last_peered":"2023-09-12T16:07:05.272943+0000","last_clean":"2023-09-12T16:07:05.272943+0000","last_became_active":"2023-09-12T16:07:04.280409+0000","last_became_peered":"2023-09-12T16:07:04.280409+0000","last_unstale":"2023-09-12T16:07:05.272943+0000","last_undegraded":"2023-09-12T16:07:05.272943+0000","last_fullsized":"2023-09-12T16:07:05.272943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:41.622238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.264295+0000","last_change":"2023-09-12T16:06:59.239375+0000","last_active":"2023-09-12T16:07:04.264295+0000","last_peered":"2023-09-12T16:07:04.264295+0000","last_clean":"2023-09-12T16:07:04.264295+0000","last_became_active":"2023-09-12T16:06:59.239006+0000","last_became_peered":"2023-09-12T16:06:59.239006+0000","last_unstale":"2023-09-12T16:07:04.264295+0000","last_undegraded":"2023-09-12T16:07:04.264295+0000","last_fullsized":"2023-09-12T16:07:04.264295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:34:49.384742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257984+0000","last_change":"2023-09-12T16:07:00.235720+0000","last_active":"2023-09-12T16:07:04.257984+0000","last_peered":"2023-09-12T16:07:04.257984+0000","last_clean":"2023-09-12T16:07:04.257984+0000","last_became_active":"2023-09-12T16:07:00.235413+0000","last_became_peered":"2023-09-12T16:07:00.235413+0000","last_unstale":"2023-09-12T16:07:04.257984+0000","last_undegraded":"2023-09-12T16:07:04.257984+0000","last_fullsized":"2023-09-12T16:07:04.257984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:58.775088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.273910+0000","last_change":"2023-09-12T16:07:04.285511+0000","last_active":"2023-09-12T16:07:05.273910+0000","last_peered":"2023-09-12T16:07:05.273910+0000","last_clean":"2023-09-12T16:07:05.273910+0000","last_became_active":"2023-09-12T16:07:04.284941+0000","last_became_peered":"2023-09-12T16:07:04.284941+0000","last_unstale":"2023-09-12T16:07:05.273910+0000","last_undegraded":"2023-09-12T16:07:05.273910+0000","last_fullsized":"2023-09-12T16:07:05.273910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:36:31.932803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258379+0000","last_change":"2023-09-12T16:06:59.238189+0000","last_active":"2023-09-12T16:07:04.258379+0000","last_peered":"2023-09-12T16:07:04.258379+0000","last_clean":"2023-09-12T16:07:04.258379+0000","last_became_active":"2023-09-12T16:06:59.237927+0000","last_became_peered":"2023-09-12T16:06:59.237927+0000","last_unstale":"2023-09-12T16:07:04.258379+0000","last_undegraded":"2023-09-12T16:07:04.258379+0000","last_fullsized":"2023-09-12T16:07:04.258379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:05:48.783727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258852+0000","last_change":"2023-09-12T16:07:00.237348+0000","last_active":"2023-09-12T16:07:04.258852+0000","last_peered":"2023-09-12T16:07:04.258852+0000","last_clean":"2023-09-12T16:07:04.258852+0000","last_became_active":"2023-09-12T16:07:00.237064+0000","last_became_peered":"2023-09-12T16:07:00.237064+0000","last_unstale":"2023-09-12T16:07:04.258852+0000","last_undegraded":"2023-09-12T16:07:04.258852+0000","last_fullsized":"2023-09-12T16:07:04.258852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:46:52.188371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.873074+0000","last_change":"2023-09-12T16:07:04.623981+0000","last_active":"2023-09-12T16:07:05.873074+0000","last_peered":"2023-09-12T16:07:05.873074+0000","last_clean":"2023-09-12T16:07:05.873074+0000","last_became_active":"2023-09-12T16:07:04.623554+0000","last_became_peered":"2023-09-12T16:07:04.623554+0000","last_unstale":"2023-09-12T16:07:05.873074+0000","last_undegraded":"2023-09-12T16:07:05.873074+0000","last_fullsized":"2023-09-12T16:07:05.873074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:07:23.213336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262386+0000","last_change":"2023-09-12T16:06:59.231146+0000","last_active":"2023-09-12T16:07:04.262386+0000","last_peered":"2023-09-12T16:07:04.262386+0000","last_clean":"2023-09-12T16:07:04.262386+0000","last_became_active":"2023-09-12T16:06:59.230810+0000","last_became_peered":"2023-09-12T16:06:59.230810+0000","last_unstale":"2023-09-12T16:07:04.262386+0000","last_undegraded":"2023-09-12T16:07:04.262386+0000","last_fullsized":"2023-09-12T16:07:04.262386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:57:34.819094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251603+0000","last_change":"2023-09-12T16:07:00.240426+0000","last_active":"2023-09-12T16:07:04.251603+0000","last_peered":"2023-09-12T16:07:04.251603+0000","last_clean":"2023-09-12T16:07:04.251603+0000","last_became_active":"2023-09-12T16:07:00.240156+0000","last_became_peered":"2023-09-12T16:07:00.240156+0000","last_unstale":"2023-09-12T16:07:04.251603+0000","last_undegraded":"2023-09-12T16:07:04.251603+0000","last_fullsized":"2023-09-12T16:07:04.251603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:08:00.209264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.269958+0000","last_change":"2023-09-12T16:07:04.622076+0000","last_active":"2023-09-12T16:07:05.269958+0000","last_peered":"2023-09-12T16:07:05.269958+0000","last_clean":"2023-09-12T16:07:05.269958+0000","last_became_active":"2023-09-12T16:07:04.621688+0000","last_became_peered":"2023-09-12T16:07:04.621688+0000","last_unstale":"2023-09-12T16:07:05.269958+0000","last_undegraded":"2023-09-12T16:07:05.269958+0000","last_fullsized":"2023-09-12T16:07:05.269958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:14:22.302046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.265441+0000","last_change":"2023-09-12T16:06:59.240104+0000","last_active":"2023-09-12T16:07:04.265441+0000","last_peered":"2023-09-12T16:07:04.265441+0000","last_clean":"2023-09-12T16:07:04.265441+0000","last_became_active":"2023-09-12T16:06:59.239833+0000","last_became_peered":"2023-09-12T16:06:59.239833+0000","last_unstale":"2023-09-12T16:07:04.265441+0000","last_undegraded":"2023-09-12T16:07:04.265441+0000","last_fullsized":"2023-09-12T16:07:04.265441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:44:49.750579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262969+0000","last_change":"2023-09-12T16:07:00.243340+0000","last_active":"2023-09-12T16:07:04.262969+0000","last_peered":"2023-09-12T16:07:04.262969+0000","last_clean":"2023-09-12T16:07:04.262969+0000","last_became_active":"2023-09-12T16:07:00.243070+0000","last_became_peered":"2023-09-12T16:07:00.243070+0000","last_unstale":"2023-09-12T16:07:04.262969+0000","last_undegraded":"2023-09-12T16:07:04.262969+0000","last_fullsized":"2023-09-12T16:07:04.262969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:11:30.292559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.269916+0000","last_change":"2023-09-12T16:07:04.276182+0000","last_active":"2023-09-12T16:07:05.269916+0000","last_peered":"2023-09-12T16:07:05.269916+0000","last_clean":"2023-09-12T16:07:05.269916+0000","last_became_active":"2023-09-12T16:07:04.275578+0000","last_became_peered":"2023-09-12T16:07:04.275578+0000","last_unstale":"2023-09-12T16:07:05.269916+0000","last_undegraded":"2023-09-12T16:07:05.269916+0000","last_fullsized":"2023-09-12T16:07:05.269916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:40.671615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262877+0000","last_change":"2023-09-12T16:06:59.239648+0000","last_active":"2023-09-12T16:07:04.262877+0000","last_peered":"2023-09-12T16:07:04.262877+0000","last_clean":"2023-09-12T16:07:04.262877+0000","last_became_active":"2023-09-12T16:06:59.238170+0000","last_became_peered":"2023-09-12T16:06:59.238170+0000","last_unstale":"2023-09-12T16:07:04.262877+0000","last_undegraded":"2023-09-12T16:07:04.262877+0000","last_fullsized":"2023-09-12T16:07:04.262877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:53:19.847861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258027+0000","last_change":"2023-09-12T16:07:00.248255+0000","last_active":"2023-09-12T16:07:04.258027+0000","last_peered":"2023-09-12T16:07:04.258027+0000","last_clean":"2023-09-12T16:07:04.258027+0000","last_became_active":"2023-09-12T16:07:00.247645+0000","last_became_peered":"2023-09-12T16:07:00.247645+0000","last_unstale":"2023-09-12T16:07:04.258027+0000","last_undegraded":"2023-09-12T16:07:04.258027+0000","last_fullsized":"2023-09-12T16:07:04.258027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:08:00.209264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.873715+0000","last_change":"2023-09-12T16:07:04.272173+0000","last_active":"2023-09-12T16:07:05.873715+0000","last_peered":"2023-09-12T16:07:05.873715+0000","last_clean":"2023-09-12T16:07:05.873715+0000","last_became_active":"2023-09-12T16:07:04.271748+0000","last_became_peered":"2023-09-12T16:07:04.271748+0000","last_unstale":"2023-09-12T16:07:05.873715+0000","last_undegraded":"2023-09-12T16:07:05.873715+0000","last_fullsized":"2023-09-12T16:07:05.873715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:12:22.733151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.252189+0000","last_change":"2023-09-12T16:06:59.230783+0000","last_active":"2023-09-12T16:07:04.252189+0000","last_peered":"2023-09-12T16:07:04.252189+0000","last_clean":"2023-09-12T16:07:04.252189+0000","last_became_active":"2023-09-12T16:06:59.229319+0000","last_became_peered":"2023-09-12T16:06:59.229319+0000","last_unstale":"2023-09-12T16:07:04.252189+0000","last_undegraded":"2023-09-12T16:07:04.252189+0000","last_fullsized":"2023-09-12T16:07:04.252189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:09:05.056699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259921+0000","last_change":"2023-09-12T16:07:00.242166+0000","last_active":"2023-09-12T16:07:04.259921+0000","last_peered":"2023-09-12T16:07:04.259921+0000","last_clean":"2023-09-12T16:07:04.259921+0000","last_became_active":"2023-09-12T16:07:00.241914+0000","last_became_peered":"2023-09-12T16:07:00.241914+0000","last_unstale":"2023-09-12T16:07:04.259921+0000","last_undegraded":"2023-09-12T16:07:04.259921+0000","last_fullsized":"2023-09-12T16:07:04.259921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:09:09.625141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.871620+0000","last_change":"2023-09-12T16:07:04.275261+0000","last_active":"2023-09-12T16:07:05.871620+0000","last_peered":"2023-09-12T16:07:05.871620+0000","last_clean":"2023-09-12T16:07:05.871620+0000","last_became_active":"2023-09-12T16:07:04.274860+0000","last_became_peered":"2023-09-12T16:07:04.274860+0000","last_unstale":"2023-09-12T16:07:05.871620+0000","last_undegraded":"2023-09-12T16:07:05.871620+0000","last_fullsized":"2023-09-12T16:07:05.871620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:29:33.285508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:17.593597+0000","last_change":"2023-09-12T16:06:59.236346+0000","last_active":"2023-09-12T16:07:17.593597+0000","last_peered":"2023-09-12T16:07:17.593597+0000","last_clean":"2023-09-12T16:07:17.593597+0000","last_became_active":"2023-09-12T16:06:59.235979+0000","last_became_peered":"2023-09-12T16:06:59.235979+0000","last_unstale":"2023-09-12T16:07:17.593597+0000","last_undegraded":"2023-09-12T16:07:17.593597+0000","last_fullsized":"2023-09-12T16:07:17.593597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:06:29.925466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.617193+0000","last_change":"2023-09-12T16:07:00.246722+0000","last_active":"2023-09-12T16:07:04.617193+0000","last_peered":"2023-09-12T16:07:04.617193+0000","last_clean":"2023-09-12T16:07:04.617193+0000","last_became_active":"2023-09-12T16:07:00.246249+0000","last_became_peered":"2023-09-12T16:07:00.246249+0000","last_unstale":"2023-09-12T16:07:04.617193+0000","last_undegraded":"2023-09-12T16:07:04.617193+0000","last_fullsized":"2023-09-12T16:07:04.617193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:41:27.002114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872920+0000","last_change":"2023-09-12T16:07:04.624400+0000","last_active":"2023-09-12T16:07:05.872920+0000","last_peered":"2023-09-12T16:07:05.872920+0000","last_clean":"2023-09-12T16:07:05.872920+0000","last_became_active":"2023-09-12T16:07:04.623377+0000","last_became_peered":"2023-09-12T16:07:04.623377+0000","last_unstale":"2023-09-12T16:07:05.872920+0000","last_undegraded":"2023-09-12T16:07:05.872920+0000","last_fullsized":"2023-09-12T16:07:05.872920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:14:22.302046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258240+0000","last_change":"2023-09-12T16:06:59.235950+0000","last_active":"2023-09-12T16:07:04.258240+0000","last_peered":"2023-09-12T16:07:04.258240+0000","last_clean":"2023-09-12T16:07:04.258240+0000","last_became_active":"2023-09-12T16:06:59.235661+0000","last_became_peered":"2023-09-12T16:06:59.235661+0000","last_unstale":"2023-09-12T16:07:04.258240+0000","last_undegraded":"2023-09-12T16:07:04.258240+0000","last_fullsized":"2023-09-12T16:07:04.258240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:54:02.241554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257618+0000","last_change":"2023-09-12T16:07:00.246401+0000","last_active":"2023-09-12T16:07:04.257618+0000","last_peered":"2023-09-12T16:07:04.257618+0000","last_clean":"2023-09-12T16:07:04.257618+0000","last_became_active":"2023-09-12T16:07:00.246137+0000","last_became_peered":"2023-09-12T16:07:00.246137+0000","last_unstale":"2023-09-12T16:07:04.257618+0000","last_undegraded":"2023-09-12T16:07:04.257618+0000","last_fullsized":"2023-09-12T16:07:04.257618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:57:35.825213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.270749+0000","last_change":"2023-09-12T16:07:04.619237+0000","last_active":"2023-09-12T16:07:05.270749+0000","last_peered":"2023-09-12T16:07:05.270749+0000","last_clean":"2023-09-12T16:07:05.270749+0000","last_became_active":"2023-09-12T16:07:04.618830+0000","last_became_peered":"2023-09-12T16:07:04.618830+0000","last_unstale":"2023-09-12T16:07:05.270749+0000","last_undegraded":"2023-09-12T16:07:05.270749+0000","last_fullsized":"2023-09-12T16:07:05.270749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T16:16:29.162777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261955+0000","last_change":"2023-09-12T16:06:59.232841+0000","last_active":"2023-09-12T16:07:04.261955+0000","last_peered":"2023-09-12T16:07:04.261955+0000","last_clean":"2023-09-12T16:07:04.261955+0000","last_became_active":"2023-09-12T16:06:59.232536+0000","last_became_peered":"2023-09-12T16:06:59.232536+0000","last_unstale":"2023-09-12T16:07:04.261955+0000","last_undegraded":"2023-09-12T16:07:04.261955+0000","last_fullsized":"2023-09-12T16:07:04.261955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:46:51.182253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616294+0000","last_change":"2023-09-12T16:07:00.255342+0000","last_active":"2023-09-12T16:07:04.616294+0000","last_peered":"2023-09-12T16:07:04.616294+0000","last_clean":"2023-09-12T16:07:04.616294+0000","last_became_active":"2023-09-12T16:07:00.255010+0000","last_became_peered":"2023-09-12T16:07:00.255010+0000","last_unstale":"2023-09-12T16:07:04.616294+0000","last_undegraded":"2023-09-12T16:07:04.616294+0000","last_fullsized":"2023-09-12T16:07:04.616294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:45:15.386898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.270784+0000","last_change":"2023-09-12T16:07:04.622772+0000","last_active":"2023-09-12T16:07:05.270784+0000","last_peered":"2023-09-12T16:07:05.270784+0000","last_clean":"2023-09-12T16:07:05.270784+0000","last_became_active":"2023-09-12T16:07:04.622386+0000","last_became_peered":"2023-09-12T16:07:04.622386+0000","last_unstale":"2023-09-12T16:07:05.270784+0000","last_undegraded":"2023-09-12T16:07:05.270784+0000","last_fullsized":"2023-09-12T16:07:05.270784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:11:56.544503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.267852+0000","last_change":"2023-09-12T16:06:59.236957+0000","last_active":"2023-09-12T16:07:04.267852+0000","last_peered":"2023-09-12T16:07:04.267852+0000","last_clean":"2023-09-12T16:07:04.267852+0000","last_became_active":"2023-09-12T16:06:59.236675+0000","last_became_peered":"2023-09-12T16:06:59.236675+0000","last_unstale":"2023-09-12T16:07:04.267852+0000","last_undegraded":"2023-09-12T16:07:04.267852+0000","last_fullsized":"2023-09-12T16:07:04.267852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:09:08.619023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.264778+0000","last_change":"2023-09-12T16:07:00.239896+0000","last_active":"2023-09-12T16:07:04.264778+0000","last_peered":"2023-09-12T16:07:04.264778+0000","last_clean":"2023-09-12T16:07:04.264778+0000","last_became_active":"2023-09-12T16:07:00.239523+0000","last_became_peered":"2023-09-12T16:07:00.239523+0000","last_unstale":"2023-09-12T16:07:04.264778+0000","last_undegraded":"2023-09-12T16:07:04.264778+0000","last_fullsized":"2023-09-12T16:07:04.264778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:57:35.825213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872900+0000","last_change":"2023-09-12T16:07:04.276870+0000","last_active":"2023-09-12T16:07:05.872900+0000","last_peered":"2023-09-12T16:07:05.872900+0000","last_clean":"2023-09-12T16:07:05.872900+0000","last_became_active":"2023-09-12T16:07:04.276394+0000","last_became_peered":"2023-09-12T16:07:04.276394+0000","last_unstale":"2023-09-12T16:07:05.872900+0000","last_undegraded":"2023-09-12T16:07:05.872900+0000","last_fullsized":"2023-09-12T16:07:05.872900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:12:22.733151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259472+0000","last_change":"2023-09-12T16:06:59.233084+0000","last_active":"2023-09-12T16:07:04.259472+0000","last_peered":"2023-09-12T16:07:04.259472+0000","last_clean":"2023-09-12T16:07:04.259472+0000","last_became_active":"2023-09-12T16:06:59.232748+0000","last_became_peered":"2023-09-12T16:06:59.232748+0000","last_unstale":"2023-09-12T16:07:04.259472+0000","last_undegraded":"2023-09-12T16:07:04.259472+0000","last_fullsized":"2023-09-12T16:07:04.259472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:55:00.108889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616161+0000","last_change":"2023-09-12T16:07:00.245561+0000","last_active":"2023-09-12T16:07:04.616161+0000","last_peered":"2023-09-12T16:07:04.616161+0000","last_clean":"2023-09-12T16:07:04.616161+0000","last_became_active":"2023-09-12T16:07:00.245297+0000","last_became_peered":"2023-09-12T16:07:00.245297+0000","last_unstale":"2023-09-12T16:07:04.616161+0000","last_undegraded":"2023-09-12T16:07:04.616161+0000","last_fullsized":"2023-09-12T16:07:04.616161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:13:06.582191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872174+0000","last_change":"2023-09-12T16:07:04.276692+0000","last_active":"2023-09-12T16:07:05.872174+0000","last_peered":"2023-09-12T16:07:05.872174+0000","last_clean":"2023-09-12T16:07:05.872174+0000","last_became_active":"2023-09-12T16:07:04.276305+0000","last_became_peered":"2023-09-12T16:07:04.276305+0000","last_unstale":"2023-09-12T16:07:05.872174+0000","last_undegraded":"2023-09-12T16:07:05.872174+0000","last_fullsized":"2023-09-12T16:07:05.872174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:28:02.497121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.260584+0000","last_change":"2023-09-12T16:06:59.228623+0000","last_active":"2023-09-12T16:07:04.260584+0000","last_peered":"2023-09-12T16:07:04.260584+0000","last_clean":"2023-09-12T16:07:04.260584+0000","last_became_active":"2023-09-12T16:06:59.228249+0000","last_became_peered":"2023-09-12T16:06:59.228249+0000","last_unstale":"2023-09-12T16:07:04.260584+0000","last_undegraded":"2023-09-12T16:07:04.260584+0000","last_fullsized":"2023-09-12T16:07:04.260584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:49:47.563558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616629+0000","last_change":"2023-09-12T16:07:00.252935+0000","last_active":"2023-09-12T16:07:04.616629+0000","last_peered":"2023-09-12T16:07:04.616629+0000","last_clean":"2023-09-12T16:07:04.616629+0000","last_became_active":"2023-09-12T16:07:00.252647+0000","last_became_peered":"2023-09-12T16:07:00.252647+0000","last_unstale":"2023-09-12T16:07:04.616629+0000","last_undegraded":"2023-09-12T16:07:04.616629+0000","last_fullsized":"2023-09-12T16:07:04.616629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:31.336670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.871785+0000","last_change":"2023-09-12T16:07:04.270006+0000","last_active":"2023-09-12T16:07:05.871785+0000","last_peered":"2023-09-12T16:07:05.871785+0000","last_clean":"2023-09-12T16:07:05.871785+0000","last_became_active":"2023-09-12T16:07:04.269505+0000","last_became_peered":"2023-09-12T16:07:04.269505+0000","last_unstale":"2023-09-12T16:07:05.871785+0000","last_undegraded":"2023-09-12T16:07:05.871785+0000","last_fullsized":"2023-09-12T16:07:05.871785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:07:23.213336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251774+0000","last_change":"2023-09-12T16:06:59.234205+0000","last_active":"2023-09-12T16:07:04.251774+0000","last_peered":"2023-09-12T16:07:04.251774+0000","last_clean":"2023-09-12T16:07:04.251774+0000","last_became_active":"2023-09-12T16:06:59.233923+0000","last_became_peered":"2023-09-12T16:06:59.233923+0000","last_unstale":"2023-09-12T16:07:04.251774+0000","last_undegraded":"2023-09-12T16:07:04.251774+0000","last_fullsized":"2023-09-12T16:07:04.251774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:09:08.619023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262579+0000","last_change":"2023-09-12T16:07:00.242588+0000","last_active":"2023-09-12T16:07:04.262579+0000","last_peered":"2023-09-12T16:07:04.262579+0000","last_clean":"2023-09-12T16:07:04.262579+0000","last_became_active":"2023-09-12T16:07:00.242329+0000","last_became_peered":"2023-09-12T16:07:00.242329+0000","last_unstale":"2023-09-12T16:07:04.262579+0000","last_undegraded":"2023-09-12T16:07:04.262579+0000","last_fullsized":"2023-09-12T16:07:04.262579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:45:15.386898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.871795+0000","last_change":"2023-09-12T16:07:04.277502+0000","last_active":"2023-09-12T16:07:05.871795+0000","last_peered":"2023-09-12T16:07:05.871795+0000","last_clean":"2023-09-12T16:07:05.871795+0000","last_became_active":"2023-09-12T16:07:04.277124+0000","last_became_peered":"2023-09-12T16:07:04.277124+0000","last_unstale":"2023-09-12T16:07:05.871795+0000","last_undegraded":"2023-09-12T16:07:05.871795+0000","last_fullsized":"2023-09-12T16:07:05.871795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:08:08.942117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261852+0000","last_change":"2023-09-12T16:06:59.230496+0000","last_active":"2023-09-12T16:07:04.261852+0000","last_peered":"2023-09-12T16:07:04.261852+0000","last_clean":"2023-09-12T16:07:04.261852+0000","last_became_active":"2023-09-12T16:06:59.229861+0000","last_became_peered":"2023-09-12T16:06:59.229861+0000","last_unstale":"2023-09-12T16:07:04.261852+0000","last_undegraded":"2023-09-12T16:07:04.261852+0000","last_fullsized":"2023-09-12T16:07:04.261852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:36.576680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259685+0000","last_change":"2023-09-12T16:07:00.238162+0000","last_active":"2023-09-12T16:07:04.259685+0000","last_peered":"2023-09-12T16:07:04.259685+0000","last_clean":"2023-09-12T16:07:04.259685+0000","last_became_active":"2023-09-12T16:07:00.237811+0000","last_became_peered":"2023-09-12T16:07:00.237811+0000","last_unstale":"2023-09-12T16:07:04.259685+0000","last_undegraded":"2023-09-12T16:07:04.259685+0000","last_fullsized":"2023-09-12T16:07:04.259685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:53:29.565994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872588+0000","last_change":"2023-09-12T16:07:04.277513+0000","last_active":"2023-09-12T16:07:05.872588+0000","last_peered":"2023-09-12T16:07:05.872588+0000","last_clean":"2023-09-12T16:07:05.872588+0000","last_became_active":"2023-09-12T16:07:04.277127+0000","last_became_peered":"2023-09-12T16:07:04.277127+0000","last_unstale":"2023-09-12T16:07:05.872588+0000","last_undegraded":"2023-09-12T16:07:05.872588+0000","last_fullsized":"2023-09-12T16:07:05.872588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:35:14.402111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251417+0000","last_change":"2023-09-12T16:07:00.241609+0000","last_active":"2023-09-12T16:07:04.251417+0000","last_peered":"2023-09-12T16:07:04.251417+0000","last_clean":"2023-09-12T16:07:04.251417+0000","last_became_active":"2023-09-12T16:07:00.241320+0000","last_became_peered":"2023-09-12T16:07:00.241320+0000","last_unstale":"2023-09-12T16:07:04.251417+0000","last_undegraded":"2023-09-12T16:07:04.251417+0000","last_fullsized":"2023-09-12T16:07:04.251417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:58:37.106438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259080+0000","last_change":"2023-09-12T16:06:59.234032+0000","last_active":"2023-09-12T16:07:04.259080+0000","last_peered":"2023-09-12T16:07:04.259080+0000","last_clean":"2023-09-12T16:07:04.259080+0000","last_became_active":"2023-09-12T16:06:59.233608+0000","last_became_peered":"2023-09-12T16:06:59.233608+0000","last_unstale":"2023-09-12T16:07:04.259080+0000","last_undegraded":"2023-09-12T16:07:04.259080+0000","last_fullsized":"2023-09-12T16:07:04.259080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:02:44.404892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.273604+0000","last_change":"2023-09-12T16:07:04.619647+0000","last_active":"2023-09-12T16:07:05.273604+0000","last_peered":"2023-09-12T16:07:05.273604+0000","last_clean":"2023-09-12T16:07:05.273604+0000","last_became_active":"2023-09-12T16:07:04.618758+0000","last_became_peered":"2023-09-12T16:07:04.618758+0000","last_unstale":"2023-09-12T16:07:05.273604+0000","last_undegraded":"2023-09-12T16:07:05.273604+0000","last_fullsized":"2023-09-12T16:07:05.273604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:11:34.331999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257837+0000","last_change":"2023-09-12T16:07:00.247265+0000","last_active":"2023-09-12T16:07:04.257837+0000","last_peered":"2023-09-12T16:07:04.257837+0000","last_clean":"2023-09-12T16:07:04.257837+0000","last_became_active":"2023-09-12T16:07:00.246967+0000","last_became_peered":"2023-09-12T16:07:00.246967+0000","last_unstale":"2023-09-12T16:07:04.257837+0000","last_undegraded":"2023-09-12T16:07:04.257837+0000","last_fullsized":"2023-09-12T16:07:04.257837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:58:37.106438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261947+0000","last_change":"2023-09-12T16:06:59.232424+0000","last_active":"2023-09-12T16:07:04.261947+0000","last_peered":"2023-09-12T16:07:04.261947+0000","last_clean":"2023-09-12T16:07:04.261947+0000","last_became_active":"2023-09-12T16:06:59.232084+0000","last_became_peered":"2023-09-12T16:06:59.232084+0000","last_unstale":"2023-09-12T16:07:04.261947+0000","last_undegraded":"2023-09-12T16:07:04.261947+0000","last_fullsized":"2023-09-12T16:07:04.261947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:55:22.355102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.615901+0000","last_change":"2023-09-12T16:06:50.214088+0000","last_active":"2023-09-12T16:07:04.615901+0000","last_peered":"2023-09-12T16:07:04.615901+0000","last_clean":"2023-09-12T16:07:04.615901+0000","last_became_active":"2023-09-12T16:06:50.213622+0000","last_became_peered":"2023-09-12T16:06:50.213622+0000","last_unstale":"2023-09-12T16:07:04.615901+0000","last_undegraded":"2023-09-12T16:07:04.615901+0000","last_fullsized":"2023-09-12T16:07:04.615901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:49.077619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:49.077619+0000","last_clean_scrub_stamp":"2023-09-12T16:06:49.077619+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:18:36.870572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.873037+0000","last_change":"2023-09-12T16:07:04.619724+0000","last_active":"2023-09-12T16:07:05.873037+0000","last_peered":"2023-09-12T16:07:05.873037+0000","last_clean":"2023-09-12T16:07:05.873037+0000","last_became_active":"2023-09-12T16:07:04.619332+0000","last_became_peered":"2023-09-12T16:07:04.619332+0000","last_unstale":"2023-09-12T16:07:05.873037+0000","last_undegraded":"2023-09-12T16:07:05.873037+0000","last_fullsized":"2023-09-12T16:07:05.873037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:29:33.285508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257135+0000","last_change":"2023-09-12T16:07:00.235625+0000","last_active":"2023-09-12T16:07:04.257135+0000","last_peered":"2023-09-12T16:07:04.257135+0000","last_clean":"2023-09-12T16:07:04.257135+0000","last_became_active":"2023-09-12T16:07:00.235331+0000","last_became_peered":"2023-09-12T16:07:00.235331+0000","last_unstale":"2023-09-12T16:07:04.257135+0000","last_undegraded":"2023-09-12T16:07:04.257135+0000","last_fullsized":"2023-09-12T16:07:04.257135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:05:49.789846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616019+0000","last_change":"2023-09-12T16:06:59.235516+0000","last_active":"2023-09-12T16:07:04.616019+0000","last_peered":"2023-09-12T16:07:04.616019+0000","last_clean":"2023-09-12T16:07:04.616019+0000","last_became_active":"2023-09-12T16:06:59.235199+0000","last_became_peered":"2023-09-12T16:06:59.235199+0000","last_unstale":"2023-09-12T16:07:04.616019+0000","last_undegraded":"2023-09-12T16:07:04.616019+0000","last_fullsized":"2023-09-12T16:07:04.616019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:55:00.108889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872606+0000","last_change":"2023-09-12T16:07:04.619215+0000","last_active":"2023-09-12T16:07:05.872606+0000","last_peered":"2023-09-12T16:07:05.872606+0000","last_clean":"2023-09-12T16:07:05.872606+0000","last_became_active":"2023-09-12T16:07:04.618728+0000","last_became_peered":"2023-09-12T16:07:04.618728+0000","last_unstale":"2023-09-12T16:07:05.872606+0000","last_undegraded":"2023-09-12T16:07:05.872606+0000","last_fullsized":"2023-09-12T16:07:05.872606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:19:21.300414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616251+0000","last_change":"2023-09-12T16:06:59.243165+0000","last_active":"2023-09-12T16:07:04.616251+0000","last_peered":"2023-09-12T16:07:04.616251+0000","last_clean":"2023-09-12T16:07:04.616251+0000","last_became_active":"2023-09-12T16:06:59.242849+0000","last_became_peered":"2023-09-12T16:06:59.242849+0000","last_unstale":"2023-09-12T16:07:04.616251+0000","last_undegraded":"2023-09-12T16:07:04.616251+0000","last_fullsized":"2023-09-12T16:07:04.616251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:55:22.355102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251893+0000","last_change":"2023-09-12T16:07:00.246431+0000","last_active":"2023-09-12T16:07:04.251893+0000","last_peered":"2023-09-12T16:07:04.251893+0000","last_clean":"2023-09-12T16:07:04.251893+0000","last_became_active":"2023-09-12T16:07:00.246167+0000","last_became_peered":"2023-09-12T16:07:00.246167+0000","last_unstale":"2023-09-12T16:07:04.251893+0000","last_undegraded":"2023-09-12T16:07:04.251893+0000","last_fullsized":"2023-09-12T16:07:04.251893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:14:21.195478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.269732+0000","last_change":"2023-09-12T16:07:04.619600+0000","last_active":"2023-09-12T16:07:05.269732+0000","last_peered":"2023-09-12T16:07:05.269732+0000","last_clean":"2023-09-12T16:07:05.269732+0000","last_became_active":"2023-09-12T16:07:04.619212+0000","last_became_peered":"2023-09-12T16:07:04.619212+0000","last_unstale":"2023-09-12T16:07:05.269732+0000","last_undegraded":"2023-09-12T16:07:05.269732+0000","last_fullsized":"2023-09-12T16:07:05.269732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:35:14.402111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.200180+0000","last_change":"2023-09-12T16:06:59.238333+0000","last_active":"2023-09-12T16:07:05.200180+0000","last_peered":"2023-09-12T16:07:05.200180+0000","last_clean":"2023-09-12T16:07:05.200180+0000","last_became_active":"2023-09-12T16:06:59.237813+0000","last_became_peered":"2023-09-12T16:06:59.237813+0000","last_unstale":"2023-09-12T16:07:05.200180+0000","last_undegraded":"2023-09-12T16:07:05.200180+0000","last_fullsized":"2023-09-12T16:07:05.200180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:05:48.783727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261856+0000","last_change":"2023-09-12T16:07:00.243068+0000","last_active":"2023-09-12T16:07:04.261856+0000","last_peered":"2023-09-12T16:07:04.261856+0000","last_clean":"2023-09-12T16:07:04.261856+0000","last_became_active":"2023-09-12T16:07:00.242602+0000","last_became_peered":"2023-09-12T16:07:00.242602+0000","last_unstale":"2023-09-12T16:07:04.261856+0000","last_undegraded":"2023-09-12T16:07:04.261856+0000","last_fullsized":"2023-09-12T16:07:04.261856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:31.336670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872330+0000","last_change":"2023-09-12T16:07:04.619568+0000","last_active":"2023-09-12T16:07:05.872330+0000","last_peered":"2023-09-12T16:07:05.872330+0000","last_clean":"2023-09-12T16:07:05.872330+0000","last_became_active":"2023-09-12T16:07:04.619080+0000","last_became_peered":"2023-09-12T16:07:04.619080+0000","last_unstale":"2023-09-12T16:07:05.872330+0000","last_undegraded":"2023-09-12T16:07:05.872330+0000","last_fullsized":"2023-09-12T16:07:05.872330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:45:19.426338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.265308+0000","last_change":"2023-09-12T16:06:59.239587+0000","last_active":"2023-09-12T16:07:04.265308+0000","last_peered":"2023-09-12T16:07:04.265308+0000","last_clean":"2023-09-12T16:07:04.265308+0000","last_became_active":"2023-09-12T16:06:59.239216+0000","last_became_peered":"2023-09-12T16:06:59.239216+0000","last_unstale":"2023-09-12T16:07:04.265308+0000","last_undegraded":"2023-09-12T16:07:04.265308+0000","last_fullsized":"2023-09-12T16:07:04.265308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:53:28.559875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257463+0000","last_change":"2023-09-12T16:07:00.240585+0000","last_active":"2023-09-12T16:07:04.257463+0000","last_peered":"2023-09-12T16:07:04.257463+0000","last_clean":"2023-09-12T16:07:04.257463+0000","last_became_active":"2023-09-12T16:07:00.240323+0000","last_became_peered":"2023-09-12T16:07:00.240323+0000","last_unstale":"2023-09-12T16:07:04.257463+0000","last_undegraded":"2023-09-12T16:07:04.257463+0000","last_fullsized":"2023-09-12T16:07:04.257463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:55:23.361221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872379+0000","last_change":"2023-09-12T16:07:04.281034+0000","last_active":"2023-09-12T16:07:05.872379+0000","last_peered":"2023-09-12T16:07:05.872379+0000","last_clean":"2023-09-12T16:07:05.872379+0000","last_became_active":"2023-09-12T16:07:04.280525+0000","last_became_peered":"2023-09-12T16:07:04.280525+0000","last_unstale":"2023-09-12T16:07:05.872379+0000","last_undegraded":"2023-09-12T16:07:05.872379+0000","last_fullsized":"2023-09-12T16:07:05.872379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:42:29.239901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.615895+0000","last_change":"2023-09-12T16:06:59.236011+0000","last_active":"2023-09-12T16:07:04.615895+0000","last_peered":"2023-09-12T16:07:04.615895+0000","last_clean":"2023-09-12T16:07:04.615895+0000","last_became_active":"2023-09-12T16:06:59.235750+0000","last_became_peered":"2023-09-12T16:06:59.235750+0000","last_unstale":"2023-09-12T16:07:04.615895+0000","last_undegraded":"2023-09-12T16:07:04.615895+0000","last_fullsized":"2023-09-12T16:07:04.615895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:44:49.750579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259787+0000","last_change":"2023-09-12T16:07:00.232052+0000","last_active":"2023-09-12T16:07:04.259787+0000","last_peered":"2023-09-12T16:07:04.259787+0000","last_clean":"2023-09-12T16:07:04.259787+0000","last_became_active":"2023-09-12T16:07:00.231763+0000","last_became_peered":"2023-09-12T16:07:00.231763+0000","last_unstale":"2023-09-12T16:07:04.259787+0000","last_undegraded":"2023-09-12T16:07:04.259787+0000","last_fullsized":"2023-09-12T16:07:04.259787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:06:30.931584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872351+0000","last_change":"2023-09-12T16:07:04.619604+0000","last_active":"2023-09-12T16:07:05.872351+0000","last_peered":"2023-09-12T16:07:05.872351+0000","last_clean":"2023-09-12T16:07:05.872351+0000","last_became_active":"2023-09-12T16:07:04.619196+0000","last_became_peered":"2023-09-12T16:07:04.619196+0000","last_unstale":"2023-09-12T16:07:05.872351+0000","last_undegraded":"2023-09-12T16:07:05.872351+0000","last_fullsized":"2023-09-12T16:07:05.872351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:27:51.938138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251490+0000","last_change":"2023-09-12T16:06:59.235568+0000","last_active":"2023-09-12T16:07:04.251490+0000","last_peered":"2023-09-12T16:07:04.251490+0000","last_clean":"2023-09-12T16:07:04.251490+0000","last_became_active":"2023-09-12T16:06:59.235300+0000","last_became_peered":"2023-09-12T16:06:59.235300+0000","last_unstale":"2023-09-12T16:07:04.251490+0000","last_undegraded":"2023-09-12T16:07:04.251490+0000","last_fullsized":"2023-09-12T16:07:04.251490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:34:49.384742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258950+0000","last_change":"2023-09-12T16:07:00.244717+0000","last_active":"2023-09-12T16:07:04.258950+0000","last_peered":"2023-09-12T16:07:04.258950+0000","last_clean":"2023-09-12T16:07:04.258950+0000","last_became_active":"2023-09-12T16:07:00.244448+0000","last_became_peered":"2023-09-12T16:07:00.244448+0000","last_unstale":"2023-09-12T16:07:04.258950+0000","last_undegraded":"2023-09-12T16:07:04.258950+0000","last_fullsized":"2023-09-12T16:07:04.258950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:37.582798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872677+0000","last_change":"2023-09-12T16:07:04.280641+0000","last_active":"2023-09-12T16:07:05.872677+0000","last_peered":"2023-09-12T16:07:05.872677+0000","last_clean":"2023-09-12T16:07:05.872677+0000","last_became_active":"2023-09-12T16:07:04.280192+0000","last_became_peered":"2023-09-12T16:07:04.280192+0000","last_unstale":"2023-09-12T16:07:05.872677+0000","last_undegraded":"2023-09-12T16:07:05.872677+0000","last_fullsized":"2023-09-12T16:07:05.872677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:36:31.932803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.252402+0000","last_change":"2023-09-12T16:06:59.226827+0000","last_active":"2023-09-12T16:07:04.252402+0000","last_peered":"2023-09-12T16:07:04.252402+0000","last_clean":"2023-09-12T16:07:04.252402+0000","last_became_active":"2023-09-12T16:06:59.226354+0000","last_became_peered":"2023-09-12T16:06:59.226354+0000","last_unstale":"2023-09-12T16:07:04.252402+0000","last_undegraded":"2023-09-12T16:07:04.252402+0000","last_fullsized":"2023-09-12T16:07:04.252402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:57:34.819094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257528+0000","last_change":"2023-09-12T16:07:00.243653+0000","last_active":"2023-09-12T16:07:04.257528+0000","last_peered":"2023-09-12T16:07:04.257528+0000","last_clean":"2023-09-12T16:07:04.257528+0000","last_became_active":"2023-09-12T16:07:00.243093+0000","last_became_peered":"2023-09-12T16:07:00.243093+0000","last_unstale":"2023-09-12T16:07:04.257528+0000","last_undegraded":"2023-09-12T16:07:04.257528+0000","last_fullsized":"2023-09-12T16:07:04.257528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:58.775088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872439+0000","last_change":"2023-09-12T16:07:04.274627+0000","last_active":"2023-09-12T16:07:05.872439+0000","last_peered":"2023-09-12T16:07:05.872439+0000","last_clean":"2023-09-12T16:07:05.872439+0000","last_became_active":"2023-09-12T16:07:04.274161+0000","last_became_peered":"2023-09-12T16:07:04.274161+0000","last_unstale":"2023-09-12T16:07:05.872439+0000","last_undegraded":"2023-09-12T16:07:05.872439+0000","last_fullsized":"2023-09-12T16:07:05.872439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:11:34.331999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616307+0000","last_change":"2023-09-12T16:06:59.238849+0000","last_active":"2023-09-12T16:07:04.616307+0000","last_peered":"2023-09-12T16:07:04.616307+0000","last_clean":"2023-09-12T16:07:04.616307+0000","last_became_active":"2023-09-12T16:06:59.238511+0000","last_became_peered":"2023-09-12T16:06:59.238511+0000","last_unstale":"2023-09-12T16:07:04.616307+0000","last_undegraded":"2023-09-12T16:07:04.616307+0000","last_fullsized":"2023-09-12T16:07:04.616307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:09:05.056699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.266098+0000","last_change":"2023-09-12T16:07:00.236595+0000","last_active":"2023-09-12T16:07:04.266098+0000","last_peered":"2023-09-12T16:07:04.266098+0000","last_clean":"2023-09-12T16:07:04.266098+0000","last_became_active":"2023-09-12T16:07:00.236274+0000","last_became_peered":"2023-09-12T16:07:00.236274+0000","last_unstale":"2023-09-12T16:07:04.266098+0000","last_undegraded":"2023-09-12T16:07:04.266098+0000","last_fullsized":"2023-09-12T16:07:04.266098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:55:23.361221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.273966+0000","last_change":"2023-09-12T16:07:04.619296+0000","last_active":"2023-09-12T16:07:05.273966+0000","last_peered":"2023-09-12T16:07:05.273966+0000","last_clean":"2023-09-12T16:07:05.273966+0000","last_became_active":"2023-09-12T16:07:04.618720+0000","last_became_peered":"2023-09-12T16:07:04.618720+0000","last_unstale":"2023-09-12T16:07:05.273966+0000","last_undegraded":"2023-09-12T16:07:05.273966+0000","last_fullsized":"2023-09-12T16:07:05.273966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:45:19.426338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261342+0000","last_change":"2023-09-12T16:06:59.238054+0000","last_active":"2023-09-12T16:07:04.261342+0000","last_peered":"2023-09-12T16:07:04.261342+0000","last_clean":"2023-09-12T16:07:04.261342+0000","last_became_active":"2023-09-12T16:06:59.237786+0000","last_became_peered":"2023-09-12T16:06:59.237786+0000","last_unstale":"2023-09-12T16:07:04.261342+0000","last_undegraded":"2023-09-12T16:07:04.261342+0000","last_fullsized":"2023-09-12T16:07:04.261342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:49:47.563558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616530+0000","last_change":"2023-09-12T16:07:00.249587+0000","last_active":"2023-09-12T16:07:04.616530+0000","last_peered":"2023-09-12T16:07:04.616530+0000","last_clean":"2023-09-12T16:07:04.616530+0000","last_became_active":"2023-09-12T16:07:00.249288+0000","last_became_peered":"2023-09-12T16:07:00.249288+0000","last_unstale":"2023-09-12T16:07:04.616530+0000","last_undegraded":"2023-09-12T16:07:04.616530+0000","last_fullsized":"2023-09-12T16:07:04.616530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:36:27.893363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872455+0000","last_change":"2023-09-12T16:07:04.269929+0000","last_active":"2023-09-12T16:07:05.872455+0000","last_peered":"2023-09-12T16:07:05.872455+0000","last_clean":"2023-09-12T16:07:05.872455+0000","last_became_active":"2023-09-12T16:07:04.269553+0000","last_became_peered":"2023-09-12T16:07:04.269553+0000","last_unstale":"2023-09-12T16:07:05.872455+0000","last_undegraded":"2023-09-12T16:07:05.872455+0000","last_fullsized":"2023-09-12T16:07:05.872455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:42:29.239901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.252147+0000","last_change":"2023-09-12T16:06:59.222437+0000","last_active":"2023-09-12T16:07:04.252147+0000","last_peered":"2023-09-12T16:07:04.252147+0000","last_clean":"2023-09-12T16:07:04.252147+0000","last_became_active":"2023-09-12T16:06:59.222099+0000","last_became_peered":"2023-09-12T16:06:59.222099+0000","last_unstale":"2023-09-12T16:07:04.252147+0000","last_undegraded":"2023-09-12T16:07:04.252147+0000","last_fullsized":"2023-09-12T16:07:04.252147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:44:49.750579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262052+0000","last_change":"2023-09-12T16:07:00.246299+0000","last_active":"2023-09-12T16:07:04.262052+0000","last_peered":"2023-09-12T16:07:04.262052+0000","last_clean":"2023-09-12T16:07:04.262052+0000","last_became_active":"2023-09-12T16:07:00.245786+0000","last_became_peered":"2023-09-12T16:07:00.245786+0000","last_unstale":"2023-09-12T16:07:04.262052+0000","last_undegraded":"2023-09-12T16:07:04.262052+0000","last_fullsized":"2023-09-12T16:07:04.262052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:27:58.457682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.871863+0000","last_change":"2023-09-12T16:07:04.619216+0000","last_active":"2023-09-12T16:07:05.871863+0000","last_peered":"2023-09-12T16:07:05.871863+0000","last_clean":"2023-09-12T16:07:05.871863+0000","last_became_active":"2023-09-12T16:07:04.618772+0000","last_became_peered":"2023-09-12T16:07:04.618772+0000","last_unstale":"2023-09-12T16:07:05.871863+0000","last_undegraded":"2023-09-12T16:07:05.871863+0000","last_fullsized":"2023-09-12T16:07:05.871863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:40.671615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262737+0000","last_change":"2023-09-12T16:06:59.237315+0000","last_active":"2023-09-12T16:07:04.262737+0000","last_peered":"2023-09-12T16:07:04.262737+0000","last_clean":"2023-09-12T16:07:04.262737+0000","last_became_active":"2023-09-12T16:06:59.237042+0000","last_became_peered":"2023-09-12T16:06:59.237042+0000","last_unstale":"2023-09-12T16:07:04.262737+0000","last_undegraded":"2023-09-12T16:07:04.262737+0000","last_fullsized":"2023-09-12T16:07:04.262737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:34:01.502780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.617354+0000","last_change":"2023-09-12T16:07:00.252987+0000","last_active":"2023-09-12T16:07:04.617354+0000","last_peered":"2023-09-12T16:07:04.617354+0000","last_clean":"2023-09-12T16:07:04.617354+0000","last_became_active":"2023-09-12T16:07:00.252715+0000","last_became_peered":"2023-09-12T16:07:00.252715+0000","last_unstale":"2023-09-12T16:07:04.617354+0000","last_undegraded":"2023-09-12T16:07:04.617354+0000","last_fullsized":"2023-09-12T16:07:04.617354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:12:18.693711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.264873+0000","last_change":"2023-09-12T16:07:00.239692+0000","last_active":"2023-09-12T16:07:04.264873+0000","last_peered":"2023-09-12T16:07:04.264873+0000","last_clean":"2023-09-12T16:07:04.264873+0000","last_became_active":"2023-09-12T16:07:00.239382+0000","last_became_peered":"2023-09-12T16:07:00.239382+0000","last_unstale":"2023-09-12T16:07:04.264873+0000","last_undegraded":"2023-09-12T16:07:04.264873+0000","last_fullsized":"2023-09-12T16:07:04.264873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:58:37.106438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258921+0000","last_change":"2023-09-12T16:07:00.243624+0000","last_active":"2023-09-12T16:07:04.258921+0000","last_peered":"2023-09-12T16:07:04.258921+0000","last_clean":"2023-09-12T16:07:04.258921+0000","last_became_active":"2023-09-12T16:07:00.243363+0000","last_became_peered":"2023-09-12T16:07:00.243363+0000","last_unstale":"2023-09-12T16:07:04.258921+0000","last_undegraded":"2023-09-12T16:07:04.258921+0000","last_fullsized":"2023-09-12T16:07:04.258921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:06:30.931584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262048+0000","last_change":"2023-09-12T16:07:00.247135+0000","last_active":"2023-09-12T16:07:04.262048+0000","last_peered":"2023-09-12T16:07:04.262048+0000","last_clean":"2023-09-12T16:07:04.262048+0000","last_became_active":"2023-09-12T16:07:00.245531+0000","last_became_peered":"2023-09-12T16:07:00.245531+0000","last_unstale":"2023-09-12T16:07:04.262048+0000","last_undegraded":"2023-09-12T16:07:04.262048+0000","last_fullsized":"2023-09-12T16:07:04.262048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:12:18.693711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258068+0000","last_change":"2023-09-12T16:07:00.235877+0000","last_active":"2023-09-12T16:07:04.258068+0000","last_peered":"2023-09-12T16:07:04.258068+0000","last_clean":"2023-09-12T16:07:04.258068+0000","last_became_active":"2023-09-12T16:07:00.235463+0000","last_became_peered":"2023-09-12T16:07:00.235463+0000","last_unstale":"2023-09-12T16:07:04.258068+0000","last_undegraded":"2023-09-12T16:07:04.258068+0000","last_fullsized":"2023-09-12T16:07:04.258068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:14:21.195478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261764+0000","last_change":"2023-09-12T16:07:00.239178+0000","last_active":"2023-09-12T16:07:04.261764+0000","last_peered":"2023-09-12T16:07:04.261764+0000","last_clean":"2023-09-12T16:07:04.261764+0000","last_became_active":"2023-09-12T16:07:00.237641+0000","last_became_peered":"2023-09-12T16:07:00.237641+0000","last_unstale":"2023-09-12T16:07:04.261764+0000","last_undegraded":"2023-09-12T16:07:04.261764+0000","last_fullsized":"2023-09-12T16:07:04.261764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:08:00.209264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.252078+0000","last_change":"2023-09-12T16:07:00.240120+0000","last_active":"2023-09-12T16:07:04.252078+0000","last_peered":"2023-09-12T16:07:04.252078+0000","last_clean":"2023-09-12T16:07:04.252078+0000","last_became_active":"2023-09-12T16:07:00.239826+0000","last_became_peered":"2023-09-12T16:07:00.239826+0000","last_unstale":"2023-09-12T16:07:04.252078+0000","last_undegraded":"2023-09-12T16:07:04.252078+0000","last_fullsized":"2023-09-12T16:07:04.252078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:58.775088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.266947+0000","last_change":"2023-09-12T16:07:00.242920+0000","last_active":"2023-09-12T16:07:04.266947+0000","last_peered":"2023-09-12T16:07:04.266947+0000","last_clean":"2023-09-12T16:07:04.266947+0000","last_became_active":"2023-09-12T16:07:00.242640+0000","last_became_peered":"2023-09-12T16:07:00.242640+0000","last_unstale":"2023-09-12T16:07:04.266947+0000","last_undegraded":"2023-09-12T16:07:04.266947+0000","last_fullsized":"2023-09-12T16:07:04.266947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:46:52.188371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261946+0000","last_change":"2023-09-12T16:07:00.236628+0000","last_active":"2023-09-12T16:07:04.261946+0000","last_peered":"2023-09-12T16:07:04.261946+0000","last_clean":"2023-09-12T16:07:04.261946+0000","last_became_active":"2023-09-12T16:07:00.236285+0000","last_became_peered":"2023-09-12T16:07:00.236285+0000","last_unstale":"2023-09-12T16:07:04.261946+0000","last_undegraded":"2023-09-12T16:07:04.261946+0000","last_fullsized":"2023-09-12T16:07:04.261946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:38:37.389648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262483+0000","last_change":"2023-09-12T16:07:00.242101+0000","last_active":"2023-09-12T16:07:04.262483+0000","last_peered":"2023-09-12T16:07:04.262483+0000","last_clean":"2023-09-12T16:07:04.262483+0000","last_became_active":"2023-09-12T16:07:00.241617+0000","last_became_peered":"2023-09-12T16:07:00.241617+0000","last_unstale":"2023-09-12T16:07:04.262483+0000","last_undegraded":"2023-09-12T16:07:04.262483+0000","last_fullsized":"2023-09-12T16:07:04.262483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:13:06.582191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258456+0000","last_change":"2023-09-12T16:07:00.236987+0000","last_active":"2023-09-12T16:07:04.258456+0000","last_peered":"2023-09-12T16:07:04.258456+0000","last_clean":"2023-09-12T16:07:04.258456+0000","last_became_active":"2023-09-12T16:07:00.236642+0000","last_became_peered":"2023-09-12T16:07:00.236642+0000","last_unstale":"2023-09-12T16:07:04.258456+0000","last_undegraded":"2023-09-12T16:07:04.258456+0000","last_fullsized":"2023-09-12T16:07:04.258456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:53:20.853979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262134+0000","last_change":"2023-09-12T16:07:00.246004+0000","last_active":"2023-09-12T16:07:04.262134+0000","last_peered":"2023-09-12T16:07:04.262134+0000","last_clean":"2023-09-12T16:07:04.262134+0000","last_became_active":"2023-09-12T16:07:00.245625+0000","last_became_peered":"2023-09-12T16:07:00.245625+0000","last_unstale":"2023-09-12T16:07:04.262134+0000","last_undegraded":"2023-09-12T16:07:04.262134+0000","last_fullsized":"2023-09-12T16:07:04.262134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:19:17.260974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258148+0000","last_change":"2023-09-12T16:07:00.246340+0000","last_active":"2023-09-12T16:07:04.258148+0000","last_peered":"2023-09-12T16:07:04.258148+0000","last_clean":"2023-09-12T16:07:04.258148+0000","last_became_active":"2023-09-12T16:07:00.246060+0000","last_became_peered":"2023-09-12T16:07:00.246060+0000","last_unstale":"2023-09-12T16:07:04.258148+0000","last_undegraded":"2023-09-12T16:07:04.258148+0000","last_fullsized":"2023-09-12T16:07:04.258148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:58:37.106438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.266833+0000","last_change":"2023-09-12T16:07:00.238100+0000","last_active":"2023-09-12T16:07:04.266833+0000","last_peered":"2023-09-12T16:07:04.266833+0000","last_clean":"2023-09-12T16:07:04.266833+0000","last_became_active":"2023-09-12T16:07:00.237802+0000","last_became_peered":"2023-09-12T16:07:00.237802+0000","last_unstale":"2023-09-12T16:07:04.266833+0000","last_undegraded":"2023-09-12T16:07:04.266833+0000","last_fullsized":"2023-09-12T16:07:04.266833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:53:20.853979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":689767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-12T16:07:23.180 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-12T16:07:23.181 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2023-09-12T16:07:23.181 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-09-12T16:07:23.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.417+0000 7f8af0bff700 1 -- 172.21.15.112:0/4284532487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8aec0d0590 msgr2=0x7f8aec0ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:23.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.417+0000 7f8af0bff700 1 --2- 172.21.15.112:0/4284532487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8aec0d0590 0x7f8aec0ccac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4009f60 tx=0x7f8ae4009f90 comp rx=0 tx=0).stop 2023-09-12T16:07:23.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.417+0000 7f8af0bff700 1 -- 172.21.15.112:0/4284532487 shutdown_connections 2023-09-12T16:07:23.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.417+0000 7f8af0bff700 1 --2- 172.21.15.112:0/4284532487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8aec0d0590 0x7f8aec0ccac0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:23.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.417+0000 7f8af0bff700 1 -- 172.21.15.112:0/4284532487 >> 172.21.15.112:0/4284532487 conn(0x7f8aec0d1930 msgr2=0x7f8aec0d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:23.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.417+0000 7f8af0bff700 1 -- 172.21.15.112:0/4284532487 shutdown_connections 2023-09-12T16:07:23.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.417+0000 7f8af0bff700 1 -- 172.21.15.112:0/4284532487 wait complete. 2023-09-12T16:07:23.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.419+0000 7f8af0bff700 1 Processor -- start 2023-09-12T16:07:23.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.419+0000 7f8af0bff700 1 -- start start 2023-09-12T16:07:23.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.420+0000 7f8af0bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8aec0cdfb0 0x7f8aec15bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:23.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.420+0000 7f8af0bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8aec0d0590 0x7f8aec1f1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:23.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.420+0000 7f8af0bff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8aec15f480 0x7f8aec15b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:23.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.420+0000 7f8af0bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec15b960 con 0x7f8aec0d0590 2023-09-12T16:07:23.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.420+0000 7f8af0bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec0c8ee0 con 0x7f8aec0cdfb0 2023-09-12T16:07:23.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.420+0000 7f8af0bff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec0c91c0 con 0x7f8aec15f480 2023-09-12T16:07:23.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.420+0000 7f8ae9d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8aec0d0590 0x7f8aec1f1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:23.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.420+0000 7f8ae9d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8aec0d0590 0x7f8aec1f1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50294/0 (socket says 172.21.15.112:50294) 2023-09-12T16:07:23.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.420+0000 7f8ae9d9b700 1 -- 172.21.15.112:0/2159262078 learned_addr learned my addr 172.21.15.112:0/2159262078 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:23.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.420+0000 7f8aea59c700 1 --2- 172.21.15.112:0/2159262078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8aec0cdfb0 0x7f8aec15bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:23.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.420+0000 7f8aead9d700 1 --2- 172.21.15.112:0/2159262078 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8aec15f480 0x7f8aec15b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:23.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.421+0000 7f8ae9d9b700 1 -- 172.21.15.112:0/2159262078 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8aec15f480 msgr2=0x7f8aec15b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:23.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.421+0000 7f8ae9d9b700 1 --2- 172.21.15.112:0/2159262078 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8aec15f480 0x7f8aec15b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:23.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.421+0000 7f8ae9d9b700 1 -- 172.21.15.112:0/2159262078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8aec0cdfb0 msgr2=0x7f8aec15bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:23.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.421+0000 7f8ae9d9b700 1 --2- 172.21.15.112:0/2159262078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8aec0cdfb0 0x7f8aec15bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:23.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.421+0000 7f8ae9d9b700 1 -- 172.21.15.112:0/2159262078 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae4009c40 con 0x7f8aec0d0590 2023-09-12T16:07:23.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.421+0000 7f8ae9d9b700 1 --2- 172.21.15.112:0/2159262078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8aec0d0590 0x7f8aec1f1dd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8ae000c500 tx=0x7f8ae000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:23.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.421+0000 7f8adaffd700 1 -- 172.21.15.112:0/2159262078 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00052d0 con 0x7f8aec0d0590 2023-09-12T16:07:23.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.421+0000 7f8adaffd700 1 -- 172.21.15.112:0/2159262078 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8ae0005520 con 0x7f8aec0d0590 2023-09-12T16:07:23.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.421+0000 7f8adaffd700 1 -- 172.21.15.112:0/2159262078 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00038e0 con 0x7f8aec0d0590 2023-09-12T16:07:23.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.421+0000 7f8af0bff700 1 -- 172.21.15.112:0/2159262078 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aec0b2ba0 con 0x7f8aec0d0590 2023-09-12T16:07:23.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.421+0000 7f8af0bff700 1 -- 172.21.15.112:0/2159262078 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aec0c9780 con 0x7f8aec0d0590 2023-09-12T16:07:23.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.422+0000 7f8af0bff700 1 -- 172.21.15.112:0/2159262078 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aec04e300 con 0x7f8aec0d0590 2023-09-12T16:07:23.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.423+0000 7f8adaffd700 1 -- 172.21.15.112:0/2159262078 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f8ae0003a40 con 0x7f8aec0d0590 2023-09-12T16:07:23.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.424+0000 7f8adaffd700 1 --2- 172.21.15.112:0/2159262078 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8acc06a580 0x7f8acc06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:23.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.424+0000 7f8adaffd700 1 -- 172.21.15.112:0/2159262078 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8ae00883d0 con 0x7f8aec0d0590 2023-09-12T16:07:23.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.424+0000 7f8aea59c700 1 --2- 172.21.15.112:0/2159262078 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8acc06a580 0x7f8acc06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:23.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.425+0000 7f8aea59c700 1 --2- 172.21.15.112:0/2159262078 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8acc06a580 0x7f8acc06ca40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8adc001090 tx=0x7f8adc009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:23.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.428+0000 7f8adaffd700 1 -- 172.21.15.112:0/2159262078 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f8ae00535c0 con 0x7f8aec0d0590 2023-09-12T16:07:23.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.625+0000 7f8af0bff700 1 -- 172.21.15.112:0/2159262078 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) v1 -- 0x7f8aec0b4300 con 0x7f8aec0d0590 2023-09-12T16:07:23.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.626+0000 7f8adaffd700 1 -- 172.21.15.112:0/2159262078 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v30) v1 ==== 86+0+160 (secure 0 0 0) 0x7f8ae0056be0 con 0x7f8aec0d0590 2023-09-12T16:07:23.626 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:23.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.628+0000 7f8af0bff700 1 -- 172.21.15.112:0/2159262078 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8acc06a580 msgr2=0x7f8acc06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:23.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.628+0000 7f8af0bff700 1 --2- 172.21.15.112:0/2159262078 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8acc06a580 0x7f8acc06ca40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8adc001090 tx=0x7f8adc009040 comp rx=0 tx=0).stop 2023-09-12T16:07:23.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.628+0000 7f8af0bff700 1 -- 172.21.15.112:0/2159262078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8aec0d0590 msgr2=0x7f8aec1f1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:23.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.628+0000 7f8af0bff700 1 --2- 172.21.15.112:0/2159262078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8aec0d0590 0x7f8aec1f1dd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8ae000c500 tx=0x7f8ae000c810 comp rx=0 tx=0).stop 2023-09-12T16:07:23.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.628+0000 7f8af0bff700 1 -- 172.21.15.112:0/2159262078 shutdown_connections 2023-09-12T16:07:23.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.628+0000 7f8af0bff700 1 --2- 172.21.15.112:0/2159262078 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8acc06a580 0x7f8acc06ca40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:23.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.628+0000 7f8af0bff700 1 --2- 172.21.15.112:0/2159262078 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8aec15f480 0x7f8aec15b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:23.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.628+0000 7f8af0bff700 1 --2- 172.21.15.112:0/2159262078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8aec0cdfb0 0x7f8aec15bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:23.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.628+0000 7f8af0bff700 1 --2- 172.21.15.112:0/2159262078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8aec0d0590 0x7f8aec1f1dd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:23.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.628+0000 7f8af0bff700 1 -- 172.21.15.112:0/2159262078 >> 172.21.15.112:0/2159262078 conn(0x7f8aec0d1930 msgr2=0x7f8aec0cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:23.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.628+0000 7f8af0bff700 1 -- 172.21.15.112:0/2159262078 shutdown_connections 2023-09-12T16:07:23.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.628+0000 7f8af0bff700 1 -- 172.21.15.112:0/2159262078 wait complete. 2023-09-12T16:07:23.646 INFO:teuthology.orchestra.run.smithi112.stdout:[{"version":30,"timestamp":"2023-09-12T16:06:47.655187+0000","name":"","changes":[{"name":"osd.7/osd_mclock_max_capacity_iops_ssd","new_value":"2460.222830"}]}] 2023-09-12T16:07:23.646 INFO:tasks.ceph_manager:config epoch is 30 2023-09-12T16:07:23.647 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-12T16:07:23.647 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-12T16:07:23.647 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-12T16:07:23.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.845+0000 7f88d759e700 1 -- 172.21.15.112:0/3488911997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88d80ca0b0 msgr2=0x7f88d8159ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:23.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.845+0000 7f88d759e700 1 --2- 172.21.15.112:0/3488911997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88d80ca0b0 0x7f88d8159ba0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f88c0005fd0 tx=0x7f88c0009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:23.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.846+0000 7f88d759e700 1 -- 172.21.15.112:0/3488911997 shutdown_connections 2023-09-12T16:07:23.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.846+0000 7f88d759e700 1 --2- 172.21.15.112:0/3488911997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88d80ca0b0 0x7f88d8159ba0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:23.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.846+0000 7f88d759e700 1 -- 172.21.15.112:0/3488911997 >> 172.21.15.112:0/3488911997 conn(0x7f88d8066320 msgr2=0x7f88d806a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:23.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.846+0000 7f88d759e700 1 -- 172.21.15.112:0/3488911997 shutdown_connections 2023-09-12T16:07:23.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.846+0000 7f88d759e700 1 -- 172.21.15.112:0/3488911997 wait complete. 2023-09-12T16:07:23.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.847+0000 7f88d759e700 1 Processor -- start 2023-09-12T16:07:23.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.847+0000 7f88d759e700 1 -- start start 2023-09-12T16:07:23.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.848+0000 7f88d759e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88d8153cc0 0x7f88d80b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:23.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.848+0000 7f88d759e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88d815de10 0x7f88d80b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:23.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.848+0000 7f88d759e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d80b12a0 0x7f88d8152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:23.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.848+0000 7f88d759e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d815d9f0 con 0x7f88d8153cc0 2023-09-12T16:07:23.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.848+0000 7f88d759e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d80af390 con 0x7f88d80b12a0 2023-09-12T16:07:23.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.848+0000 7f88d759e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d80af670 con 0x7f88d815de10 2023-09-12T16:07:23.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.848+0000 7f88d659c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88d8153cc0 0x7f88d80b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:23.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.849+0000 7f88d659c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88d8153cc0 0x7f88d80b3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50318/0 (socket says 172.21.15.112:50318) 2023-09-12T16:07:23.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.849+0000 7f88d659c700 1 -- 172.21.15.112:0/2870081479 learned_addr learned my addr 172.21.15.112:0/2870081479 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:23.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.849+0000 7f88cffff700 1 --2- 172.21.15.112:0/2870081479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88d815de10 0x7f88d80b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:23.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.849+0000 7f88d6d9d700 1 --2- 172.21.15.112:0/2870081479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d80b12a0 0x7f88d8152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:23.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.849+0000 7f88d659c700 1 -- 172.21.15.112:0/2870081479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88d815de10 msgr2=0x7f88d80b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:23.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.849+0000 7f88d659c700 1 --2- 172.21.15.112:0/2870081479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88d815de10 0x7f88d80b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:23.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.849+0000 7f88d659c700 1 -- 172.21.15.112:0/2870081479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d80b12a0 msgr2=0x7f88d8152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:23.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.849+0000 7f88d659c700 1 --2- 172.21.15.112:0/2870081479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d80b12a0 0x7f88d8152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:23.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.849+0000 7f88d659c700 1 -- 172.21.15.112:0/2870081479 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c00095f0 con 0x7f88d8153cc0 2023-09-12T16:07:23.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.849+0000 7f88d659c700 1 --2- 172.21.15.112:0/2870081479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88d8153cc0 0x7f88d80b3e60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f88c8001eb0 tx=0x7f88c800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:23.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.849+0000 7f88ceffd700 1 -- 172.21.15.112:0/2870081479 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c80054e0 con 0x7f88d8153cc0 2023-09-12T16:07:23.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.849+0000 7f88ceffd700 1 -- 172.21.15.112:0/2870081479 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f88c8003680 con 0x7f88d8153cc0 2023-09-12T16:07:23.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.850+0000 7f88d759e700 1 -- 172.21.15.112:0/2870081479 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d80af950 con 0x7f88d8153cc0 2023-09-12T16:07:23.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.850+0000 7f88ceffd700 1 -- 172.21.15.112:0/2870081479 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c8003a50 con 0x7f88d8153cc0 2023-09-12T16:07:23.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.850+0000 7f88d759e700 1 -- 172.21.15.112:0/2870081479 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d80b1860 con 0x7f88d8153cc0 2023-09-12T16:07:23.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.851+0000 7f88d759e700 1 -- 172.21.15.112:0/2870081479 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d80afe70 con 0x7f88d8153cc0 2023-09-12T16:07:23.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.851+0000 7f88ceffd700 1 -- 172.21.15.112:0/2870081479 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f88c8003bb0 con 0x7f88d8153cc0 2023-09-12T16:07:23.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.852+0000 7f88ceffd700 1 --2- 172.21.15.112:0/2870081479 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f88b806a580 0x7f88b806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:23.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.852+0000 7f88ceffd700 1 -- 172.21.15.112:0/2870081479 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f88c8088360 con 0x7f88d8153cc0 2023-09-12T16:07:23.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.852+0000 7f88cffff700 1 --2- 172.21.15.112:0/2870081479 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f88b806a580 0x7f88b806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:23.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.853+0000 7f88cffff700 1 --2- 172.21.15.112:0/2870081479 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f88b806a580 0x7f88b806ca40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f88d8071ec0 tx=0x7f88c00047c0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:23.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:23.857+0000 7f88ceffd700 1 -- 172.21.15.112:0/2870081479 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f88d80afe70 con 0x7f88d8153cc0 2023-09-12T16:07:24.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.110+0000 7f88d759e700 1 -- 172.21.15.112:0/2870081479 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f88d80afe70 con 0x7f88d8153cc0 2023-09-12T16:07:24.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.113+0000 7f88ceffd700 1 -- 172.21.15.112:0/2870081479 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170111 (secure 0 0 0) 0x7f88d80afe70 con 0x7f88d8153cc0 2023-09-12T16:07:24.116 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:24.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.117+0000 7f88d759e700 1 -- 172.21.15.112:0/2870081479 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f88b806a580 msgr2=0x7f88b806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:24.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.117+0000 7f88d759e700 1 --2- 172.21.15.112:0/2870081479 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f88b806a580 0x7f88b806ca40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f88d8071ec0 tx=0x7f88c00047c0 comp rx=0 tx=0).stop 2023-09-12T16:07:24.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.117+0000 7f88d759e700 1 -- 172.21.15.112:0/2870081479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88d8153cc0 msgr2=0x7f88d80b3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:24.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.117+0000 7f88d759e700 1 --2- 172.21.15.112:0/2870081479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88d8153cc0 0x7f88d80b3e60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f88c8001eb0 tx=0x7f88c800c8b0 comp rx=0 tx=0).stop 2023-09-12T16:07:24.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.117+0000 7f88d759e700 1 -- 172.21.15.112:0/2870081479 shutdown_connections 2023-09-12T16:07:24.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.117+0000 7f88d759e700 1 --2- 172.21.15.112:0/2870081479 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f88b806a580 0x7f88b806ca40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:24.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.117+0000 7f88d759e700 1 --2- 172.21.15.112:0/2870081479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d80b12a0 0x7f88d8152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:24.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.117+0000 7f88d759e700 1 --2- 172.21.15.112:0/2870081479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88d8153cc0 0x7f88d80b3e60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:24.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.117+0000 7f88d759e700 1 --2- 172.21.15.112:0/2870081479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88d815de10 0x7f88d80b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:24.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.117+0000 7f88d759e700 1 -- 172.21.15.112:0/2870081479 >> 172.21.15.112:0/2870081479 conn(0x7f88d80ca0b0 msgr2=0x7f88d8158670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:24.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.117+0000 7f88d759e700 1 -- 172.21.15.112:0/2870081479 shutdown_connections 2023-09-12T16:07:24.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.117+0000 7f88d759e700 1 -- 172.21.15.112:0/2870081479 wait complete. 2023-09-12T16:07:24.134 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":5,"active_gid":4176,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1000013333},{"type":"v1","addr":"172.21.15.112:6833","nonce":1000013333}]},"active_addr":"172.21.15.112:6833/1000013333","active_change":"2023-09-12T16:06:42.800782+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4172,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":3032975113}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":3533669437}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":2522464658}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":3743685877}]}]} 2023-09-12T16:07:24.140 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-12T16:07:24.140 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-12T16:07:24.140 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:07:24.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.342+0000 7f45457ff700 1 -- 172.21.15.112:0/3032835992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45400d0590 msgr2=0x7f45400cc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:24.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.342+0000 7f45457ff700 1 --2- 172.21.15.112:0/3032835992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45400d0590 0x7f45400cc8f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4540089340 tx=0x7f453800b330 comp rx=0 tx=0).stop 2023-09-12T16:07:24.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.343+0000 7f45457ff700 1 -- 172.21.15.112:0/3032835992 shutdown_connections 2023-09-12T16:07:24.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.343+0000 7f45457ff700 1 --2- 172.21.15.112:0/3032835992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45400d0590 0x7f45400cc8f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:24.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.343+0000 7f45457ff700 1 --2- 172.21.15.112:0/3032835992 >> v2:172.21.15.144:3300/0 conn(0x7f45400cdfb0 0x7f45400cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:24.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.343+0000 7f45457ff700 1 -- 172.21.15.112:0/3032835992 >> 172.21.15.112:0/3032835992 conn(0x7f45400d1930 msgr2=0x7f45400d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:24.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.343+0000 7f45457ff700 1 -- 172.21.15.112:0/3032835992 shutdown_connections 2023-09-12T16:07:24.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.343+0000 7f45457ff700 1 -- 172.21.15.112:0/3032835992 wait complete. 2023-09-12T16:07:24.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.344+0000 7f45457ff700 1 Processor -- start 2023-09-12T16:07:24.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.344+0000 7f45457ff700 1 -- start start 2023-09-12T16:07:24.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.345+0000 7f45457ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45400cdfb0 0x7f45400afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:24.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.345+0000 7f45457ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45400d0590 0x7f454015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:24.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.345+0000 7f45457ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f454015f480 0x7f45400c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:24.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.345+0000 7f45457ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45400b0250 con 0x7f45400d0590 2023-09-12T16:07:24.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.345+0000 7f45457ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45400b0530 con 0x7f454015f480 2023-09-12T16:07:24.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.345+0000 7f45457ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45400b0810 con 0x7f45400cdfb0 2023-09-12T16:07:24.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.346+0000 7f4537fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45400d0590 0x7f454015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:24.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.346+0000 7f4537fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45400d0590 0x7f454015a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50330/0 (socket says 172.21.15.112:50330) 2023-09-12T16:07:24.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.346+0000 7f4537fff700 1 -- 172.21.15.112:0/3362472743 learned_addr learned my addr 172.21.15.112:0/3362472743 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:24.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.346+0000 7f453f7fe700 1 --2- 172.21.15.112:0/3362472743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f454015f480 0x7f45400c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:24.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.346+0000 7f453effd700 1 --2- 172.21.15.112:0/3362472743 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45400cdfb0 0x7f45400afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:24.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.346+0000 7f4537fff700 1 -- 172.21.15.112:0/3362472743 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45400cdfb0 msgr2=0x7f45400afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:24.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.346+0000 7f4537fff700 1 --2- 172.21.15.112:0/3362472743 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45400cdfb0 0x7f45400afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:24.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.346+0000 7f4537fff700 1 -- 172.21.15.112:0/3362472743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f454015f480 msgr2=0x7f45400c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:24.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.346+0000 7f4537fff700 1 --2- 172.21.15.112:0/3362472743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f454015f480 0x7f45400c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:24.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.346+0000 7f4537fff700 1 -- 172.21.15.112:0/3362472743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4538009c40 con 0x7f45400d0590 2023-09-12T16:07:24.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.346+0000 7f453f7fe700 1 --2- 172.21.15.112:0/3362472743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f454015f480 0x7f45400c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:24.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.346+0000 7f453effd700 1 --2- 172.21.15.112:0/3362472743 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45400cdfb0 0x7f45400afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:24.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.346+0000 7f4537fff700 1 --2- 172.21.15.112:0/3362472743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45400d0590 0x7f454015a1e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f452800d950 tx=0x7f452800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:24.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.346+0000 7f45377fe700 1 -- 172.21.15.112:0/3362472743 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4528009b40 con 0x7f45400d0590 2023-09-12T16:07:24.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.346+0000 7f45377fe700 1 -- 172.21.15.112:0/3362472743 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4528009d90 con 0x7f45400d0590 2023-09-12T16:07:24.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.347+0000 7f45457ff700 1 -- 172.21.15.112:0/3362472743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45400b0af0 con 0x7f45400d0590 2023-09-12T16:07:24.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.347+0000 7f45377fe700 1 -- 172.21.15.112:0/3362472743 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45280106c0 con 0x7f45400d0590 2023-09-12T16:07:24.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.347+0000 7f45457ff700 1 -- 172.21.15.112:0/3362472743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45400aff40 con 0x7f45400d0590 2023-09-12T16:07:24.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.348+0000 7f45457ff700 1 -- 172.21.15.112:0/3362472743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45400b1140 con 0x7f45400d0590 2023-09-12T16:07:24.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.349+0000 7f45377fe700 1 -- 172.21.15.112:0/3362472743 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f4528010820 con 0x7f45400d0590 2023-09-12T16:07:24.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.349+0000 7f45377fe700 1 --2- 172.21.15.112:0/3362472743 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f452006a580 0x7f452006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:24.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.350+0000 7f45377fe700 1 -- 172.21.15.112:0/3362472743 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4528089350 con 0x7f45400d0590 2023-09-12T16:07:24.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.350+0000 7f453effd700 1 --2- 172.21.15.112:0/3362472743 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f452006a580 0x7f452006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:24.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.350+0000 7f453effd700 1 --2- 172.21.15.112:0/3362472743 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f452006a580 0x7f452006ca40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4530001090 tx=0x7f4530009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:24.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.354+0000 7f45377fe700 1 -- 172.21.15.112:0/3362472743 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f4528054670 con 0x7f45400d0590 2023-09-12T16:07:24.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.551+0000 7f45457ff700 1 -- 172.21.15.112:0/3362472743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f454004e300 con 0x7f45400d0590 2023-09-12T16:07:24.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.552+0000 7f45377fe700 1 -- 172.21.15.112:0/3362472743 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f4528057c90 con 0x7f45400d0590 2023-09-12T16:07:24.553 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:24.553 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:04.748402+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:07:24.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.555+0000 7f45457ff700 1 -- 172.21.15.112:0/3362472743 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f452006a580 msgr2=0x7f452006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:24.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.555+0000 7f45457ff700 1 --2- 172.21.15.112:0/3362472743 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f452006a580 0x7f452006ca40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4530001090 tx=0x7f4530009040 comp rx=0 tx=0).stop 2023-09-12T16:07:24.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.555+0000 7f45457ff700 1 -- 172.21.15.112:0/3362472743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45400d0590 msgr2=0x7f454015a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:24.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.555+0000 7f45457ff700 1 --2- 172.21.15.112:0/3362472743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45400d0590 0x7f454015a1e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f452800d950 tx=0x7f452800dd10 comp rx=0 tx=0).stop 2023-09-12T16:07:24.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.555+0000 7f45457ff700 1 -- 172.21.15.112:0/3362472743 shutdown_connections 2023-09-12T16:07:24.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.555+0000 7f45457ff700 1 --2- 172.21.15.112:0/3362472743 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f452006a580 0x7f452006ca40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:24.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.555+0000 7f45457ff700 1 --2- 172.21.15.112:0/3362472743 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45400cdfb0 0x7f45400afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:24.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.555+0000 7f45457ff700 1 --2- 172.21.15.112:0/3362472743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f454015f480 0x7f45400c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:24.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.555+0000 7f45457ff700 1 --2- 172.21.15.112:0/3362472743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45400d0590 0x7f454015a1e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:24.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.555+0000 7f45457ff700 1 -- 172.21.15.112:0/3362472743 >> 172.21.15.112:0/3362472743 conn(0x7f45400d1930 msgr2=0x7f45400cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:24.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.555+0000 7f45457ff700 1 -- 172.21.15.112:0/3362472743 shutdown_connections 2023-09-12T16:07:24.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.555+0000 7f45457ff700 1 -- 172.21.15.112:0/3362472743 wait complete. 2023-09-12T16:07:24.573 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-12T16:07:24.573 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:07:24.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.772+0000 7fc7b37ff700 1 -- 172.21.15.112:0/2183606684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7ac0cdfb0 msgr2=0x7fc7ac0cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:24.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.772+0000 7fc7b37ff700 1 --2- 172.21.15.112:0/2183606684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7ac0cdfb0 0x7fc7ac0cc3b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc79c005fd0 tx=0x7fc79c009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:24.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.772+0000 7fc7b37ff700 1 -- 172.21.15.112:0/2183606684 shutdown_connections 2023-09-12T16:07:24.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.772+0000 7fc7b37ff700 1 --2- 172.21.15.112:0/2183606684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7ac0cdfb0 0x7fc7ac0cc3b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:24.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.772+0000 7fc7b37ff700 1 -- 172.21.15.112:0/2183606684 >> 172.21.15.112:0/2183606684 conn(0x7fc7ac0d1930 msgr2=0x7fc7ac0d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:24.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.772+0000 7fc7b37ff700 1 -- 172.21.15.112:0/2183606684 shutdown_connections 2023-09-12T16:07:24.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.772+0000 7fc7b37ff700 1 -- 172.21.15.112:0/2183606684 wait complete. 2023-09-12T16:07:24.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.774+0000 7fc7b37ff700 1 Processor -- start 2023-09-12T16:07:24.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.774+0000 7fc7b37ff700 1 -- start start 2023-09-12T16:07:24.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.775+0000 7fc7b37ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7ac0cdfb0 0x7fc7ac15a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:24.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.775+0000 7fc7b37ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7ac0d0590 0x7fc7ac06c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:24.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.775+0000 7fc7b37ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7ac15f480 0x7fc7ac06c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:24.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.775+0000 7fc7b37ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac0cb4d0 con 0x7fc7ac15f480 2023-09-12T16:07:24.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.775+0000 7fc7b37ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac159d30 con 0x7fc7ac0d0590 2023-09-12T16:07:24.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.775+0000 7fc7b37ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac159120 con 0x7fc7ac0cdfb0 2023-09-12T16:07:24.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.775+0000 7fc7b1d9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7ac15f480 0x7fc7ac06c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:24.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.775+0000 7fc7b1d9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7ac15f480 0x7fc7ac06c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50350/0 (socket says 172.21.15.112:50350) 2023-09-12T16:07:24.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.775+0000 7fc7b1d9c700 1 -- 172.21.15.112:0/1073392783 learned_addr learned my addr 172.21.15.112:0/1073392783 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:24.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.775+0000 7fc7b0d9a700 1 --2- 172.21.15.112:0/1073392783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7ac0d0590 0x7fc7ac06c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:24.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.775+0000 7fc7b159b700 1 --2- 172.21.15.112:0/1073392783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7ac0cdfb0 0x7fc7ac15a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:24.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.776+0000 7fc7b1d9c700 1 -- 172.21.15.112:0/1073392783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7ac0cdfb0 msgr2=0x7fc7ac15a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:24.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.776+0000 7fc7b1d9c700 1 --2- 172.21.15.112:0/1073392783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7ac0cdfb0 0x7fc7ac15a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:24.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.776+0000 7fc7b1d9c700 1 -- 172.21.15.112:0/1073392783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7ac0d0590 msgr2=0x7fc7ac06c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:24.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.776+0000 7fc7b1d9c700 1 --2- 172.21.15.112:0/1073392783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7ac0d0590 0x7fc7ac06c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:24.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.776+0000 7fc7b1d9c700 1 -- 172.21.15.112:0/1073392783 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79c0095f0 con 0x7fc7ac15f480 2023-09-12T16:07:24.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.776+0000 7fc7b159b700 1 --2- 172.21.15.112:0/1073392783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7ac0cdfb0 0x7fc7ac15a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:07:24.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.776+0000 7fc7b1d9c700 1 --2- 172.21.15.112:0/1073392783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7ac15f480 0x7fc7ac06c9a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400cba0 tx=0x7fc7a400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:24.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.776+0000 7fc7a1ffb700 1 -- 172.21.15.112:0/1073392783 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a400aad0 con 0x7fc7ac15f480 2023-09-12T16:07:24.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.776+0000 7fc7a1ffb700 1 -- 172.21.15.112:0/1073392783 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc7a400ad20 con 0x7fc7ac15f480 2023-09-12T16:07:24.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.776+0000 7fc7a1ffb700 1 -- 172.21.15.112:0/1073392783 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4012680 con 0x7fc7ac15f480 2023-09-12T16:07:24.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.776+0000 7fc7b37ff700 1 -- 172.21.15.112:0/1073392783 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7ac159400 con 0x7fc7ac15f480 2023-09-12T16:07:24.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.776+0000 7fc7b37ff700 1 -- 172.21.15.112:0/1073392783 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7ac1599c0 con 0x7fc7ac15f480 2023-09-12T16:07:24.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.777+0000 7fc7b37ff700 1 -- 172.21.15.112:0/1073392783 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7ac159ea0 con 0x7fc7ac15f480 2023-09-12T16:07:24.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.778+0000 7fc7a1ffb700 1 -- 172.21.15.112:0/1073392783 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fc7a401b400 con 0x7fc7ac15f480 2023-09-12T16:07:24.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.779+0000 7fc7a1ffb700 1 --2- 172.21.15.112:0/1073392783 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc79006a580 0x7fc79006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:24.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.779+0000 7fc7a1ffb700 1 -- 172.21.15.112:0/1073392783 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc7a40896b0 con 0x7fc7ac15f480 2023-09-12T16:07:24.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.779+0000 7fc7b159b700 1 --2- 172.21.15.112:0/1073392783 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc79006a580 0x7fc79006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:24.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.780+0000 7fc7b159b700 1 --2- 172.21.15.112:0/1073392783 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc79006a580 0x7fc79006ca40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac15ded0 tx=0x7fc7a8009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:24.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.784+0000 7fc7a1ffb700 1 -- 172.21.15.112:0/1073392783 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fc7a4054940 con 0x7fc7ac15f480 2023-09-12T16:07:24.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.982+0000 7fc7b37ff700 1 -- 172.21.15.112:0/1073392783 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7ac04e300 con 0x7fc7ac15f480 2023-09-12T16:07:24.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.984+0000 7fc7a1ffb700 1 -- 172.21.15.112:0/1073392783 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fc7a405e030 con 0x7fc7ac15f480 2023-09-12T16:07:24.984 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:24.985 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:04.748402+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:07:24.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.986+0000 7fc7b37ff700 1 -- 172.21.15.112:0/1073392783 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc79006a580 msgr2=0x7fc79006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:24.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.986+0000 7fc7b37ff700 1 --2- 172.21.15.112:0/1073392783 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc79006a580 0x7fc79006ca40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac15ded0 tx=0x7fc7a8009040 comp rx=0 tx=0).stop 2023-09-12T16:07:24.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.986+0000 7fc7b37ff700 1 -- 172.21.15.112:0/1073392783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7ac15f480 msgr2=0x7fc7ac06c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:24.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.986+0000 7fc7b37ff700 1 --2- 172.21.15.112:0/1073392783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7ac15f480 0x7fc7ac06c9a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400cba0 tx=0x7fc7a400ceb0 comp rx=0 tx=0).stop 2023-09-12T16:07:24.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.986+0000 7fc7b37ff700 1 -- 172.21.15.112:0/1073392783 shutdown_connections 2023-09-12T16:07:24.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.986+0000 7fc7b37ff700 1 --2- 172.21.15.112:0/1073392783 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc79006a580 0x7fc79006ca40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:24.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.986+0000 7fc7b37ff700 1 --2- 172.21.15.112:0/1073392783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7ac0cdfb0 0x7fc7ac15a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:24.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.986+0000 7fc7b37ff700 1 --2- 172.21.15.112:0/1073392783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7ac15f480 0x7fc7ac06c9a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:24.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.986+0000 7fc7b37ff700 1 --2- 172.21.15.112:0/1073392783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7ac0d0590 0x7fc7ac06c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:24.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.986+0000 7fc7b37ff700 1 -- 172.21.15.112:0/1073392783 >> 172.21.15.112:0/1073392783 conn(0x7fc7ac0d1930 msgr2=0x7fc7ac0cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:24.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.986+0000 7fc7b37ff700 1 -- 172.21.15.112:0/1073392783 shutdown_connections 2023-09-12T16:07:24.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:24.986+0000 7fc7b37ff700 1 -- 172.21.15.112:0/1073392783 wait complete. 2023-09-12T16:07:25.005 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-12T16:07:25.006 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-12T16:07:25.006 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-12T16:07:25.007 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-12T16:07:25.007 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-09-12T16:07:25.008 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-09-12T16:07:25.009 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-09-12T16:07:25.009 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-09-12T16:07:25.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.370+0000 7fee77fff700 1 --2- 172.21.15.112:0/2664323495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee6c004850 0x7fee6c004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:25.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.370+0000 7fee7e59c700 1 --2- 172.21.15.112:0/2664323495 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee6c003bf0 0x7fee6c003fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:07:25.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.370+0000 7fee84dff700 1 -- 172.21.15.112:0/2664323495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee6c005210 msgr2=0x7fee6c010020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.370+0000 7fee84dff700 1 --2- 172.21.15.112:0/2664323495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee6c005210 0x7fee6c010020 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fee7800c660 tx=0x7fee6c005880 comp rx=0 tx=0).stop 2023-09-12T16:07:25.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.370+0000 7fee7ed9d700 1 -- 172.21.15.112:0/2664323495 reap_dead start 2023-09-12T16:07:25.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.370+0000 7fee84dff700 1 -- 172.21.15.112:0/2664323495 shutdown_connections 2023-09-12T16:07:25.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.370+0000 7fee84dff700 1 -- 172.21.15.112:0/2664323495 >> 172.21.15.112:0/2664323495 conn(0x7fee8006a650 msgr2=0x7fee8006c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.370+0000 7fee84dff700 1 -- 172.21.15.112:0/2664323495 shutdown_connections 2023-09-12T16:07:25.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.370+0000 7fee84dff700 1 -- 172.21.15.112:0/2664323495 wait complete. 2023-09-12T16:07:25.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.373+0000 7fee84dff700 1 Processor -- start 2023-09-12T16:07:25.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.374+0000 7fee84dff700 1 -- start start 2023-09-12T16:07:25.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.375+0000 7f43b7fff700 1 -- 172.21.15.112:0/2376907050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43b0071e90 msgr2=0x7f43b015f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.375+0000 7f43b7fff700 1 --2- 172.21.15.112:0/2376907050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43b0071e90 0x7f43b015f730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009fd0 tx=0x7f43a800b380 comp rx=0 tx=0).stop 2023-09-12T16:07:25.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.376+0000 7f43b7fff700 1 -- 172.21.15.112:0/2376907050 shutdown_connections 2023-09-12T16:07:25.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.376+0000 7f43b7fff700 1 --2- 172.21.15.112:0/2376907050 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43b00af390 0x7f43b00af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.376+0000 7f43b7fff700 1 --2- 172.21.15.112:0/2376907050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43b0071e90 0x7f43b015f730 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.376+0000 7f43b7fff700 1 -- 172.21.15.112:0/2376907050 >> 172.21.15.112:0/2376907050 conn(0x7f43b006a200 msgr2=0x7f43b006a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.377+0000 7fee84dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee6c005210 0x7fee800c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.377+0000 7fee84dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee800c5e90 0x7fee801ee8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.377+0000 7fee84dff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee801eee30 0x7fee800c29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.377+0000 7fee84dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee801ef2c0 con 0x7fee6c005210 2023-09-12T16:07:25.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.377+0000 7fee84dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee800c48b0 con 0x7fee800c5e90 2023-09-12T16:07:25.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.377+0000 7fee84dff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee800c4b90 con 0x7fee801eee30 2023-09-12T16:07:25.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.378+0000 7fee7e59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee6c005210 0x7fee800c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.378+0000 7fee7e59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee6c005210 0x7fee800c5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50368/0 (socket says 172.21.15.112:50368) 2023-09-12T16:07:25.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.378+0000 7fee7e59c700 1 -- 172.21.15.112:0/2824410827 learned_addr learned my addr 172.21.15.112:0/2824410827 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:25.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.378+0000 7fee77fff700 1 --2- 172.21.15.112:0/2824410827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee800c5e90 0x7fee801ee8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.379+0000 7fee7ed9d700 1 --2- 172.21.15.112:0/2824410827 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee801eee30 0x7fee800c29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.379+0000 7f43b7fff700 1 -- 172.21.15.112:0/2376907050 shutdown_connections 2023-09-12T16:07:25.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.379+0000 7fee77fff700 1 -- 172.21.15.112:0/2824410827 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee801eee30 msgr2=0x7fee800c29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.379+0000 7fee77fff700 1 --2- 172.21.15.112:0/2824410827 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee801eee30 0x7fee800c29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.379+0000 7fee77fff700 1 -- 172.21.15.112:0/2824410827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee6c005210 msgr2=0x7fee800c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.379+0000 7fee77fff700 1 --2- 172.21.15.112:0/2824410827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee6c005210 0x7fee800c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.379+0000 7fee77fff700 1 -- 172.21.15.112:0/2824410827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee800c4e70 con 0x7fee800c5e90 2023-09-12T16:07:25.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.379+0000 7fc200dff700 1 -- 172.21.15.112:0/393367525 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1fc0ce6e0 msgr2=0x7fc1fc15b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.379+0000 7fc200dff700 1 --2- 172.21.15.112:0/393367525 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1fc0ce6e0 0x7fc1fc15b460 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0005fd0 tx=0x7fc1f0009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:25.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.380+0000 7fc200dff700 1 -- 172.21.15.112:0/393367525 shutdown_connections 2023-09-12T16:07:25.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.380+0000 7fc200dff700 1 --2- 172.21.15.112:0/393367525 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1fc0ce6e0 0x7fc1fc15b460 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.380+0000 7fc200dff700 1 --2- 172.21.15.112:0/393367525 >> v2:172.21.15.144:3300/0 conn(0x7fc1fc0d2490 0x7fc1fc0d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.380+0000 7fc200dff700 1 -- 172.21.15.112:0/393367525 >> 172.21.15.112:0/393367525 conn(0x7fc1fc09abe0 msgr2=0x7fc1fc0d1830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.379+0000 7f43b7fff700 1 -- 172.21.15.112:0/2376907050 wait complete. 2023-09-12T16:07:25.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.380+0000 7fc200dff700 1 -- 172.21.15.112:0/393367525 shutdown_connections 2023-09-12T16:07:25.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.380+0000 7fc200dff700 1 -- 172.21.15.112:0/393367525 wait complete. 2023-09-12T16:07:25.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.380+0000 7fee77fff700 1 --2- 172.21.15.112:0/2824410827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee800c5e90 0x7fee801ee8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fee68005fd0 tx=0x7fee68007d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.381+0000 7fbcc03ff700 1 -- 172.21.15.112:0/463852501 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcb80ce6e0 msgr2=0x7fbcb815b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.381+0000 7fbcc03ff700 1 --2- 172.21.15.112:0/463852501 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcb80ce6e0 0x7fbcb815b460 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009fd0 tx=0x7fbcb000b380 comp rx=0 tx=0).stop 2023-09-12T16:07:25.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.381+0000 7fbcc03ff700 1 -- 172.21.15.112:0/463852501 shutdown_connections 2023-09-12T16:07:25.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.381+0000 7fbcc03ff700 1 --2- 172.21.15.112:0/463852501 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcb80ce6e0 0x7fbcb815b460 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.381+0000 7fbcc03ff700 1 --2- 172.21.15.112:0/463852501 >> v2:172.21.15.144:3300/0 conn(0x7fbcb80d2490 0x7fbcb80d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.381+0000 7fbcc03ff700 1 -- 172.21.15.112:0/463852501 >> 172.21.15.112:0/463852501 conn(0x7fbcb809abe0 msgr2=0x7fbcb80d1830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.381+0000 7fbcc03ff700 1 -- 172.21.15.112:0/463852501 shutdown_connections 2023-09-12T16:07:25.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.381+0000 7fbcc03ff700 1 -- 172.21.15.112:0/463852501 wait complete. 2023-09-12T16:07:25.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.383+0000 7f43b7fff700 1 Processor -- start 2023-09-12T16:07:25.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.383+0000 7f43b7fff700 1 -- start start 2023-09-12T16:07:25.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.384+0000 7fbcc03ff700 1 Processor -- start 2023-09-12T16:07:25.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.383+0000 7fc200dff700 1 Processor -- start 2023-09-12T16:07:25.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.384+0000 7fee76ffd700 1 -- 172.21.15.112:0/2824410827 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6800f9c0 con 0x7fee800c5e90 2023-09-12T16:07:25.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.384+0000 7fee76ffd700 1 -- 172.21.15.112:0/2824410827 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fee68010040 con 0x7fee800c5e90 2023-09-12T16:07:25.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.384+0000 7fee76ffd700 1 -- 172.21.15.112:0/2824410827 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6800fd80 con 0x7fee800c5e90 2023-09-12T16:07:25.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.384+0000 7fee84dff700 1 -- 172.21.15.112:0/2824410827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee800c5150 con 0x7fee800c5e90 2023-09-12T16:07:25.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.384+0000 7f43b7fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43b0071e90 0x7f43b014ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.384+0000 7f43b7fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43b0072310 0x7f43b0159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.385+0000 7f43b7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43b00af390 0x7f43b0156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.385+0000 7f43b7fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b014cf80 con 0x7f43b00af390 2023-09-12T16:07:25.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.385+0000 7f43b7fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b0157640 con 0x7f43b0071e90 2023-09-12T16:07:25.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.385+0000 7f43b7fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b01578e0 con 0x7f43b0072310 2023-09-12T16:07:25.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.385+0000 7fee84dff700 1 -- 172.21.15.112:0/2824410827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee800c4580 con 0x7fee800c5e90 2023-09-12T16:07:25.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.388+0000 7fee84dff700 1 -- 172.21.15.112:0/2824410827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fee80157e70 con 0x7fee800c5e90 2023-09-12T16:07:25.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.385+0000 7fbcc03ff700 1 -- start start 2023-09-12T16:07:25.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.386+0000 7fbcc03ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbcb80ce300 0x7fbcb80c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.386+0000 7fbcc03ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcb80ce6e0 0x7fbcb8154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.387+0000 7fbcc03ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcb80d2490 0x7fbcb80cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.387+0000 7fbcc03ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb80ca230 con 0x7fbcb80ce6e0 2023-09-12T16:07:25.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.387+0000 7fbcc03ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb80ca480 con 0x7fbcb80ce300 2023-09-12T16:07:25.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.387+0000 7fbcc03ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb80ca760 con 0x7fbcb80d2490 2023-09-12T16:07:25.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.384+0000 7fc200dff700 1 -- start start 2023-09-12T16:07:25.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.386+0000 7fc200dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1fc0ce300 0x7fc1fc14c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.386+0000 7fc200dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1fc0ce6e0 0x7fc1fc150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.386+0000 7fc200dff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1fc0d2490 0x7fc1fc0caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.386+0000 7fc200dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc14fe00 con 0x7fc1fc0ce6e0 2023-09-12T16:07:25.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.386+0000 7fc200dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc14f230 con 0x7fc1fc0ce300 2023-09-12T16:07:25.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.386+0000 7fc200dff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc1eece0 con 0x7fc1fc0d2490 2023-09-12T16:07:25.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.387+0000 7fc1fa59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1fc0ce300 0x7fc1fc14c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.387+0000 7fc1fa59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1fc0ce300 0x7fc1fc14c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.112:44056/0 (socket says 172.21.15.112:44056) 2023-09-12T16:07:25.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.387+0000 7fc1fa59c700 1 -- 172.21.15.112:0/1483183586 learned_addr learned my addr 172.21.15.112:0/1483183586 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:25.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.387+0000 7fc1fad9d700 1 --2- 172.21.15.112:0/1483183586 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1fc0d2490 0x7fc1fc0caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.385+0000 7f43b559a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43b0072310 0x7f43b0159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.385+0000 7f43b559a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43b0072310 0x7f43b0159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.112:59200/0 (socket says 172.21.15.112:59200) 2023-09-12T16:07:25.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.385+0000 7f43b559a700 1 -- 172.21.15.112:0/1737881258 learned_addr learned my addr 172.21.15.112:0/1737881258 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:25.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.386+0000 7f43b559a700 1 -- 172.21.15.112:0/1737881258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43b0071e90 msgr2=0x7f43b014ca40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-12T16:07:25.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.386+0000 7f43b559a700 1 --2- 172.21.15.112:0/1737881258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43b0071e90 0x7f43b014ca40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.386+0000 7f43b559a700 1 -- 172.21.15.112:0/1737881258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43b00af390 msgr2=0x7f43b0156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.386+0000 7f43b559a700 1 --2- 172.21.15.112:0/1737881258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43b00af390 0x7f43b0156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.386+0000 7f43b559a700 1 -- 172.21.15.112:0/1737881258 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a8009d00 con 0x7f43b0072310 2023-09-12T16:07:25.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.386+0000 7f43b559a700 1 --2- 172.21.15.112:0/1737881258 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43b0072310 0x7f43b0159c10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f43a800b070 tx=0x7f43a8009450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.387+0000 7f43a67fc700 1 -- 172.21.15.112:0/1737881258 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a800e050 con 0x7f43b0072310 2023-09-12T16:07:25.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.387+0000 7f43a67fc700 1 -- 172.21.15.112:0/1737881258 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f43a8008c90 con 0x7f43b0072310 2023-09-12T16:07:25.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.387+0000 7f43a67fc700 1 -- 172.21.15.112:0/1737881258 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a8004030 con 0x7f43b0072310 2023-09-12T16:07:25.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.387+0000 7f43b7fff700 1 -- 172.21.15.112:0/1737881258 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b0157bc0 con 0x7f43b0072310 2023-09-12T16:07:25.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.387+0000 7f43b7fff700 1 -- 172.21.15.112:0/1737881258 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b0158180 con 0x7f43b0072310 2023-09-12T16:07:25.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.389+0000 7fbcbe99c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcb80d2490 0x7fbcb80cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.389+0000 7fbcbe99c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcb80d2490 0x7fbcb80cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.112:59208/0 (socket says 172.21.15.112:59208) 2023-09-12T16:07:25.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.389+0000 7fbcbe99c700 1 -- 172.21.15.112:0/3679652363 learned_addr learned my addr 172.21.15.112:0/3679652363 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:25.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.390+0000 7fbcbe19b700 1 --2- 172.21.15.112:0/3679652363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbcb80ce300 0x7fbcb80c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.390+0000 7fbcbd99a700 1 --2- 172.21.15.112:0/3679652363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcb80ce6e0 0x7fbcb8154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.390+0000 7fbcbe99c700 1 -- 172.21.15.112:0/3679652363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbcb80ce300 msgr2=0x7fbcb80c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.390+0000 7fbcbe99c700 1 --2- 172.21.15.112:0/3679652363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbcb80ce300 0x7fbcb80c5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.390+0000 7fbcbe99c700 1 -- 172.21.15.112:0/3679652363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcb80ce6e0 msgr2=0x7fbcb8154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.390+0000 7fbcbe99c700 1 --2- 172.21.15.112:0/3679652363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcb80ce6e0 0x7fbcb8154c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.390+0000 7fbcbe99c700 1 -- 172.21.15.112:0/3679652363 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb0009d00 con 0x7fbcb80d2490 2023-09-12T16:07:25.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.388+0000 7fc1fad9d700 1 -- 172.21.15.112:0/1483183586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1fc0ce300 msgr2=0x7fc1fc14c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.388+0000 7fc1fad9d700 1 --2- 172.21.15.112:0/1483183586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1fc0ce300 0x7fc1fc14c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.389+0000 7fc1fad9d700 1 -- 172.21.15.112:0/1483183586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1fc0ce6e0 msgr2=0x7fc1fc150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.389+0000 7fc1fad9d700 1 --2- 172.21.15.112:0/1483183586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1fc0ce6e0 0x7fc1fc150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.389+0000 7fc1fad9d700 1 -- 172.21.15.112:0/1483183586 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f00095f0 con 0x7fc1fc0d2490 2023-09-12T16:07:25.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.388+0000 7f43b7fff700 1 -- 172.21.15.112:0/1737881258 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4398000fb0 con 0x7f43b0072310 2023-09-12T16:07:25.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.391+0000 7fbcbe99c700 1 --2- 172.21.15.112:0/3679652363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcb80d2490 0x7fbcb80cb520 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbcb80cffa0 tx=0x7fbcb0007b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.391+0000 7fc1fad9d700 1 --2- 172.21.15.112:0/1483183586 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1fc0d2490 0x7fc1fc0caeb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0015000 tx=0x7fc1f0004a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.391+0000 7fc1eaffd700 1 -- 172.21.15.112:0/1483183586 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f001d070 con 0x7fc1fc0d2490 2023-09-12T16:07:25.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.391+0000 7fc1eaffd700 1 -- 172.21.15.112:0/1483183586 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc1f000be50 con 0x7fc1fc0d2490 2023-09-12T16:07:25.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.391+0000 7fc1eaffd700 1 -- 172.21.15.112:0/1483183586 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0005260 con 0x7fc1fc0d2490 2023-09-12T16:07:25.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.391+0000 7fee76ffd700 1 -- 172.21.15.112:0/2824410827 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fee68004850 con 0x7fee800c5e90 2023-09-12T16:07:25.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.391+0000 7fbcaeffd700 1 -- 172.21.15.112:0/3679652363 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb000e040 con 0x7fbcb80d2490 2023-09-12T16:07:25.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.391+0000 7fbcaeffd700 1 -- 172.21.15.112:0/3679652363 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbcb0003c00 con 0x7fbcb80d2490 2023-09-12T16:07:25.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.391+0000 7fbcaeffd700 1 -- 172.21.15.112:0/3679652363 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb000beb0 con 0x7fbcb80d2490 2023-09-12T16:07:25.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.391+0000 7fbcc03ff700 1 -- 172.21.15.112:0/3679652363 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb80caa40 con 0x7fbcb80d2490 2023-09-12T16:07:25.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.391+0000 7fbcc03ff700 1 -- 172.21.15.112:0/3679652363 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb80cb000 con 0x7fbcb80d2490 2023-09-12T16:07:25.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.393+0000 7fee76ffd700 1 --2- 172.21.15.112:0/2824410827 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fee6006a650 0x7fee6006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.392+0000 7f43a67fc700 1 -- 172.21.15.112:0/1737881258 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f43a8019040 con 0x7f43b0072310 2023-09-12T16:07:25.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.393+0000 7f43a67fc700 1 --2- 172.21.15.112:0/1737881258 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f439406a650 0x7f439406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.393+0000 7f43a67fc700 1 -- 172.21.15.112:0/1737881258 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f43a808a800 con 0x7f43b0072310 2023-09-12T16:07:25.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.394+0000 7f43a67fc700 1 --2- 172.21.15.112:0/1737881258 >> [v2:172.21.15.112:6824/2420650766,v1:172.21.15.112:6825/2420650766] conn(0x7f4394073c90 0x7f43940760d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.394+0000 7f43a67fc700 1 -- 172.21.15.112:0/1737881258 --> [v2:172.21.15.112:6824/2420650766,v1:172.21.15.112:6825/2420650766] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f43940767a0 con 0x7f4394073c90 2023-09-12T16:07:25.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.394+0000 7f43a67fc700 1 -- 172.21.15.112:0/1737881258 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43a808abb0 con 0x7f43b0072310 2023-09-12T16:07:25.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.393+0000 7fc200dff700 1 -- 172.21.15.112:0/1483183586 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1fc14f460 con 0x7fc1fc0d2490 2023-09-12T16:07:25.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.393+0000 7fc200dff700 1 -- 172.21.15.112:0/1483183586 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1fc14fa20 con 0x7fc1fc0d2490 2023-09-12T16:07:25.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.393+0000 7fae12bff700 1 -- 172.21.15.112:0/3921475778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae0c071e90 msgr2=0x7fae0c15f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.393+0000 7fae12bff700 1 --2- 172.21.15.112:0/3921475778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae0c071e90 0x7fae0c15f730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fadfc009840 tx=0x7fadfc009b50 comp rx=0 tx=0).stop 2023-09-12T16:07:25.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.393+0000 7fee76ffd700 1 -- 172.21.15.112:0/2824410827 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fee68088d50 con 0x7fee800c5e90 2023-09-12T16:07:25.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.393+0000 7fee76ffd700 1 --2- 172.21.15.112:0/2824410827 >> [v2:172.21.15.112:6808/3024311046,v1:172.21.15.112:6809/3024311046] conn(0x7fee60073c10 0x7fee60076050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.393+0000 7fee76ffd700 1 -- 172.21.15.112:0/2824410827 --> [v2:172.21.15.112:6808/3024311046,v1:172.21.15.112:6809/3024311046] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee60076720 con 0x7fee60073c10 2023-09-12T16:07:25.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.393+0000 7fee76ffd700 1 -- 172.21.15.112:0/2824410827 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee68053df0 con 0x7fee800c5e90 2023-09-12T16:07:25.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.394+0000 7fee7ed9d700 1 --2- 172.21.15.112:0/2824410827 >> [v2:172.21.15.112:6808/3024311046,v1:172.21.15.112:6809/3024311046] conn(0x7fee60073c10 0x7fee60076050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.395+0000 7fee7ed9d700 1 --2- 172.21.15.112:0/2824410827 >> [v2:172.21.15.112:6808/3024311046,v1:172.21.15.112:6809/3024311046] conn(0x7fee60073c10 0x7fee60076050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.394+0000 7fbcc03ff700 1 -- 172.21.15.112:0/3679652363 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbca0000fb0 con 0x7fbcb80d2490 2023-09-12T16:07:25.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.395+0000 7fee7e59c700 1 --2- 172.21.15.112:0/2824410827 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fee6006a650 0x7fee6006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.395+0000 7f43b5d9b700 1 --2- 172.21.15.112:0/1737881258 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f439406a650 0x7f439406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.396+0000 7fc200dff700 1 -- 172.21.15.112:0/1483183586 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc1e0000fb0 con 0x7fc1fc0d2490 2023-09-12T16:07:25.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.396+0000 7fee76ffd700 1 -- 172.21.15.112:0/2824410827 <== osd.0 v2:172.21.15.112:6808/3024311046 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fee60076720 con 0x7fee60073c10 2023-09-12T16:07:25.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.397+0000 7fee7e59c700 1 --2- 172.21.15.112:0/2824410827 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fee6006a650 0x7fee6006cb10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fee70001720 tx=0x7fee700015d0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.397+0000 7fe352dff700 1 -- 172.21.15.112:0/3898110267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe34c0c8460 msgr2=0x7fe34c0cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.397+0000 7fe352dff700 1 --2- 172.21.15.112:0/3898110267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe34c0c8460 0x7fe34c0cb3d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0ce550 tx=0x7fe334009ba0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.397+0000 7f43b659c700 1 --2- 172.21.15.112:0/1737881258 >> [v2:172.21.15.112:6824/2420650766,v1:172.21.15.112:6825/2420650766] conn(0x7f4394073c90 0x7f43940760d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.397+0000 7fe352dff700 1 -- 172.21.15.112:0/3898110267 shutdown_connections 2023-09-12T16:07:25.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.397+0000 7fe352dff700 1 --2- 172.21.15.112:0/3898110267 >> v2:172.21.15.112:3300/0 conn(0x7fe34c0af390 0x7fe34c0af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.397+0000 7fe352dff700 1 --2- 172.21.15.112:0/3898110267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe34c0c8460 0x7fe34c0cb3d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.397+0000 7fe352dff700 1 -- 172.21.15.112:0/3898110267 >> 172.21.15.112:0/3898110267 conn(0x7fe34c06a200 msgr2=0x7fe34c06a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.397+0000 7fbcaeffd700 1 -- 172.21.15.112:0/3679652363 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fbcb0004000 con 0x7fbcb80d2490 2023-09-12T16:07:25.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.398+0000 7f43b5d9b700 1 --2- 172.21.15.112:0/1737881258 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f439406a650 0x7f439406cb10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00ba10 tx=0x7f43ac00b3f0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.398+0000 7fe352dff700 1 -- 172.21.15.112:0/3898110267 shutdown_connections 2023-09-12T16:07:25.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.398+0000 7f43b659c700 1 --2- 172.21.15.112:0/1737881258 >> [v2:172.21.15.112:6824/2420650766,v1:172.21.15.112:6825/2420650766] conn(0x7f4394073c90 0x7f43940760d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.398+0000 7fe352dff700 1 -- 172.21.15.112:0/3898110267 wait complete. 2023-09-12T16:07:25.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.398+0000 7fae12bff700 1 -- 172.21.15.112:0/3921475778 shutdown_connections 2023-09-12T16:07:25.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.398+0000 7fae12bff700 1 --2- 172.21.15.112:0/3921475778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae0c071e90 0x7fae0c15f730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.398+0000 7fae12bff700 1 -- 172.21.15.112:0/3921475778 >> 172.21.15.112:0/3921475778 conn(0x7fae0c06a200 msgr2=0x7fae0c06a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.398+0000 7fc1eaffd700 1 -- 172.21.15.112:0/1483183586 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fc1f0042b60 con 0x7fc1fc0d2490 2023-09-12T16:07:25.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.399+0000 7fc1eaffd700 1 --2- 172.21.15.112:0/1483183586 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc1dc06a680 0x7fc1dc06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.399+0000 7fc1eaffd700 1 -- 172.21.15.112:0/1483183586 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc1f008a4b0 con 0x7fc1fc0d2490 2023-09-12T16:07:25.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.399+0000 7fc1eaffd700 1 --2- 172.21.15.112:0/1483183586 >> [v2:172.21.15.112:6816/3849733449,v1:172.21.15.112:6817/3849733449] conn(0x7fc1dc073cc0 0x7fc1dc076100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.399+0000 7fc1eaffd700 1 -- 172.21.15.112:0/1483183586 --> [v2:172.21.15.112:6816/3849733449,v1:172.21.15.112:6817/3849733449] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc1dc0767d0 con 0x7fc1dc073cc0 2023-09-12T16:07:25.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.399+0000 7fc1eaffd700 1 -- 172.21.15.112:0/1483183586 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1f008a860 con 0x7fc1fc0d2490 2023-09-12T16:07:25.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.399+0000 7fbcaeffd700 1 --2- 172.21.15.112:0/3679652363 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbc9c06a5d0 0x7fbc9c06ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.399+0000 7fbcaeffd700 1 -- 172.21.15.112:0/3679652363 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbcb0042e40 con 0x7fbcb80d2490 2023-09-12T16:07:25.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.399+0000 7fbcaeffd700 1 --2- 172.21.15.112:0/3679652363 >> [v2:172.21.15.112:6800/3868819689,v1:172.21.15.112:6801/3868819689] conn(0x7fbc9c073c10 0x7fbc9c076050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.399+0000 7fbcaeffd700 1 -- 172.21.15.112:0/3679652363 --> [v2:172.21.15.112:6800/3868819689,v1:172.21.15.112:6801/3868819689] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc9c076720 con 0x7fbc9c073c10 2023-09-12T16:07:25.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.399+0000 7fbcaeffd700 1 -- 172.21.15.112:0/3679652363 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbcb008ade0 con 0x7fbcb80d2490 2023-09-12T16:07:25.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.400+0000 7fbcbe19b700 1 --2- 172.21.15.112:0/3679652363 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbc9c06a5d0 0x7fbc9c06ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.400+0000 7fc1fa59c700 1 --2- 172.21.15.112:0/1483183586 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc1dc06a680 0x7fc1dc06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.400+0000 7fc1f9d9b700 1 --2- 172.21.15.112:0/1483183586 >> [v2:172.21.15.112:6816/3849733449,v1:172.21.15.112:6817/3849733449] conn(0x7fc1dc073cc0 0x7fc1dc076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.400+0000 7fae12bff700 1 -- 172.21.15.112:0/3921475778 shutdown_connections 2023-09-12T16:07:25.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.400+0000 7fbcbd99a700 1 --2- 172.21.15.112:0/3679652363 >> [v2:172.21.15.112:6800/3868819689,v1:172.21.15.112:6801/3868819689] conn(0x7fbc9c073c10 0x7fbc9c076050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.400+0000 7f43a67fc700 1 -- 172.21.15.112:0/1737881258 <== osd.3 v2:172.21.15.112:6824/2420650766 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f43940767a0 con 0x7f4394073c90 2023-09-12T16:07:25.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.400+0000 7fae12bff700 1 -- 172.21.15.112:0/3921475778 wait complete. 2023-09-12T16:07:25.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.399+0000 7fd9d57ff700 1 -- 172.21.15.112:0/2048331555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9d006a020 msgr2=0x7fd9d006a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.399+0000 7fd9d57ff700 1 --2- 172.21.15.112:0/2048331555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9d006a020 0x7fd9d006a4b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009f60 tx=0x7fd9c0009f90 comp rx=0 tx=0).stop 2023-09-12T16:07:25.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.400+0000 7fd9d57ff700 1 -- 172.21.15.112:0/2048331555 shutdown_connections 2023-09-12T16:07:25.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.400+0000 7fd9d57ff700 1 --2- 172.21.15.112:0/2048331555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9d006a020 0x7fd9d006a4b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.400+0000 7fd9d57ff700 1 --2- 172.21.15.112:0/2048331555 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9d00b0c20 0x7fd9d00ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.400+0000 7fd9d57ff700 1 -- 172.21.15.112:0/2048331555 >> 172.21.15.112:0/2048331555 conn(0x7fd9d006b760 msgr2=0x7fd9d006d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.401+0000 7fc1fa59c700 1 --2- 172.21.15.112:0/1483183586 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc1dc06a680 0x7fc1dc06cb40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4005a30 tx=0x7fc1f4004370 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.401+0000 7fbcbd99a700 1 --2- 172.21.15.112:0/3679652363 >> [v2:172.21.15.112:6800/3868819689,v1:172.21.15.112:6801/3868819689] conn(0x7fbc9c073c10 0x7fbc9c076050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.401+0000 7fc1f9d9b700 1 --2- 172.21.15.112:0/1483183586 >> [v2:172.21.15.112:6816/3849733449,v1:172.21.15.112:6817/3849733449] conn(0x7fc1dc073cc0 0x7fc1dc076100 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.402+0000 7fae12bff700 1 Processor -- start 2023-09-12T16:07:25.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.403+0000 7fbcaeffd700 1 -- 172.21.15.112:0/3679652363 <== osd.1 v2:172.21.15.112:6800/3868819689 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fbc9c076720 con 0x7fbc9c073c10 2023-09-12T16:07:25.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.403+0000 7fae12bff700 1 -- start start 2023-09-12T16:07:25.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.404+0000 7fc1eaffd700 1 -- 172.21.15.112:0/1483183586 <== osd.2 v2:172.21.15.112:6816/3849733449 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc1dc0767d0 con 0x7fc1dc073cc0 2023-09-12T16:07:25.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.404+0000 7fae12bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae0c071e90 0x7fae0c0acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.402+0000 7fe352dff700 1 Processor -- start 2023-09-12T16:07:25.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.402+0000 7fe352dff700 1 -- start start 2023-09-12T16:07:25.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.404+0000 7fe352dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe34c0af390 0x7fe34c0c3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.404+0000 7fe352dff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe34c0c8460 0x7fe34c0c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.404+0000 7fe352dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe34c0c8840 0x7fe34c158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.404+0000 7fe352dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c0c2760 con 0x7fe34c0c8840 2023-09-12T16:07:25.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.404+0000 7fe352dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c0c1b50 con 0x7fe34c0af390 2023-09-12T16:07:25.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.404+0000 7fe352dff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c0c1e30 con 0x7fe34c0c8460 2023-09-12T16:07:25.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.404+0000 7fe350b9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe34c0af390 0x7fe34c0c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.404+0000 7fe350b9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe34c0af390 0x7fe34c0c3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.112:44094/0 (socket says 172.21.15.112:44094) 2023-09-12T16:07:25.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.404+0000 7fe350b9b700 1 -- 172.21.15.112:0/436925790 learned_addr learned my addr 172.21.15.112:0/436925790 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:25.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.404+0000 7fe34bfff700 1 --2- 172.21.15.112:0/436925790 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe34c0c8460 0x7fe34c0c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.405+0000 7fe34bfff700 1 -- 172.21.15.112:0/436925790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe34c0af390 msgr2=0x7fe34c0c3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.405+0000 7fe34bfff700 1 --2- 172.21.15.112:0/436925790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe34c0af390 0x7fe34c0c3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.405+0000 7fe34bfff700 1 -- 172.21.15.112:0/436925790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe34c0c8840 msgr2=0x7fe34c158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.405+0000 7fe34bfff700 1 --2- 172.21.15.112:0/436925790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe34c0c8840 0x7fe34c158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.405+0000 7fe34bfff700 1 -- 172.21.15.112:0/436925790 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe334009520 con 0x7fe34c0c8460 2023-09-12T16:07:25.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.405+0000 7fe34bfff700 1 --2- 172.21.15.112:0/436925790 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe34c0c8460 0x7fe34c0c38c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe34400c8f0 tx=0x7fe34400ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.406+0000 7fe3497fa700 1 -- 172.21.15.112:0/436925790 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344003e10 con 0x7fe34c0c8460 2023-09-12T16:07:25.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.406+0000 7fe3497fa700 1 -- 172.21.15.112:0/436925790 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe344005070 con 0x7fe34c0c8460 2023-09-12T16:07:25.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.406+0000 7fe3497fa700 1 -- 172.21.15.112:0/436925790 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344005440 con 0x7fe34c0c8460 2023-09-12T16:07:25.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.406+0000 7fbcbe19b700 1 --2- 172.21.15.112:0/3679652363 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbc9c06a5d0 0x7fbc9c06ca90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbca8007fd0 tx=0x7fbca8009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.407+0000 7fe352dff700 1 -- 172.21.15.112:0/436925790 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe34c0c2110 con 0x7fe34c0c8460 2023-09-12T16:07:25.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.407+0000 7fe352dff700 1 -- 172.21.15.112:0/436925790 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe34c159830 con 0x7fe34c0c8460 2023-09-12T16:07:25.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.405+0000 7fae12bff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae0c0af390 0x7fae0c0c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.405+0000 7fae12bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0c15fc70 0x7fae0c0c2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.405+0000 7fae12bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c0cc4b0 con 0x7fae0c15fc70 2023-09-12T16:07:25.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.405+0000 7fae12bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c154390 con 0x7fae0c071e90 2023-09-12T16:07:25.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.405+0000 7fae12bff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c154670 con 0x7fae0c0af390 2023-09-12T16:07:25.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.405+0000 7fae03fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae0c0af390 0x7fae0c0c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.405+0000 7fae03fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae0c0af390 0x7fae0c0c28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.112:59250/0 (socket says 172.21.15.112:59250) 2023-09-12T16:07:25.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.405+0000 7fae03fff700 1 -- 172.21.15.112:0/867690881 learned_addr learned my addr 172.21.15.112:0/867690881 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:25.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.407+0000 7fae1099b700 1 --2- 172.21.15.112:0/867690881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae0c071e90 0x7fae0c0acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.407+0000 7fae03fff700 1 -- 172.21.15.112:0/867690881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae0c071e90 msgr2=0x7fae0c0acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.407+0000 7fae03fff700 1 --2- 172.21.15.112:0/867690881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae0c071e90 0x7fae0c0acfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.407+0000 7fae03fff700 1 -- 172.21.15.112:0/867690881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0c15fc70 msgr2=0x7fae0c0c2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.407+0000 7fae03fff700 1 --2- 172.21.15.112:0/867690881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0c15fc70 0x7fae0c0c2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.407+0000 7fae03fff700 1 -- 172.21.15.112:0/867690881 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc009520 con 0x7fae0c0af390 2023-09-12T16:07:25.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.406+0000 7fd9d57ff700 1 -- 172.21.15.112:0/2048331555 shutdown_connections 2023-09-12T16:07:25.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.407+0000 7fae03fff700 1 --2- 172.21.15.112:0/867690881 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae0c0af390 0x7fae0c0c28e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fadfc004000 tx=0x7fadfc003f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.408+0000 7fae017fa700 1 -- 172.21.15.112:0/867690881 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc00bb20 con 0x7fae0c0af390 2023-09-12T16:07:25.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.408+0000 7fae017fa700 1 -- 172.21.15.112:0/867690881 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fadfc00bd70 con 0x7fae0c0af390 2023-09-12T16:07:25.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.408+0000 7fae017fa700 1 -- 172.21.15.112:0/867690881 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc00f6c0 con 0x7fae0c0af390 2023-09-12T16:07:25.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.408+0000 7fae12bff700 1 -- 172.21.15.112:0/867690881 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0c154950 con 0x7fae0c0af390 2023-09-12T16:07:25.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.408+0000 7fae12bff700 1 -- 172.21.15.112:0/867690881 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0c154f10 con 0x7fae0c0af390 2023-09-12T16:07:25.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.410+0000 7fd9d57ff700 1 -- 172.21.15.112:0/2048331555 wait complete. 2023-09-12T16:07:25.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.410+0000 7fe3497fa700 1 -- 172.21.15.112:0/436925790 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe3440055a0 con 0x7fe34c0c8460 2023-09-12T16:07:25.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.412+0000 7fe3497fa700 1 --2- 172.21.15.112:0/436925790 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe32c06a580 0x7fe32c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.412+0000 7fe3497fa700 1 -- 172.21.15.112:0/436925790 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe3440885c0 con 0x7fe34c0c8460 2023-09-12T16:07:25.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.412+0000 7fd9d57ff700 1 Processor -- start 2023-09-12T16:07:25.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.413+0000 7fd9d57ff700 1 -- start start 2023-09-12T16:07:25.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.413+0000 7fe350b9b700 1 --2- 172.21.15.112:0/436925790 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe32c06a580 0x7fe32c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.413+0000 7f76bc3ff700 1 -- 172.21.15.112:0/3357360062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76b40cfde0 msgr2=0x7f76b40d01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.413+0000 7f76bc3ff700 1 --2- 172.21.15.112:0/3357360062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76b40cfde0 0x7f76b40d01c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f76b415f640 tx=0x7f76a4009ba0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.413+0000 7fe352dff700 1 --2- 172.21.15.112:0/436925790 >> [v2:172.21.15.144:6805/490270140,v1:172.21.15.144:6807/490270140] conn(0x7fe34c15f960 0x7fe34c0cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.413+0000 7fe352dff700 1 -- 172.21.15.112:0/436925790 --> [v2:172.21.15.144:6805/490270140,v1:172.21.15.144:6807/490270140] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe34c0c28a0 con 0x7fe34c15f960 2023-09-12T16:07:25.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.412+0000 7fae017fa700 1 -- 172.21.15.112:0/867690881 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fadfc00f820 con 0x7fae0c0af390 2023-09-12T16:07:25.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.413+0000 7fae017fa700 1 --2- 172.21.15.112:0/867690881 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fadf806a650 0x7fadf806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.414+0000 7fae017fa700 1 -- 172.21.15.112:0/867690881 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fadfc08a670 con 0x7fae0c0af390 2023-09-12T16:07:25.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.414+0000 7fae1099b700 1 --2- 172.21.15.112:0/867690881 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fadf806a650 0x7fadf806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.414+0000 7fd9d57ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9d006a020 0x7fd9d0151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.414+0000 7fd9d57ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9d00b0c20 0x7fd9d00c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.414+0000 7fd9d57ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d015be30 0x7fd9d01e4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.414+0000 7fd9d57ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d015d1e0 con 0x7fd9d015be30 2023-09-12T16:07:25.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.414+0000 7fd9d57ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d015c560 con 0x7fd9d006a020 2023-09-12T16:07:25.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.414+0000 7fd9d57ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d015c840 con 0x7fd9d00b0c20 2023-09-12T16:07:25.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.415+0000 7fe35139c700 1 --2- 172.21.15.112:0/436925790 >> [v2:172.21.15.144:6805/490270140,v1:172.21.15.144:6807/490270140] conn(0x7fe34c15f960 0x7fe34c0cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.415+0000 7fe350b9b700 1 --2- 172.21.15.112:0/436925790 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe32c06a580 0x7fe32c06ca40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe334009810 tx=0x7fe334019040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.415+0000 7fd9ce7fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9d00b0c20 0x7fd9d00c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.415+0000 7fd9ce7fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9d00b0c20 0x7fd9d00c71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.112:59266/0 (socket says 172.21.15.112:59266) 2023-09-12T16:07:25.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.415+0000 7fd9ce7fc700 1 -- 172.21.15.112:0/523875611 learned_addr learned my addr 172.21.15.112:0/523875611 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:25.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.415+0000 7fd9ceffd700 1 --2- 172.21.15.112:0/523875611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9d006a020 0x7fd9d0151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.415+0000 7fd9cf7fe700 1 --2- 172.21.15.112:0/523875611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d015be30 0x7fd9d01e4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.416+0000 7fd9ce7fc700 1 -- 172.21.15.112:0/523875611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9d006a020 msgr2=0x7fd9d0151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.416+0000 7fd9ce7fc700 1 --2- 172.21.15.112:0/523875611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9d006a020 0x7fd9d0151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.416+0000 7fd9ce7fc700 1 -- 172.21.15.112:0/523875611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d015be30 msgr2=0x7fd9d01e4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.416+0000 7fd9ce7fc700 1 --2- 172.21.15.112:0/523875611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d015be30 0x7fd9d01e4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.416+0000 7fd9ce7fc700 1 -- 172.21.15.112:0/523875611 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c0009c40 con 0x7fd9d00b0c20 2023-09-12T16:07:25.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.416+0000 7fd9ceffd700 1 --2- 172.21.15.112:0/523875611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9d006a020 0x7fd9d0151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-12T16:07:25.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.416+0000 7fe35139c700 1 --2- 172.21.15.112:0/436925790 >> [v2:172.21.15.144:6805/490270140,v1:172.21.15.144:6807/490270140] conn(0x7fe34c15f960 0x7fe34c0cd3c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.416+0000 7fae12bff700 1 --2- 172.21.15.112:0/867690881 >> [v2:172.21.15.144:6800/498990310,v1:172.21.15.144:6801/498990310] conn(0x7fadec0015d0 0x7fadec003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.416+0000 7fae12bff700 1 -- 172.21.15.112:0/867690881 --> [v2:172.21.15.144:6800/498990310,v1:172.21.15.144:6801/498990310] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fadec006bc0 con 0x7fadec0015d0 2023-09-12T16:07:25.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.416+0000 7fd9ce7fc700 1 --2- 172.21.15.112:0/523875611 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9d00b0c20 0x7fd9d00c71e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800e9c0 tx=0x7fd9b800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.416+0000 7fae1099b700 1 --2- 172.21.15.112:0/867690881 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fadf806a650 0x7fadf806cb10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fae080018e0 tx=0x7fae08009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.417+0000 7fd9c77fe700 1 -- 172.21.15.112:0/523875611 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8004a30 con 0x7fd9d00b0c20 2023-09-12T16:07:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.417+0000 7fd9c77fe700 1 -- 172.21.15.112:0/523875611 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd9b8004bb0 con 0x7fd9d00b0c20 2023-09-12T16:07:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.417+0000 7fd9c77fe700 1 -- 172.21.15.112:0/523875611 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b800c7c0 con 0x7fd9d00b0c20 2023-09-12T16:07:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.417+0000 7fd9d57ff700 1 -- 172.21.15.112:0/523875611 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d015cb20 con 0x7fd9d00b0c20 2023-09-12T16:07:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.417+0000 7fe3497fa700 1 -- 172.21.15.112:0/436925790 <== osd.4 v2:172.21.15.144:6805/490270140 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe33c009840 con 0x7fe34c15f960 2023-09-12T16:07:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.417+0000 7fd9d57ff700 1 -- 172.21.15.112:0/523875611 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d015d600 con 0x7fd9d00b0c20 2023-09-12T16:07:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.417+0000 7f76bc3ff700 1 -- 172.21.15.112:0/3357360062 shutdown_connections 2023-09-12T16:07:25.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.417+0000 7f76bc3ff700 1 --2- 172.21.15.112:0/3357360062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76b40cfde0 0x7f76b40d01c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.417+0000 7f76bc3ff700 1 --2- 172.21.15.112:0/3357360062 >> v2:172.21.15.144:3300/0 conn(0x7f76b415bdd0 0x7f76b40d21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.417+0000 7f76bc3ff700 1 -- 172.21.15.112:0/3357360062 >> 172.21.15.112:0/3357360062 conn(0x7f76b409ab60 msgr2=0x7f76b40d1890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.418+0000 7fd9d57ff700 1 -- 172.21.15.112:0/523875611 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd9b4000fb0 con 0x7fd9d00b0c20 2023-09-12T16:07:25.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.419+0000 7fae1119c700 1 --2- 172.21.15.112:0/867690881 >> [v2:172.21.15.144:6800/498990310,v1:172.21.15.144:6801/498990310] conn(0x7fadec0015d0 0x7fadec003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.419+0000 7f76bc3ff700 1 -- 172.21.15.112:0/3357360062 shutdown_connections 2023-09-12T16:07:25.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.419+0000 7fae1119c700 1 --2- 172.21.15.112:0/867690881 >> [v2:172.21.15.144:6800/498990310,v1:172.21.15.144:6801/498990310] conn(0x7fadec0015d0 0x7fadec003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.420+0000 7fd9c77fe700 1 -- 172.21.15.112:0/523875611 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fd9b800c920 con 0x7fd9d00b0c20 2023-09-12T16:07:25.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.422+0000 7fd9c77fe700 1 --2- 172.21.15.112:0/523875611 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd9b006a650 0x7fd9b006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.422+0000 7fd9c77fe700 1 -- 172.21.15.112:0/523875611 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd9b8014070 con 0x7fd9d00b0c20 2023-09-12T16:07:25.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.422+0000 7fd9c77fe700 1 --2- 172.21.15.112:0/523875611 >> [v2:172.21.15.144:6824/2931281424,v1:172.21.15.144:6825/2931281424] conn(0x7fd9b0073c10 0x7fd9b0076050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.422+0000 7fd9c77fe700 1 -- 172.21.15.112:0/523875611 --> [v2:172.21.15.144:6824/2931281424,v1:172.21.15.144:6825/2931281424] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd9b0076720 con 0x7fd9b0073c10 2023-09-12T16:07:25.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.422+0000 7fd9c77fe700 1 -- 172.21.15.112:0/523875611 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9b8054710 con 0x7fd9d00b0c20 2023-09-12T16:07:25.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.422+0000 7fae017fa700 1 -- 172.21.15.112:0/867690881 <== osd.5 v2:172.21.15.144:6800/498990310 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fadec006bc0 con 0x7fadec0015d0 2023-09-12T16:07:25.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.420+0000 7f76bc3ff700 1 -- 172.21.15.112:0/3357360062 wait complete. 2023-09-12T16:07:25.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.422+0000 7f76bc3ff700 1 Processor -- start 2023-09-12T16:07:25.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.423+0000 7f76bc3ff700 1 -- start start 2023-09-12T16:07:25.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.424+0000 7f76bc3ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76b40cf5e0 0x7f76b40b6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.424+0000 7f76bc3ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76b40cfde0 0x7f76b420bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.424+0000 7f76bc3ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76b415bdd0 0x7f76b40b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.424+0000 7f76bc3ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b420c040 con 0x7f76b40cf5e0 2023-09-12T16:07:25.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.425+0000 7f76bc3ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b40cb8a0 con 0x7f76b415bdd0 2023-09-12T16:07:25.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.425+0000 7f76bc3ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b4088b80 con 0x7f76b40cfde0 2023-09-12T16:07:25.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.425+0000 7f76b999a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76b40cfde0 0x7f76b420bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.425+0000 7f76b999a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76b40cfde0 0x7f76b420bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.112:59276/0 (socket says 172.21.15.112:59276) 2023-09-12T16:07:25.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.425+0000 7f76b999a700 1 -- 172.21.15.112:0/2448533340 learned_addr learned my addr 172.21.15.112:0/2448533340 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:25.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.426+0000 7f76ba19b700 1 --2- 172.21.15.112:0/2448533340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76b40cf5e0 0x7f76b40b6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.425+0000 7fd9ceffd700 1 --2- 172.21.15.112:0/523875611 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd9b006a650 0x7fd9b006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.426+0000 7fd9cf7fe700 1 --2- 172.21.15.112:0/523875611 >> [v2:172.21.15.144:6824/2931281424,v1:172.21.15.144:6825/2931281424] conn(0x7fd9b0073c10 0x7fd9b0076050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.426+0000 7f76b999a700 1 -- 172.21.15.112:0/2448533340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76b415bdd0 msgr2=0x7f76b40b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.426+0000 7f76b999a700 1 --2- 172.21.15.112:0/2448533340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76b415bdd0 0x7f76b40b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.426+0000 7f76b999a700 1 -- 172.21.15.112:0/2448533340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76b40cf5e0 msgr2=0x7f76b40b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.426+0000 7f76b999a700 1 --2- 172.21.15.112:0/2448533340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76b40cf5e0 0x7f76b40b6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.426+0000 7f76b999a700 1 -- 172.21.15.112:0/2448533340 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a4009520 con 0x7f76b40cfde0 2023-09-12T16:07:25.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.426+0000 7f76b999a700 1 --2- 172.21.15.112:0/2448533340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76b40cfde0 0x7f76b420bb00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f76b000ea20 tx=0x7f76b000ede0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.427+0000 7f76aaffd700 1 -- 172.21.15.112:0/2448533340 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b000cbd0 con 0x7f76b40cfde0 2023-09-12T16:07:25.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.427+0000 7f76aaffd700 1 -- 172.21.15.112:0/2448533340 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f76b000ce20 con 0x7f76b40cfde0 2023-09-12T16:07:25.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.427+0000 7f76aaffd700 1 -- 172.21.15.112:0/2448533340 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0010690 con 0x7f76b40cfde0 2023-09-12T16:07:25.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.426+0000 7fd9cf7fe700 1 --2- 172.21.15.112:0/523875611 >> [v2:172.21.15.144:6824/2931281424,v1:172.21.15.144:6825/2931281424] conn(0x7fd9b0073c10 0x7fd9b0076050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.427+0000 7fd9c77fe700 1 -- 172.21.15.112:0/523875611 <== osd.6 v2:172.21.15.144:6824/2931281424 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd9b0076720 con 0x7fd9b0073c10 2023-09-12T16:07:25.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.428+0000 7f76bc3ff700 1 -- 172.21.15.112:0/2448533340 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b40b69f0 con 0x7f76b40cfde0 2023-09-12T16:07:25.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.429+0000 7f76bc3ff700 1 -- 172.21.15.112:0/2448533340 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b40b5e50 con 0x7f76b40cfde0 2023-09-12T16:07:25.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.429+0000 7f76ba19b700 1 --2- 172.21.15.112:0/2448533340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76b40cf5e0 0x7f76b40b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:25.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.430+0000 7fd9ceffd700 1 --2- 172.21.15.112:0/523875611 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd9b006a650 0x7fd9b006cb10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8007fd0 tx=0x7fd9c8009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.431+0000 7f76bc3ff700 1 -- 172.21.15.112:0/2448533340 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f76b40cfac0 con 0x7f76b40cfde0 2023-09-12T16:07:25.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.431+0000 7fc200dff700 1 -- 172.21.15.112:0/1483183586 --> [v2:172.21.15.112:6816/3849733449,v1:172.21.15.112:6817/3849733449] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc1e0002d30 con 0x7fc1dc073cc0 2023-09-12T16:07:25.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.431+0000 7fee84dff700 1 -- 172.21.15.112:0/2824410827 --> [v2:172.21.15.112:6808/3024311046,v1:172.21.15.112:6809/3024311046] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fee800c6fa0 con 0x7fee60073c10 2023-09-12T16:07:25.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.432+0000 7fee76ffd700 1 -- 172.21.15.112:0/2824410827 <== osd.0 v2:172.21.15.112:6808/3024311046 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fee780011c0 con 0x7fee60073c10 2023-09-12T16:07:25.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.433+0000 7fc1eaffd700 1 -- 172.21.15.112:0/1483183586 <== osd.2 v2:172.21.15.112:6816/3849733449 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc1e0002d30 con 0x7fc1dc073cc0 2023-09-12T16:07:25.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.433+0000 7fee84dff700 1 -- 172.21.15.112:0/2824410827 >> [v2:172.21.15.112:6808/3024311046,v1:172.21.15.112:6809/3024311046] conn(0x7fee60073c10 msgr2=0x7fee60076050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.433+0000 7fee84dff700 1 --2- 172.21.15.112:0/2824410827 >> [v2:172.21.15.112:6808/3024311046,v1:172.21.15.112:6809/3024311046] conn(0x7fee60073c10 0x7fee60076050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.433+0000 7f76aaffd700 1 -- 172.21.15.112:0/2448533340 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f76b00107f0 con 0x7f76b40cfde0 2023-09-12T16:07:25.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.433+0000 7fee84dff700 1 -- 172.21.15.112:0/2824410827 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fee6006a650 msgr2=0x7fee6006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.433+0000 7fee84dff700 1 --2- 172.21.15.112:0/2824410827 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fee6006a650 0x7fee6006cb10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fee70001720 tx=0x7fee700015d0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.433+0000 7fee84dff700 1 -- 172.21.15.112:0/2824410827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee800c5e90 msgr2=0x7fee801ee8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.433+0000 7fee84dff700 1 --2- 172.21.15.112:0/2824410827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee800c5e90 0x7fee801ee8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fee68005fd0 tx=0x7fee68007d20 comp rx=0 tx=0).stop 2023-09-12T16:07:25.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.434+0000 7fee7ed9d700 1 -- 172.21.15.112:0/2824410827 reap_dead start 2023-09-12T16:07:25.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.434+0000 7fc200dff700 1 -- 172.21.15.112:0/1483183586 >> [v2:172.21.15.112:6816/3849733449,v1:172.21.15.112:6817/3849733449] conn(0x7fc1dc073cc0 msgr2=0x7fc1dc076100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.434+0000 7fc200dff700 1 --2- 172.21.15.112:0/1483183586 >> [v2:172.21.15.112:6816/3849733449,v1:172.21.15.112:6817/3849733449] conn(0x7fc1dc073cc0 0x7fc1dc076100 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.435+0000 7fc200dff700 1 -- 172.21.15.112:0/1483183586 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc1dc06a680 msgr2=0x7fc1dc06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.435+0000 7fc200dff700 1 --2- 172.21.15.112:0/1483183586 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc1dc06a680 0x7fc1dc06cb40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4005a30 tx=0x7fc1f4004370 comp rx=0 tx=0).stop 2023-09-12T16:07:25.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.435+0000 7fc200dff700 1 -- 172.21.15.112:0/1483183586 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1fc0d2490 msgr2=0x7fc1fc0caeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.435+0000 7fc200dff700 1 --2- 172.21.15.112:0/1483183586 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1fc0d2490 0x7fc1fc0caeb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0015000 tx=0x7fc1f0004a60 comp rx=0 tx=0).stop 2023-09-12T16:07:25.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.434+0000 7f76aaffd700 1 --2- 172.21.15.112:0/2448533340 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f769806a650 0x7f769806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.434+0000 7f76aaffd700 1 -- 172.21.15.112:0/2448533340 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f76b0014070 con 0x7f76b40cfde0 2023-09-12T16:07:25.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.435+0000 7f76aaffd700 1 --2- 172.21.15.112:0/2448533340 >> [v2:172.21.15.144:6816/4212271840,v1:172.21.15.144:6817/4212271840] conn(0x7f7698073c10 0x7f7698076050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.435+0000 7f76aaffd700 1 -- 172.21.15.112:0/2448533340 --> [v2:172.21.15.144:6816/4212271840,v1:172.21.15.144:6817/4212271840] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7698076720 con 0x7f7698073c10 2023-09-12T16:07:25.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.435+0000 7fc1fad9d700 1 -- 172.21.15.112:0/1483183586 reap_dead start 2023-09-12T16:07:25.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.435+0000 7f76aaffd700 1 -- 172.21.15.112:0/2448533340 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76b0054880 con 0x7f76b40cfde0 2023-09-12T16:07:25.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.435+0000 7f76ba19b700 1 --2- 172.21.15.112:0/2448533340 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f769806a650 0x7f769806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.435+0000 7f76ba99c700 1 --2- 172.21.15.112:0/2448533340 >> [v2:172.21.15.144:6816/4212271840,v1:172.21.15.144:6817/4212271840] conn(0x7f7698073c10 0x7f7698076050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.436+0000 7fee84dff700 1 -- 172.21.15.112:0/2824410827 shutdown_connections 2023-09-12T16:07:25.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.436+0000 7fee84dff700 1 -- 172.21.15.112:0/2824410827 >> 172.21.15.112:0/2824410827 conn(0x7fee8006a650 msgr2=0x7fee801583c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.436+0000 7fee84dff700 1 -- 172.21.15.112:0/2824410827 shutdown_connections 2023-09-12T16:07:25.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.436+0000 7fee84dff700 1 -- 172.21.15.112:0/2824410827 wait complete. 2023-09-12T16:07:25.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.436+0000 7fc200dff700 1 -- 172.21.15.112:0/1483183586 shutdown_connections 2023-09-12T16:07:25.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.436+0000 7fc200dff700 1 -- 172.21.15.112:0/1483183586 >> 172.21.15.112:0/1483183586 conn(0x7fc1fc09abe0 msgr2=0x7fc1fc0b60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.436+0000 7fc200dff700 1 -- 172.21.15.112:0/1483183586 shutdown_connections 2023-09-12T16:07:25.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.436+0000 7fc200dff700 1 -- 172.21.15.112:0/1483183586 wait complete. 2023-09-12T16:07:25.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.436+0000 7f76ba19b700 1 --2- 172.21.15.112:0/2448533340 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f769806a650 0x7f769806cb10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f76b415f640 tx=0x7f76a4019040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.436+0000 7f43b7fff700 1 -- 172.21.15.112:0/1737881258 --> [v2:172.21.15.112:6824/2420650766,v1:172.21.15.112:6825/2420650766] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4398002d30 con 0x7f4394073c90 2023-09-12T16:07:25.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.437+0000 7f43a67fc700 1 -- 172.21.15.112:0/1737881258 <== osd.3 v2:172.21.15.112:6824/2420650766 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4398002d30 con 0x7f4394073c90 2023-09-12T16:07:25.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.437+0000 7f43b7fff700 1 -- 172.21.15.112:0/1737881258 >> [v2:172.21.15.112:6824/2420650766,v1:172.21.15.112:6825/2420650766] conn(0x7f4394073c90 msgr2=0x7f43940760d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.437+0000 7f43b7fff700 1 --2- 172.21.15.112:0/1737881258 >> [v2:172.21.15.112:6824/2420650766,v1:172.21.15.112:6825/2420650766] conn(0x7f4394073c90 0x7f43940760d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.438+0000 7f43b7fff700 1 -- 172.21.15.112:0/1737881258 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f439406a650 msgr2=0x7f439406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.438+0000 7f43b7fff700 1 --2- 172.21.15.112:0/1737881258 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f439406a650 0x7f439406cb10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00ba10 tx=0x7f43ac00b3f0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.438+0000 7f43b7fff700 1 -- 172.21.15.112:0/1737881258 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43b0072310 msgr2=0x7f43b0159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.438+0000 7f43b7fff700 1 --2- 172.21.15.112:0/1737881258 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43b0072310 0x7f43b0159c10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f43a800b070 tx=0x7f43a8009450 comp rx=0 tx=0).stop 2023-09-12T16:07:25.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.438+0000 7f43b659c700 1 -- 172.21.15.112:0/1737881258 reap_dead start 2023-09-12T16:07:25.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.438+0000 7f43b7fff700 1 -- 172.21.15.112:0/1737881258 shutdown_connections 2023-09-12T16:07:25.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.438+0000 7f43b7fff700 1 -- 172.21.15.112:0/1737881258 >> 172.21.15.112:0/1737881258 conn(0x7f43b006a200 msgr2=0x7f43b015b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.438+0000 7f43b7fff700 1 -- 172.21.15.112:0/1737881258 shutdown_connections 2023-09-12T16:07:25.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.438+0000 7f43b7fff700 1 -- 172.21.15.112:0/1737881258 wait complete. 2023-09-12T16:07:25.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.439+0000 7f76ba99c700 1 --2- 172.21.15.112:0/2448533340 >> [v2:172.21.15.144:6816/4212271840,v1:172.21.15.144:6817/4212271840] conn(0x7f7698073c10 0x7f7698076050 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.440+0000 7fbcc03ff700 1 -- 172.21.15.112:0/3679652363 --> [v2:172.21.15.112:6800/3868819689,v1:172.21.15.112:6801/3868819689] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbca0002d30 con 0x7fbc9c073c10 2023-09-12T16:07:25.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.441+0000 7f76aaffd700 1 -- 172.21.15.112:0/2448533340 <== osd.7 v2:172.21.15.144:6816/4212271840 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f7698076720 con 0x7f7698073c10 2023-09-12T16:07:25.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.442+0000 7fbcaeffd700 1 -- 172.21.15.112:0/3679652363 <== osd.1 v2:172.21.15.112:6800/3868819689 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbca0002d30 con 0x7fbc9c073c10 2023-09-12T16:07:25.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.443+0000 7fbcc03ff700 1 -- 172.21.15.112:0/3679652363 >> [v2:172.21.15.112:6800/3868819689,v1:172.21.15.112:6801/3868819689] conn(0x7fbc9c073c10 msgr2=0x7fbc9c076050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.443+0000 7fbcc03ff700 1 --2- 172.21.15.112:0/3679652363 >> [v2:172.21.15.112:6800/3868819689,v1:172.21.15.112:6801/3868819689] conn(0x7fbc9c073c10 0x7fbc9c076050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.452+0000 7fbcc03ff700 1 -- 172.21.15.112:0/3679652363 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbc9c06a5d0 msgr2=0x7fbc9c06ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.452+0000 7fbcc03ff700 1 --2- 172.21.15.112:0/3679652363 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbc9c06a5d0 0x7fbc9c06ca90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbca8007fd0 tx=0x7fbca8009040 comp rx=0 tx=0).stop 2023-09-12T16:07:25.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.452+0000 7fbcc03ff700 1 -- 172.21.15.112:0/3679652363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcb80d2490 msgr2=0x7fbcb80cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.452+0000 7fbcc03ff700 1 --2- 172.21.15.112:0/3679652363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcb80d2490 0x7fbcb80cb520 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbcb80cffa0 tx=0x7fbcb0007b60 comp rx=0 tx=0).stop 2023-09-12T16:07:25.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.452+0000 7fbcbe99c700 1 -- 172.21.15.112:0/3679652363 reap_dead start 2023-09-12T16:07:25.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.452+0000 7fbcc03ff700 1 -- 172.21.15.112:0/3679652363 shutdown_connections 2023-09-12T16:07:25.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.452+0000 7fbcc03ff700 1 -- 172.21.15.112:0/3679652363 >> 172.21.15.112:0/3679652363 conn(0x7fbcb809abe0 msgr2=0x7fbcb80b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.452+0000 7fbcc03ff700 1 -- 172.21.15.112:0/3679652363 shutdown_connections 2023-09-12T16:07:25.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.452+0000 7fbcc03ff700 1 -- 172.21.15.112:0/3679652363 wait complete. 2023-09-12T16:07:25.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.451+0000 7fae12bff700 1 -- 172.21.15.112:0/867690881 --> [v2:172.21.15.144:6800/498990310,v1:172.21.15.144:6801/498990310] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fadec005ca0 con 0x7fadec0015d0 2023-09-12T16:07:25.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.453+0000 7fae017fa700 1 -- 172.21.15.112:0/867690881 <== osd.5 v2:172.21.15.144:6800/498990310 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fadec005ca0 con 0x7fadec0015d0 2023-09-12T16:07:25.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.455+0000 7fe352dff700 1 -- 172.21.15.112:0/436925790 --> [v2:172.21.15.144:6805/490270140,v1:172.21.15.144:6807/490270140] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe34c04e300 con 0x7fe34c15f960 2023-09-12T16:07:25.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.456+0000 7fe3497fa700 1 -- 172.21.15.112:0/436925790 <== osd.4 v2:172.21.15.144:6805/490270140 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe34c04e300 con 0x7fe34c15f960 2023-09-12T16:07:25.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.456+0000 7fe352dff700 1 -- 172.21.15.112:0/436925790 >> [v2:172.21.15.144:6805/490270140,v1:172.21.15.144:6807/490270140] conn(0x7fe34c15f960 msgr2=0x7fe34c0cd3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.457+0000 7fe352dff700 1 --2- 172.21.15.112:0/436925790 >> [v2:172.21.15.144:6805/490270140,v1:172.21.15.144:6807/490270140] conn(0x7fe34c15f960 0x7fe34c0cd3c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.457+0000 7fe352dff700 1 -- 172.21.15.112:0/436925790 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe32c06a580 msgr2=0x7fe32c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.457+0000 7fe352dff700 1 --2- 172.21.15.112:0/436925790 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe32c06a580 0x7fe32c06ca40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe334009810 tx=0x7fe334019040 comp rx=0 tx=0).stop 2023-09-12T16:07:25.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.457+0000 7fe352dff700 1 -- 172.21.15.112:0/436925790 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe34c0c8460 msgr2=0x7fe34c0c38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.457+0000 7fe352dff700 1 --2- 172.21.15.112:0/436925790 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe34c0c8460 0x7fe34c0c38c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe34400c8f0 tx=0x7fe34400ccb0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.457+0000 7fe35139c700 1 -- 172.21.15.112:0/436925790 reap_dead start 2023-09-12T16:07:25.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.458+0000 7fe352dff700 1 -- 172.21.15.112:0/436925790 shutdown_connections 2023-09-12T16:07:25.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.458+0000 7fe352dff700 1 -- 172.21.15.112:0/436925790 >> 172.21.15.112:0/436925790 conn(0x7fe34c06a200 msgr2=0x7fe34c0acfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.458+0000 7fd9d57ff700 1 -- 172.21.15.112:0/523875611 --> [v2:172.21.15.144:6824/2931281424,v1:172.21.15.144:6825/2931281424] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd9b4002d30 con 0x7fd9b0073c10 2023-09-12T16:07:25.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.458+0000 7fe352dff700 1 -- 172.21.15.112:0/436925790 shutdown_connections 2023-09-12T16:07:25.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.458+0000 7fe352dff700 1 -- 172.21.15.112:0/436925790 wait complete. 2023-09-12T16:07:25.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.458+0000 7fd9c77fe700 1 -- 172.21.15.112:0/523875611 <== osd.6 v2:172.21.15.144:6824/2931281424 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd9b4002d30 con 0x7fd9b0073c10 2023-09-12T16:07:25.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.459+0000 7fd9d57ff700 1 -- 172.21.15.112:0/523875611 >> [v2:172.21.15.144:6824/2931281424,v1:172.21.15.144:6825/2931281424] conn(0x7fd9b0073c10 msgr2=0x7fd9b0076050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.459+0000 7fd9d57ff700 1 --2- 172.21.15.112:0/523875611 >> [v2:172.21.15.144:6824/2931281424,v1:172.21.15.144:6825/2931281424] conn(0x7fd9b0073c10 0x7fd9b0076050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.459+0000 7fd9d57ff700 1 -- 172.21.15.112:0/523875611 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd9b006a650 msgr2=0x7fd9b006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.459+0000 7fd9d57ff700 1 --2- 172.21.15.112:0/523875611 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd9b006a650 0x7fd9b006cb10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8007fd0 tx=0x7fd9c8009040 comp rx=0 tx=0).stop 2023-09-12T16:07:25.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.459+0000 7fd9d57ff700 1 -- 172.21.15.112:0/523875611 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9d00b0c20 msgr2=0x7fd9d00c71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.459+0000 7fd9d57ff700 1 --2- 172.21.15.112:0/523875611 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9d00b0c20 0x7fd9d00c71e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800e9c0 tx=0x7fd9b800ecd0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.459+0000 7fd9cf7fe700 1 -- 172.21.15.112:0/523875611 reap_dead start 2023-09-12T16:07:25.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.460+0000 7fd9d57ff700 1 -- 172.21.15.112:0/523875611 shutdown_connections 2023-09-12T16:07:25.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.460+0000 7fd9d57ff700 1 -- 172.21.15.112:0/523875611 >> 172.21.15.112:0/523875611 conn(0x7fd9d006b760 msgr2=0x7fd9d0159c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.460+0000 7fd9d57ff700 1 -- 172.21.15.112:0/523875611 shutdown_connections 2023-09-12T16:07:25.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.460+0000 7fd9d57ff700 1 -- 172.21.15.112:0/523875611 wait complete. 2023-09-12T16:07:25.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.461+0000 7fae12bff700 1 -- 172.21.15.112:0/867690881 >> [v2:172.21.15.144:6800/498990310,v1:172.21.15.144:6801/498990310] conn(0x7fadec0015d0 msgr2=0x7fadec003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.461+0000 7fae12bff700 1 --2- 172.21.15.112:0/867690881 >> [v2:172.21.15.144:6800/498990310,v1:172.21.15.144:6801/498990310] conn(0x7fadec0015d0 0x7fadec003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.462+0000 7fae12bff700 1 -- 172.21.15.112:0/867690881 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fadf806a650 msgr2=0x7fadf806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.462+0000 7fae12bff700 1 --2- 172.21.15.112:0/867690881 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fadf806a650 0x7fadf806cb10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fae080018e0 tx=0x7fae08009040 comp rx=0 tx=0).stop 2023-09-12T16:07:25.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.462+0000 7fae12bff700 1 -- 172.21.15.112:0/867690881 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae0c0af390 msgr2=0x7fae0c0c28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.462+0000 7fae12bff700 1 --2- 172.21.15.112:0/867690881 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae0c0af390 0x7fae0c0c28e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fadfc004000 tx=0x7fadfc003f30 comp rx=0 tx=0).stop 2023-09-12T16:07:25.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.462+0000 7fae1119c700 1 -- 172.21.15.112:0/867690881 reap_dead start 2023-09-12T16:07:25.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.464+0000 7fae12bff700 1 -- 172.21.15.112:0/867690881 shutdown_connections 2023-09-12T16:07:25.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.464+0000 7fae12bff700 1 -- 172.21.15.112:0/867690881 >> 172.21.15.112:0/867690881 conn(0x7fae0c06a200 msgr2=0x7fae0c0cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.497 INFO:teuthology.orchestra.run.smithi112.stdout:55834574858 2023-09-12T16:07:25.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.466+0000 7fae12bff700 1 -- 172.21.15.112:0/867690881 shutdown_connections 2023-09-12T16:07:25.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.466+0000 7fae12bff700 1 -- 172.21.15.112:0/867690881 wait complete. 2023-09-12T16:07:25.499 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-12T16:07:25.500 INFO:teuthology.orchestra.run.smithi112.stdout:55834574858 2023-09-12T16:07:25.500 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-12T16:07:25.501 INFO:teuthology.orchestra.run.smithi112.stdout:55834574859 2023-09-12T16:07:25.502 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-12T16:07:25.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.472+0000 7f76bc3ff700 1 -- 172.21.15.112:0/2448533340 --> [v2:172.21.15.144:6816/4212271840,v1:172.21.15.144:6817/4212271840] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f76b404e300 con 0x7f7698073c10 2023-09-12T16:07:25.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.473+0000 7f76aaffd700 1 -- 172.21.15.112:0/2448533340 <== osd.7 v2:172.21.15.144:6816/4212271840 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f76b404e300 con 0x7f7698073c10 2023-09-12T16:07:25.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.474+0000 7f76bc3ff700 1 -- 172.21.15.112:0/2448533340 >> [v2:172.21.15.144:6816/4212271840,v1:172.21.15.144:6817/4212271840] conn(0x7f7698073c10 msgr2=0x7f7698076050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.474+0000 7f76bc3ff700 1 --2- 172.21.15.112:0/2448533340 >> [v2:172.21.15.144:6816/4212271840,v1:172.21.15.144:6817/4212271840] conn(0x7f7698073c10 0x7f7698076050 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.474+0000 7f76bc3ff700 1 -- 172.21.15.112:0/2448533340 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f769806a650 msgr2=0x7f769806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.474+0000 7f76bc3ff700 1 --2- 172.21.15.112:0/2448533340 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f769806a650 0x7f769806cb10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f76b415f640 tx=0x7f76a4019040 comp rx=0 tx=0).stop 2023-09-12T16:07:25.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.474+0000 7f76bc3ff700 1 -- 172.21.15.112:0/2448533340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76b40cfde0 msgr2=0x7f76b420bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.474+0000 7f76bc3ff700 1 --2- 172.21.15.112:0/2448533340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76b40cfde0 0x7f76b420bb00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f76b000ea20 tx=0x7f76b000ede0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.474+0000 7f76ba99c700 1 -- 172.21.15.112:0/2448533340 reap_dead start 2023-09-12T16:07:25.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.474+0000 7f76bc3ff700 1 -- 172.21.15.112:0/2448533340 shutdown_connections 2023-09-12T16:07:25.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.474+0000 7f76bc3ff700 1 -- 172.21.15.112:0/2448533340 >> 172.21.15.112:0/2448533340 conn(0x7f76b409ab60 msgr2=0x7f76b415e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.475+0000 7f76bc3ff700 1 -- 172.21.15.112:0/2448533340 shutdown_connections 2023-09-12T16:07:25.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.475+0000 7f76bc3ff700 1 -- 172.21.15.112:0/2448533340 wait complete. 2023-09-12T16:07:25.506 INFO:teuthology.orchestra.run.smithi112.stdout:55834574858 2023-09-12T16:07:25.507 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-12T16:07:25.508 INFO:teuthology.orchestra.run.smithi112.stdout:55834574860 2023-09-12T16:07:25.508 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-12T16:07:25.509 INFO:teuthology.orchestra.run.smithi112.stdout:55834574859 2023-09-12T16:07:25.509 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-12T16:07:25.510 INFO:teuthology.orchestra.run.smithi112.stdout:55834574859 2023-09-12T16:07:25.511 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-12T16:07:25.512 INFO:teuthology.orchestra.run.smithi112.stdout:55834574859 2023-09-12T16:07:25.512 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-12T16:07:25.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.902+0000 7f58859ff700 1 -- 172.21.15.112:0/1223428825 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58800c8460 msgr2=0x7f58800cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.902+0000 7f58859ff700 1 --2- 172.21.15.112:0/1223428825 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58800c8460 0x7f58800cb3d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f58700098c0 tx=0x7f5870009bd0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.902+0000 7f8b31bff700 1 -- 172.21.15.112:0/3217666294 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b14004850 msgr2=0x7f8b14004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.902+0000 7f8b31bff700 1 --2- 172.21.15.112:0/3217666294 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b14004850 0x7f8b14004cd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8b2000c410 tx=0x7f8b14005880 comp rx=0 tx=0).stop 2023-09-12T16:07:25.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.902+0000 7f8b31bff700 1 -- 172.21.15.112:0/3217666294 shutdown_connections 2023-09-12T16:07:25.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.902+0000 7f8b31bff700 1 --2- 172.21.15.112:0/3217666294 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b14004850 0x7f8b14004cd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.902+0000 7f8b31bff700 1 -- 172.21.15.112:0/3217666294 >> 172.21.15.112:0/3217666294 conn(0x7f8b2c06a200 msgr2=0x7f8b2c06a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.903+0000 7f58859ff700 1 -- 172.21.15.112:0/1223428825 shutdown_connections 2023-09-12T16:07:25.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.903+0000 7f58859ff700 1 --2- 172.21.15.112:0/1223428825 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58800c8460 0x7f58800cb3d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.903+0000 7f58859ff700 1 --2- 172.21.15.112:0/1223428825 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f58800af390 0x7f58800af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.903+0000 7f58859ff700 1 -- 172.21.15.112:0/1223428825 >> 172.21.15.112:0/1223428825 conn(0x7f588006a200 msgr2=0x7f588006a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.903+0000 7f8b31bff700 1 -- 172.21.15.112:0/3217666294 shutdown_connections 2023-09-12T16:07:25.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.903+0000 7f58859ff700 1 -- 172.21.15.112:0/1223428825 shutdown_connections 2023-09-12T16:07:25.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.903+0000 7f8b31bff700 1 -- 172.21.15.112:0/3217666294 wait complete. 2023-09-12T16:07:25.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.906+0000 7f58859ff700 1 -- 172.21.15.112:0/1223428825 wait complete. 2023-09-12T16:07:25.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.906+0000 7f8b31bff700 1 Processor -- start 2023-09-12T16:07:25.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.908+0000 7f58859ff700 1 Processor -- start 2023-09-12T16:07:25.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.906+0000 7f8b31bff700 1 -- start start 2023-09-12T16:07:25.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.907+0000 7f8b31bff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b14004850 0x7f8b2c0c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.907+0000 7f8b31bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b2c1580d0 0x7f8b2c0703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.908+0000 7f8b31bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b2c070920 0x7f8b2c0c1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.908+0000 7f8b31bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c0b1720 con 0x7f8b2c1580d0 2023-09-12T16:07:25.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.908+0000 7f8b31bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c070db0 con 0x7f8b2c070920 2023-09-12T16:07:25.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.908+0000 7f8b31bff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c158550 con 0x7f8b14004850 2023-09-12T16:07:25.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.908+0000 7f8b2b7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b14004850 0x7f8b2c0c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.908+0000 7f8b2b7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b14004850 0x7f8b2c0c3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.112:37874/0 (socket says 172.21.15.112:37874) 2023-09-12T16:07:25.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.908+0000 7f8b2b7fe700 1 -- 172.21.15.112:0/1656885040 learned_addr learned my addr 172.21.15.112:0/1656885040 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:25.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.908+0000 7f8b2bfff700 1 --2- 172.21.15.112:0/1656885040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b2c070920 0x7f8b2c0c1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.909+0000 7f8b2b7fe700 1 -- 172.21.15.112:0/1656885040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b2c070920 msgr2=0x7f8b2c0c1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.909+0000 7f8b2b7fe700 1 --2- 172.21.15.112:0/1656885040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b2c070920 0x7f8b2c0c1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.909+0000 7f8b2b7fe700 1 -- 172.21.15.112:0/1656885040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b2c1580d0 msgr2=0x7f8b2c0703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.909+0000 7f8b2b7fe700 1 --2- 172.21.15.112:0/1656885040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b2c1580d0 0x7f8b2c0703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.909+0000 7f8b2b7fe700 1 -- 172.21.15.112:0/1656885040 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2c0c1740 con 0x7f8b14004850 2023-09-12T16:07:25.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.910+0000 7f8b2b7fe700 1 --2- 172.21.15.112:0/1656885040 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b14004850 0x7f8b2c0c3a70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400b9a0 tx=0x7f8b2400bcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.909+0000 7f58859ff700 1 -- start start 2023-09-12T16:07:25.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.910+0000 7f58859ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58800af390 0x7f58800c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.910+0000 7f58859ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f58800c8460 0x7f58800b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.910+0000 7f58859ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58800c8840 0x7f588014d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.910+0000 7f58859ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58800c57e0 con 0x7f58800c8840 2023-09-12T16:07:25.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.910+0000 7f58859ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58800b1920 con 0x7f58800af390 2023-09-12T16:07:25.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.910+0000 7f58859ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58800c4b60 con 0x7f58800c8460 2023-09-12T16:07:25.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.910+0000 7f8b13fff700 1 -- 172.21.15.112:0/1656885040 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2400d8e0 con 0x7f8b14004850 2023-09-12T16:07:25.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.910+0000 7f8b13fff700 1 -- 172.21.15.112:0/1656885040 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8b2400db50 con 0x7f8b14004850 2023-09-12T16:07:25.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.910+0000 7f8b13fff700 1 -- 172.21.15.112:0/1656885040 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24015420 con 0x7f8b14004850 2023-09-12T16:07:25.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.910+0000 7f8b31bff700 1 -- 172.21.15.112:0/1656885040 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b2c0b0130 con 0x7f8b14004850 2023-09-12T16:07:25.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.911+0000 7f8b31bff700 1 -- 172.21.15.112:0/1656885040 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2c0c10f0 con 0x7f8b14004850 2023-09-12T16:07:25.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.911+0000 7f587e7fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f58800c8460 0x7f58800b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.911+0000 7f587e7fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f58800c8460 0x7f58800b13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.112:37876/0 (socket says 172.21.15.112:37876) 2023-09-12T16:07:25.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.911+0000 7f587e7fc700 1 -- 172.21.15.112:0/2020272524 learned_addr learned my addr 172.21.15.112:0/2020272524 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:25.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.912+0000 7f587e7fc700 1 -- 172.21.15.112:0/2020272524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58800af390 msgr2=0x7f58800c4580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-12T16:07:25.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.912+0000 7f587e7fc700 1 --2- 172.21.15.112:0/2020272524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58800af390 0x7f58800c4580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.912+0000 7f587e7fc700 1 -- 172.21.15.112:0/2020272524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58800c8840 msgr2=0x7f588014d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.912+0000 7f587e7fc700 1 --2- 172.21.15.112:0/2020272524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58800c8840 0x7f588014d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.912+0000 7f587e7fc700 1 -- 172.21.15.112:0/2020272524 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5870009520 con 0x7f58800c8460 2023-09-12T16:07:25.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.912+0000 7f8b31bff700 1 -- 172.21.15.112:0/1656885040 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b0c0052e0 con 0x7f8b14004850 2023-09-12T16:07:25.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.914+0000 7f587e7fc700 1 --2- 172.21.15.112:0/2020272524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f58800c8460 0x7f58800b13e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f587800cbc0 tx=0x7f587800cf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.915+0000 7f8b13fff700 1 -- 172.21.15.112:0/1656885040 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f8b24015580 con 0x7f8b14004850 2023-09-12T16:07:25.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.917+0000 7f8b13fff700 1 --2- 172.21.15.112:0/1656885040 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8b1806a650 0x7f8b1806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.917+0000 7f8b13fff700 1 -- 172.21.15.112:0/1656885040 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8b24005e40 con 0x7f8b14004850 2023-09-12T16:07:25.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.918+0000 7f8b2affd700 1 --2- 172.21.15.112:0/1656885040 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8b1806a650 0x7f8b1806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.920+0000 7f8b2affd700 1 --2- 172.21.15.112:0/1656885040 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8b1806a650 0x7f8b1806cb10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8b2000c410 tx=0x7f8b20001ac0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.920+0000 7f8b13fff700 1 -- 172.21.15.112:0/1656885040 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f8b24054590 con 0x7f8b14004850 2023-09-12T16:07:25.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.921+0000 7fb6201ff700 1 -- 172.21.15.112:0/352606735 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb61815f480 msgr2=0x7fb6180cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.921+0000 7fb6201ff700 1 --2- 172.21.15.112:0/352606735 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb61815f480 0x7fb6180cfe80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb610009fb0 tx=0x7fb61000b330 comp rx=0 tx=0).stop 2023-09-12T16:07:25.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.921+0000 7fb6201ff700 1 -- 172.21.15.112:0/352606735 shutdown_connections 2023-09-12T16:07:25.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.921+0000 7fb6201ff700 1 --2- 172.21.15.112:0/352606735 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb61815f480 0x7fb6180cfe80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.921+0000 7fb6201ff700 1 --2- 172.21.15.112:0/352606735 >> v2:172.21.15.112:3300/0 conn(0x7fb6180cdfb0 0x7fb6180d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.921+0000 7fb6201ff700 1 -- 172.21.15.112:0/352606735 >> 172.21.15.112:0/352606735 conn(0x7fb6180d1930 msgr2=0x7fb6180d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.921+0000 7f1e037ff700 1 -- 172.21.15.112:0/939710478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dfc0d0410 msgr2=0x7f1dfc0ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.921+0000 7f1e037ff700 1 --2- 172.21.15.112:0/939710478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dfc0d0410 0x7f1dfc0ce090 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0cbf10 tx=0x7f1df8009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:25.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.921+0000 7f1e037ff700 1 -- 172.21.15.112:0/939710478 shutdown_connections 2023-09-12T16:07:25.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.921+0000 7f1e037ff700 1 --2- 172.21.15.112:0/939710478 >> v2:172.21.15.144:3300/0 conn(0x7f1dfc0ce5d0 0x7f1dfc0b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.921+0000 7f1e037ff700 1 --2- 172.21.15.112:0/939710478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dfc0d0410 0x7f1dfc0ce090 secure :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0cbf10 tx=0x7f1df8009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:25.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.921+0000 7f1e037ff700 1 -- 172.21.15.112:0/939710478 >> 172.21.15.112:0/939710478 conn(0x7f1dfc09abe0 msgr2=0x7f1dfc0d1830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.922+0000 7f0d481ff700 1 -- 172.21.15.112:0/831409515 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d400c8460 msgr2=0x7f0d400cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.922+0000 7f0d481ff700 1 --2- 172.21.15.112:0/831409515 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d400c8460 0x7f0d400cb3d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0d380098c0 tx=0x7f0d38009bd0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.922+0000 7fb6201ff700 1 -- 172.21.15.112:0/352606735 shutdown_connections 2023-09-12T16:07:25.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.922+0000 7f0d481ff700 1 -- 172.21.15.112:0/831409515 shutdown_connections 2023-09-12T16:07:25.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.922+0000 7f0d481ff700 1 --2- 172.21.15.112:0/831409515 >> v2:172.21.15.144:3300/0 conn(0x7f0d400af390 0x7f0d400af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.923+0000 7f0d481ff700 1 --2- 172.21.15.112:0/831409515 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d400c8460 0x7f0d400cb3d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.923+0000 7f0d481ff700 1 -- 172.21.15.112:0/831409515 >> 172.21.15.112:0/831409515 conn(0x7f0d4006a200 msgr2=0x7f0d4006a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.921+0000 7f1e037ff700 1 -- 172.21.15.112:0/939710478 shutdown_connections 2023-09-12T16:07:25.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.921+0000 7f1e037ff700 1 -- 172.21.15.112:0/939710478 wait complete. 2023-09-12T16:07:25.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.922+0000 7fb6201ff700 1 -- 172.21.15.112:0/352606735 wait complete. 2023-09-12T16:07:25.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.925+0000 7fb6201ff700 1 Processor -- start 2023-09-12T16:07:25.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.925+0000 7f7e965ff700 1 -- 172.21.15.112:0/1182024859 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e900c84f0 msgr2=0x7f7e900c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.925+0000 7f7e965ff700 1 --2- 172.21.15.112:0/1182024859 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e900c84f0 0x7f7e900c88d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009fd0 tx=0x7f7e8800b380 comp rx=0 tx=0).stop 2023-09-12T16:07:25.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.925+0000 7f7e965ff700 1 -- 172.21.15.112:0/1182024859 shutdown_connections 2023-09-12T16:07:25.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.925+0000 7f7e965ff700 1 --2- 172.21.15.112:0/1182024859 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e900c84f0 0x7f7e900c88d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.925+0000 7f7e965ff700 1 --2- 172.21.15.112:0/1182024859 >> v2:172.21.15.144:3300/0 conn(0x7f7e900c9be0 0x7f7e900ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.925+0000 7f7e965ff700 1 -- 172.21.15.112:0/1182024859 >> 172.21.15.112:0/1182024859 conn(0x7f7e9006a650 msgr2=0x7f7e9006c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.925+0000 7fb6201ff700 1 -- start start 2023-09-12T16:07:25.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.924+0000 7f0d481ff700 1 -- 172.21.15.112:0/831409515 shutdown_connections 2023-09-12T16:07:25.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.924+0000 7f0d481ff700 1 -- 172.21.15.112:0/831409515 wait complete. 2023-09-12T16:07:25.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.926+0000 7f0d481ff700 1 Processor -- start 2023-09-12T16:07:25.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.926+0000 7f0d481ff700 1 -- start start 2023-09-12T16:07:25.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.924+0000 7f1e037ff700 1 Processor -- start 2023-09-12T16:07:25.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.924+0000 7f1e037ff700 1 -- start start 2023-09-12T16:07:25.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.926+0000 7f1e037ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1dfc0ce5d0 0x7f1dfc0c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.926+0000 7f1e037ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dfc15b920 0x7f1dfc0c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.926+0000 7f1e037ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dfc0c9040 0x7f1dfc0af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.926+0000 7f1e037ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc0cb5b0 con 0x7f1dfc0c9040 2023-09-12T16:07:25.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.926+0000 7f1e037ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc0c5fb0 con 0x7f1dfc15b920 2023-09-12T16:07:25.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.926+0000 7f1e037ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc0c6290 con 0x7f1dfc0ce5d0 2023-09-12T16:07:25.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.926+0000 7f1e0159b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1dfc0ce5d0 0x7f1dfc0c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.926+0000 7f1e0159b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1dfc0ce5d0 0x7f1dfc0c6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.112:37918/0 (socket says 172.21.15.112:37918) 2023-09-12T16:07:25.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.926+0000 7f1e0159b700 1 -- 172.21.15.112:0/4269257718 learned_addr learned my addr 172.21.15.112:0/4269257718 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:25.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.926+0000 7f1e01d9c700 1 --2- 172.21.15.112:0/4269257718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dfc0c9040 0x7f1dfc0af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.927+0000 7f7e965ff700 1 -- 172.21.15.112:0/1182024859 shutdown_connections 2023-09-12T16:07:25.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.927+0000 7f7e965ff700 1 -- 172.21.15.112:0/1182024859 wait complete. 2023-09-12T16:07:25.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.928+0000 7f0d481ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d400af390 0x7f0d400c26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.928+0000 7f0d481ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d400c8460 0x7f0d40145530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.928+0000 7f0d481ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d400c8840 0x7f0d40145a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.928+0000 7f0d481ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4014c3b0 con 0x7f0d400c8460 2023-09-12T16:07:25.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.928+0000 7f0d481ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d40144820 con 0x7f0d400c8840 2023-09-12T16:07:25.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.928+0000 7f0d481ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d400c7440 con 0x7f0d400af390 2023-09-12T16:07:25.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.929+0000 7f0d4579a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d400c8460 0x7f0d40145530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.929+0000 7f0d4579a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d400c8460 0x7f0d40145530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52234/0 (socket says 172.21.15.112:52234) 2023-09-12T16:07:25.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.929+0000 7f0d4579a700 1 -- 172.21.15.112:0/2441837292 learned_addr learned my addr 172.21.15.112:0/2441837292 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:25.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.929+0000 7f0d45f9b700 1 --2- 172.21.15.112:0/2441837292 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d400af390 0x7f0d400c26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.927+0000 7f1e0159b700 1 -- 172.21.15.112:0/4269257718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dfc15b920 msgr2=0x7f1dfc0c8330 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-12T16:07:25.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.927+0000 7f1e0159b700 1 --2- 172.21.15.112:0/4269257718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dfc15b920 0x7f1dfc0c8330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.927+0000 7f1e0159b700 1 -- 172.21.15.112:0/4269257718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dfc0c9040 msgr2=0x7f1dfc0af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.927+0000 7f1e0159b700 1 --2- 172.21.15.112:0/4269257718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dfc0c9040 0x7f1dfc0af310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.927+0000 7f1e0159b700 1 -- 172.21.15.112:0/4269257718 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df80095f0 con 0x7f1dfc0ce5d0 2023-09-12T16:07:25.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.927+0000 7f1e0159b700 1 --2- 172.21.15.112:0/4269257718 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1dfc0ce5d0 0x7f1dfc0c6a90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1df000c450 tx=0x7f1df000c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.929+0000 7f7e965ff700 1 Processor -- start 2023-09-12T16:07:25.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.928+0000 7f1dedffb700 1 -- 172.21.15.112:0/4269257718 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df00052d0 con 0x7f1dfc0ce5d0 2023-09-12T16:07:25.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.928+0000 7f1dedffb700 1 -- 172.21.15.112:0/4269257718 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1df0005520 con 0x7f1dfc0ce5d0 2023-09-12T16:07:25.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.928+0000 7f1dedffb700 1 -- 172.21.15.112:0/4269257718 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df00038e0 con 0x7f1dfc0ce5d0 2023-09-12T16:07:25.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.928+0000 7f1e037ff700 1 -- 172.21.15.112:0/4269257718 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dfc0c6570 con 0x7f1dfc0ce5d0 2023-09-12T16:07:25.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.928+0000 7f1e037ff700 1 -- 172.21.15.112:0/4269257718 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dfc0c94c0 con 0x7f1dfc0ce5d0 2023-09-12T16:07:25.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.929+0000 7f0d4679c700 1 --2- 172.21.15.112:0/2441837292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d400c8840 0x7f0d40145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.930+0000 7f0d4579a700 1 -- 172.21.15.112:0/2441837292 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d400af390 msgr2=0x7f0d400c26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.930+0000 7f0d4579a700 1 --2- 172.21.15.112:0/2441837292 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d400af390 0x7f0d400c26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.930+0000 7f0d4579a700 1 -- 172.21.15.112:0/2441837292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d400c8840 msgr2=0x7f0d40145a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.930+0000 7f0d4579a700 1 --2- 172.21.15.112:0/2441837292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d400c8840 0x7f0d40145a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.930+0000 7f0d4579a700 1 -- 172.21.15.112:0/2441837292 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d38009520 con 0x7f0d400c8460 2023-09-12T16:07:25.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.926+0000 7f5867fff700 1 -- 172.21.15.112:0/2020272524 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587800ab50 con 0x7f58800c8460 2023-09-12T16:07:25.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.926+0000 7f5867fff700 1 -- 172.21.15.112:0/2020272524 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f587800adc0 con 0x7f58800c8460 2023-09-12T16:07:25.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.926+0000 7f5867fff700 1 -- 172.21.15.112:0/2020272524 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5878012680 con 0x7f58800c8460 2023-09-12T16:07:25.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.927+0000 7f58859ff700 1 -- 172.21.15.112:0/2020272524 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58800c4e40 con 0x7f58800c8460 2023-09-12T16:07:25.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.927+0000 7f58859ff700 1 -- 172.21.15.112:0/2020272524 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58800c5400 con 0x7f58800c8460 2023-09-12T16:07:25.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.930+0000 7f7e965ff700 1 -- start start 2023-09-12T16:07:25.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.929+0000 7f58859ff700 1 -- 172.21.15.112:0/2020272524 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f588004e300 con 0x7f58800c8460 2023-09-12T16:07:25.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.931+0000 7fb6201ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6180b28f0 0x7fb6181542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.931+0000 7fb6201ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6180cdfb0 0x7fb618159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.931+0000 7fb6201ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb61815f480 0x7fb6180ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.931+0000 7fb6201ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb618154810 con 0x7fb6180cdfb0 2023-09-12T16:07:25.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.931+0000 7fb6201ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb618159a50 con 0x7fb61815f480 2023-09-12T16:07:25.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.931+0000 7fb6201ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6180b46d0 con 0x7fb6180b28f0 2023-09-12T16:07:25.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.931+0000 7f7e965ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e9006e320 0x7f7e900c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.931+0000 7f7e965ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e900c84f0 0x7f7e900c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.931+0000 7f7e965ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e900c9be0 0x7f7e900c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.931+0000 7f7e965ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e900c3ed0 con 0x7f7e9006e320 2023-09-12T16:07:25.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.931+0000 7f7e965ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9014b750 con 0x7f7e900c84f0 2023-09-12T16:07:25.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.931+0000 7f7e965ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9014ba30 con 0x7f7e900c9be0 2023-09-12T16:07:25.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.932+0000 7fb61e79c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb61815f480 0x7fb6180ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.932+0000 7fb61e79c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb61815f480 0x7fb6180ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.112:56160/0 (socket says 172.21.15.112:56160) 2023-09-12T16:07:25.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.932+0000 7fb61e79c700 1 -- 172.21.15.112:0/3881288503 learned_addr learned my addr 172.21.15.112:0/3881288503 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:25.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.932+0000 7fb61df9b700 1 --2- 172.21.15.112:0/3881288503 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6180b28f0 0x7fb6181542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.930+0000 7f0d4579a700 1 --2- 172.21.15.112:0/2441837292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d400c8460 0x7f0d40145530 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c00cbf0 tx=0x7f0d3c0021c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.931+0000 7f0d367fc700 1 -- 172.21.15.112:0/2441837292 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c00ab40 con 0x7f0d400c8460 2023-09-12T16:07:25.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.931+0000 7f0d367fc700 1 -- 172.21.15.112:0/2441837292 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0d3c00adb0 con 0x7f0d400c8460 2023-09-12T16:07:25.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.931+0000 7f0d367fc700 1 -- 172.21.15.112:0/2441837292 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c012680 con 0x7f0d400c8460 2023-09-12T16:07:25.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.931+0000 7f0d481ff700 1 -- 172.21.15.112:0/2441837292 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d400c6d80 con 0x7f0d400c8460 2023-09-12T16:07:25.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.931+0000 7f0d481ff700 1 -- 172.21.15.112:0/2441837292 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d40144d30 con 0x7f0d400c8460 2023-09-12T16:07:25.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.932+0000 7f7e8f7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e900c84f0 0x7f7e900c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.932+0000 7f7e8f7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e900c84f0 0x7f7e900c3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.112:56170/0 (socket says 172.21.15.112:56170) 2023-09-12T16:07:25.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.932+0000 7f7e8f7fe700 1 -- 172.21.15.112:0/344494518 learned_addr learned my addr 172.21.15.112:0/344494518 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:25.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.932+0000 7f7e94b9c700 1 --2- 172.21.15.112:0/344494518 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e900c9be0 0x7f7e900c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.932+0000 7fb61e79c700 1 -- 172.21.15.112:0/3881288503 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6180b28f0 msgr2=0x7fb6181542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.932+0000 7fb61e79c700 1 --2- 172.21.15.112:0/3881288503 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6180b28f0 0x7fb6181542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.932+0000 7fb61e79c700 1 -- 172.21.15.112:0/3881288503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6180cdfb0 msgr2=0x7fb618159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.933+0000 7fb61e79c700 1 --2- 172.21.15.112:0/3881288503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6180cdfb0 0x7fb618159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.933+0000 7fb61e79c700 1 -- 172.21.15.112:0/3881288503 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb610009c40 con 0x7fb61815f480 2023-09-12T16:07:25.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.933+0000 7f7e8f7fe700 1 -- 172.21.15.112:0/344494518 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e900c9be0 msgr2=0x7f7e900c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.933+0000 7f7e8f7fe700 1 --2- 172.21.15.112:0/344494518 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e900c9be0 0x7f7e900c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.933+0000 7f7e8f7fe700 1 -- 172.21.15.112:0/344494518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e9006e320 msgr2=0x7f7e900c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.933+0000 7f7e8f7fe700 1 --2- 172.21.15.112:0/344494518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e9006e320 0x7f7e900c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.933+0000 7f7e8f7fe700 1 -- 172.21.15.112:0/344494518 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e88009d00 con 0x7f7e900c84f0 2023-09-12T16:07:25.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.933+0000 7fb61e79c700 1 --2- 172.21.15.112:0/3881288503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb61815f480 0x7fb6180ca590 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb60800c400 tx=0x7fb60800c710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.933+0000 7f0d481ff700 1 -- 172.21.15.112:0/2441837292 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d280052e0 con 0x7f0d400c8460 2023-09-12T16:07:25.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.931+0000 7fde5edff700 1 -- 172.21.15.112:0/3103338779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde580c84f0 msgr2=0x7fde580c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.931+0000 7fde5edff700 1 --2- 172.21.15.112:0/3103338779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde580c84f0 0x7fde580c88d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fde50009fd0 tx=0x7fde5000b380 comp rx=0 tx=0).stop 2023-09-12T16:07:25.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.932+0000 7fde5edff700 1 -- 172.21.15.112:0/3103338779 shutdown_connections 2023-09-12T16:07:25.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.932+0000 7fde5edff700 1 --2- 172.21.15.112:0/3103338779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde580c84f0 0x7fde580c88d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.932+0000 7fde5edff700 1 --2- 172.21.15.112:0/3103338779 >> v2:172.21.15.144:3300/0 conn(0x7fde580c9be0 0x7fde580ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.932+0000 7fde5edff700 1 -- 172.21.15.112:0/3103338779 >> 172.21.15.112:0/3103338779 conn(0x7fde5806a650 msgr2=0x7fde5806c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.932+0000 7fde5edff700 1 -- 172.21.15.112:0/3103338779 shutdown_connections 2023-09-12T16:07:25.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.932+0000 7fde5edff700 1 -- 172.21.15.112:0/3103338779 wait complete. 2023-09-12T16:07:25.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.933+0000 7f7e8f7fe700 1 --2- 172.21.15.112:0/344494518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e900c84f0 0x7f7e900c3680 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7e8000e9f0 tx=0x7f7e8000edb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.934+0000 7f7e8cff9700 1 -- 172.21.15.112:0/344494518 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8000cbd0 con 0x7f7e900c84f0 2023-09-12T16:07:25.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.934+0000 7f7e8cff9700 1 -- 172.21.15.112:0/344494518 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7e8000ce20 con 0x7f7e900c84f0 2023-09-12T16:07:25.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.934+0000 7f7e8cff9700 1 -- 172.21.15.112:0/344494518 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80010690 con 0x7f7e900c84f0 2023-09-12T16:07:25.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.931+0000 7f1e037ff700 1 -- 172.21.15.112:0/4269257718 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ddc0052e0 con 0x7f1dfc0ce5d0 2023-09-12T16:07:25.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.933+0000 7f1dedffb700 1 -- 172.21.15.112:0/4269257718 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f1df0003a40 con 0x7f1dfc0ce5d0 2023-09-12T16:07:25.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.935+0000 7fde5edff700 1 Processor -- start 2023-09-12T16:07:25.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.935+0000 7fde5edff700 1 -- start start 2023-09-12T16:07:25.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.934+0000 7f7e965ff700 1 -- 172.21.15.112:0/344494518 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9014bd10 con 0x7f7e900c84f0 2023-09-12T16:07:25.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.934+0000 7f7e965ff700 1 -- 172.21.15.112:0/344494518 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e900c3bc0 con 0x7f7e900c84f0 2023-09-12T16:07:25.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.935+0000 7f1dedffb700 1 --2- 172.21.15.112:0/4269257718 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f1de006a650 0x7f1de006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.935+0000 7f1dedffb700 1 -- 172.21.15.112:0/4269257718 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1df00880d0 con 0x7f1dfc0ce5d0 2023-09-12T16:07:25.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.936+0000 7f7e965ff700 1 -- 172.21.15.112:0/344494518 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e700052e0 con 0x7f7e900c84f0 2023-09-12T16:07:25.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.936+0000 7fde5edff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde5806e320 0x7fde580c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.936+0000 7fde5edff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde580c84f0 0x7fde580c2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.936+0000 7fde5edff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde580c9be0 0x7fde58149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.936+0000 7fde5edff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde580c3f60 con 0x7fde5806e320 2023-09-12T16:07:25.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.936+0000 7fde5edff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde580c33e0 con 0x7fde580c9be0 2023-09-12T16:07:25.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.936+0000 7fde5edff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde580c36c0 con 0x7fde580c84f0 2023-09-12T16:07:25.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.936+0000 7f1e00d9a700 1 --2- 172.21.15.112:0/4269257718 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f1de006a650 0x7f1de006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.937+0000 7f1e00d9a700 1 --2- 172.21.15.112:0/4269257718 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f1de006a650 0x7f1de006cb10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0d07f0 tx=0x7f1df80047c0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.937+0000 7fdbcf7ff700 1 -- 172.21.15.112:0/645478075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc80c8840 msgr2=0x7fdbc8071e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:25.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.937+0000 7fdbcf7ff700 1 --2- 172.21.15.112:0/645478075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc80c8840 0x7fdbc8071e90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80ce550 tx=0x7fdbc4009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:25.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.937+0000 7fde5cb9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde5806e320 0x7fde580c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.937+0000 7fde5cb9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde5806e320 0x7fde580c4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52248/0 (socket says 172.21.15.112:52248) 2023-09-12T16:07:25.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.937+0000 7fde5cb9b700 1 -- 172.21.15.112:0/1020968222 learned_addr learned my addr 172.21.15.112:0/1020968222 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:25.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.938+0000 7f5867fff700 1 -- 172.21.15.112:0/2020272524 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f5878024420 con 0x7f58800c8460 2023-09-12T16:07:25.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.937+0000 7fb60e7fc700 1 -- 172.21.15.112:0/3881288503 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb608011790 con 0x7fb61815f480 2023-09-12T16:07:25.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.937+0000 7fb60e7fc700 1 -- 172.21.15.112:0/3881288503 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb6080119e0 con 0x7fb61815f480 2023-09-12T16:07:25.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.937+0000 7fb60e7fc700 1 -- 172.21.15.112:0/3881288503 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb608011dd0 con 0x7fb61815f480 2023-09-12T16:07:25.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.937+0000 7fb6201ff700 1 -- 172.21.15.112:0/3881288503 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6180b49b0 con 0x7fb61815f480 2023-09-12T16:07:25.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.937+0000 7fb6201ff700 1 -- 172.21.15.112:0/3881288503 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6181596b0 con 0x7fb61815f480 2023-09-12T16:07:25.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.937+0000 7f0d367fc700 1 -- 172.21.15.112:0/2441837292 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f0d3c01b400 con 0x7f0d400c8460 2023-09-12T16:07:25.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.938+0000 7f0d367fc700 1 --2- 172.21.15.112:0/2441837292 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f0d2406a650 0x7f0d2406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.939+0000 7f0d367fc700 1 -- 172.21.15.112:0/2441837292 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0d3c089580 con 0x7f0d400c8460 2023-09-12T16:07:25.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.938+0000 7fde5cb9b700 1 -- 172.21.15.112:0/1020968222 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde580c84f0 msgr2=0x7fde580c2d70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-12T16:07:25.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.938+0000 7fde5cb9b700 1 --2- 172.21.15.112:0/1020968222 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde580c84f0 0x7fde580c2d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.938+0000 7fde5cb9b700 1 -- 172.21.15.112:0/1020968222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde580c9be0 msgr2=0x7fde58149ed0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-12T16:07:25.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.938+0000 7fde5cb9b700 1 --2- 172.21.15.112:0/1020968222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde580c9be0 0x7fde58149ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.938+0000 7fde5cb9b700 1 -- 172.21.15.112:0/1020968222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde50009d00 con 0x7fde5806e320 2023-09-12T16:07:25.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.939+0000 7fde5cb9b700 1 --2- 172.21.15.112:0/1020968222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde5806e320 0x7fde580c4580 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fde4800c4e0 tx=0x7fde4800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.938+0000 7fdbcf7ff700 1 -- 172.21.15.112:0/645478075 shutdown_connections 2023-09-12T16:07:25.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.938+0000 7fdbcf7ff700 1 --2- 172.21.15.112:0/645478075 >> v2:172.21.15.144:3300/0 conn(0x7fdbc80c8460 0x7fdbc80cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.938+0000 7fdbcf7ff700 1 --2- 172.21.15.112:0/645478075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc80c8840 0x7fdbc8071e90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:25.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.938+0000 7fdbcf7ff700 1 -- 172.21.15.112:0/645478075 >> 172.21.15.112:0/645478075 conn(0x7fdbc806a200 msgr2=0x7fdbc806a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:25.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.940+0000 7f7e8cff9700 1 -- 172.21.15.112:0/344494518 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f7e800107f0 con 0x7f7e900c84f0 2023-09-12T16:07:25.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.940+0000 7f0d45f9b700 1 --2- 172.21.15.112:0/2441837292 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f0d2406a650 0x7f0d2406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.940+0000 7f5867fff700 1 --2- 172.21.15.112:0/2020272524 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f586c06a650 0x7f586c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.940+0000 7f5867fff700 1 -- 172.21.15.112:0/2020272524 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f58780898e0 con 0x7f58800c8460 2023-09-12T16:07:25.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.940+0000 7f5867fff700 1 -- 172.21.15.112:0/2020272524 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f58780b5a50 con 0x7f58800c8460 2023-09-12T16:07:25.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.940+0000 7fb6201ff700 1 -- 172.21.15.112:0/3881288503 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6000052e0 con 0x7fb61815f480 2023-09-12T16:07:25.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.941+0000 7f587effd700 1 --2- 172.21.15.112:0/2020272524 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f586c06a650 0x7f586c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.941+0000 7fdbcf7ff700 1 -- 172.21.15.112:0/645478075 shutdown_connections 2023-09-12T16:07:25.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.941+0000 7fdbcf7ff700 1 -- 172.21.15.112:0/645478075 wait complete. 2023-09-12T16:07:25.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.942+0000 7f587effd700 1 --2- 172.21.15.112:0/2020272524 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f586c06a650 0x7f586c06cb10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5870000c00 tx=0x7f58700047c0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.941+0000 7f0d45f9b700 1 --2- 172.21.15.112:0/2441837292 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f0d2406a650 0x7f0d2406cb10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0d38009230 tx=0x7f0d380047c0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.941+0000 7f7e8cff9700 1 --2- 172.21.15.112:0/344494518 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7e7c06a650 0x7f7e7c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.941+0000 7f7e8cff9700 1 -- 172.21.15.112:0/344494518 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7e80014070 con 0x7f7e900c84f0 2023-09-12T16:07:25.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.942+0000 7f7e8ffff700 1 --2- 172.21.15.112:0/344494518 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7e7c06a650 0x7f7e7c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:25.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.943+0000 7f7e8cff9700 1 -- 172.21.15.112:0/344494518 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f7e80055050 con 0x7f7e900c84f0 2023-09-12T16:07:25.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.943+0000 7f1dedffb700 1 -- 172.21.15.112:0/4269257718 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f1df00533d0 con 0x7f1dfc0ce5d0 2023-09-12T16:07:25.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.944+0000 7fdbcf7ff700 1 Processor -- start 2023-09-12T16:07:25.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.944+0000 7fdbcf7ff700 1 -- start start 2023-09-12T16:07:25.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.945+0000 7f7e8ffff700 1 --2- 172.21.15.112:0/344494518 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7e7c06a650 0x7f7e7c06cb10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7e84000f60 tx=0x7f7e84007a40 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:25.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.946+0000 7fb60e7fc700 1 -- 172.21.15.112:0/3881288503 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fb608012420 con 0x7fb61815f480 2023-09-12T16:07:25.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.946+0000 7fdbcf7ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc80af390 0x7fdbc814e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.946+0000 7fdbcf7ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdbc80c8460 0x7fdbc81f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.946+0000 7fdbcf7ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbc80c8840 0x7fdbc80c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:25.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.946+0000 7fdbcf7ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc80c3eb0 con 0x7fdbc80af390 2023-09-12T16:07:25.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.946+0000 7fdbcf7ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc80c68d0 con 0x7fdbc80c8840 2023-09-12T16:07:26.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.946+0000 7fdbcf7ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc81f21d0 con 0x7fdbc80c8460 2023-09-12T16:07:26.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.946+0000 7fdbcdd9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbc80c8840 0x7fdbc80c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:26.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.947+0000 7fdbcdd9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbc80c8840 0x7fdbc80c6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.112:56200/0 (socket says 172.21.15.112:56200) 2023-09-12T16:07:26.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.947+0000 7fdbcdd9c700 1 -- 172.21.15.112:0/112051865 learned_addr learned my addr 172.21.15.112:0/112051865 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:26.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.947+0000 7fdbccd9a700 1 --2- 172.21.15.112:0/112051865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdbc80c8460 0x7fdbc81f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:26.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.947+0000 7fb60e7fc700 1 --2- 172.21.15.112:0/3881288503 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb5fc06a5d0 0x7fb5fc06ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:26.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.947+0000 7fb60e7fc700 1 -- 172.21.15.112:0/3881288503 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb6080896e0 con 0x7fb61815f480 2023-09-12T16:07:26.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.947+0000 7fdbcdd9c700 1 -- 172.21.15.112:0/112051865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdbc80c8460 msgr2=0x7fdbc81f1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:26.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.947+0000 7fdbcdd9c700 1 --2- 172.21.15.112:0/112051865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdbc80c8460 0x7fdbc81f1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.947+0000 7fdbcdd9c700 1 -- 172.21.15.112:0/112051865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc80af390 msgr2=0x7fdbc814e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:26.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.947+0000 7fdbcdd9c700 1 --2- 172.21.15.112:0/112051865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc80af390 0x7fdbc814e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.947+0000 7fdbcdd9c700 1 -- 172.21.15.112:0/112051865 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc40095f0 con 0x7fdbc80c8840 2023-09-12T16:07:26.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.948+0000 7f0d367fc700 1 -- 172.21.15.112:0/2441837292 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f0d3c0547f0 con 0x7f0d400c8460 2023-09-12T16:07:26.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.948+0000 7fb61df9b700 1 --2- 172.21.15.112:0/3881288503 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb5fc06a5d0 0x7fb5fc06ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:26.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.948+0000 7fb60e7fc700 1 -- 172.21.15.112:0/3881288503 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb608054950 con 0x7fb61815f480 2023-09-12T16:07:26.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.948+0000 7fdbcdd9c700 1 --2- 172.21.15.112:0/112051865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbc80c8840 0x7fdbc80c6d60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000c7d0 tx=0x7fdbc000cae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:26.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.948+0000 7fdbbdffb700 1 -- 172.21.15.112:0/112051865 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0003e10 con 0x7fdbc80c8840 2023-09-12T16:07:26.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.948+0000 7fdbbdffb700 1 -- 172.21.15.112:0/112051865 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdbc0005160 con 0x7fdbc80c8840 2023-09-12T16:07:26.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.948+0000 7fdbbdffb700 1 -- 172.21.15.112:0/112051865 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0005570 con 0x7fdbc80c8840 2023-09-12T16:07:26.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.949+0000 7fdbcf7ff700 1 -- 172.21.15.112:0/112051865 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc80c38f0 con 0x7fdbc80c8840 2023-09-12T16:07:26.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.949+0000 7fdbcf7ff700 1 -- 172.21.15.112:0/112051865 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc814e8e0 con 0x7fdbc80c8840 2023-09-12T16:07:26.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.949+0000 7fb61df9b700 1 --2- 172.21.15.112:0/3881288503 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb5fc06a5d0 0x7fb5fc06ca90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb610000f80 tx=0x7fb610014040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:26.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.950+0000 7fde557fa700 1 -- 172.21.15.112:0/1020968222 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde480052d0 con 0x7fde5806e320 2023-09-12T16:07:26.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.950+0000 7fde557fa700 1 -- 172.21.15.112:0/1020968222 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fde48005520 con 0x7fde5806e320 2023-09-12T16:07:26.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.950+0000 7fde557fa700 1 -- 172.21.15.112:0/1020968222 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde480038e0 con 0x7fde5806e320 2023-09-12T16:07:26.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.950+0000 7fde5edff700 1 -- 172.21.15.112:0/1020968222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde580c39a0 con 0x7fde5806e320 2023-09-12T16:07:26.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.950+0000 7fde5edff700 1 -- 172.21.15.112:0/1020968222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde58150590 con 0x7fde5806e320 2023-09-12T16:07:26.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.952+0000 7fde5edff700 1 -- 172.21.15.112:0/1020968222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde380052e0 con 0x7fde5806e320 2023-09-12T16:07:26.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.950+0000 7fdbcf7ff700 1 -- 172.21.15.112:0/112051865 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc8072b20 con 0x7fdbc80c8840 2023-09-12T16:07:26.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.953+0000 7fdbbdffb700 1 -- 172.21.15.112:0/112051865 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fdbc00056d0 con 0x7fdbc80c8840 2023-09-12T16:07:26.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.954+0000 7fdbbdffb700 1 --2- 172.21.15.112:0/112051865 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdbac06a650 0x7fdbac06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:26.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.954+0000 7fdbbdffb700 1 -- 172.21.15.112:0/112051865 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdbc0088b20 con 0x7fdbc80c8840 2023-09-12T16:07:26.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.958+0000 7fde557fa700 1 -- 172.21.15.112:0/1020968222 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fde48003a40 con 0x7fde5806e320 2023-09-12T16:07:26.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.960+0000 7fde557fa700 1 --2- 172.21.15.112:0/1020968222 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fde4406a680 0x7fde4406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:26.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.960+0000 7fde557fa700 1 -- 172.21.15.112:0/1020968222 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fde48088840 con 0x7fde5806e320 2023-09-12T16:07:26.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.961+0000 7fdbbdffb700 1 -- 172.21.15.112:0/112051865 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fdbc0053d90 con 0x7fdbc80c8840 2023-09-12T16:07:26.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.962+0000 7fde57fff700 1 --2- 172.21.15.112:0/1020968222 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fde4406a680 0x7fde4406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:26.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.965+0000 7fdbcd59b700 1 --2- 172.21.15.112:0/112051865 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdbac06a650 0x7fdbac06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:26.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.964+0000 7fde557fa700 1 -- 172.21.15.112:0/1020968222 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fde48053b40 con 0x7fde5806e320 2023-09-12T16:07:26.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.973+0000 7fdbcd59b700 1 --2- 172.21.15.112:0/112051865 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdbac06a650 0x7fdbac06cb10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8071810 tx=0x7fdbb8005c80 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:26.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:25.974+0000 7fde57fff700 1 --2- 172.21.15.112:0/1020968222 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fde4406a680 0x7fde4406cb40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fde5814d5d0 tx=0x7fde4c005ae0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:26.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.380+0000 7f8b31bff700 1 -- 172.21.15.112:0/1656885040 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8b0c005150 con 0x7f8b14004850 2023-09-12T16:07:26.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.384+0000 7f8b13fff700 1 -- 172.21.15.112:0/1656885040 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8b24057bb0 con 0x7f8b14004850 2023-09-12T16:07:26.393 INFO:teuthology.orchestra.run.smithi112.stdout:55834574857 2023-09-12T16:07:26.393 INFO:teuthology.orchestra.run.smithi112.stdout:55834574857 2023-09-12T16:07:26.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.389+0000 7f58859ff700 1 -- 172.21.15.112:0/2020272524 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f58800cb6f0 con 0x7f58800c8460 2023-09-12T16:07:26.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.392+0000 7f5867fff700 1 -- 172.21.15.112:0/2020272524 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5878016020 con 0x7f58800c8460 2023-09-12T16:07:26.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.394+0000 7f8b31bff700 1 -- 172.21.15.112:0/1656885040 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8b1806a650 msgr2=0x7f8b1806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:26.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.394+0000 7f8b31bff700 1 --2- 172.21.15.112:0/1656885040 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8b1806a650 0x7f8b1806cb10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8b2000c410 tx=0x7f8b20001ac0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.394+0000 7f8b31bff700 1 -- 172.21.15.112:0/1656885040 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b14004850 msgr2=0x7f8b2c0c3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:26.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.394+0000 7f8b31bff700 1 --2- 172.21.15.112:0/1656885040 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b14004850 0x7f8b2c0c3a70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400b9a0 tx=0x7f8b2400bcb0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.395+0000 7f8b31bff700 1 -- 172.21.15.112:0/1656885040 shutdown_connections 2023-09-12T16:07:26.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.395+0000 7f8b31bff700 1 --2- 172.21.15.112:0/1656885040 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8b1806a650 0x7f8b1806cb10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.395+0000 7f8b31bff700 1 --2- 172.21.15.112:0/1656885040 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b14004850 0x7f8b2c0c3a70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.395+0000 7f8b31bff700 1 --2- 172.21.15.112:0/1656885040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b2c070920 0x7f8b2c0c1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.395+0000 7f8b31bff700 1 --2- 172.21.15.112:0/1656885040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b2c1580d0 0x7f8b2c0703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.395+0000 7f8b31bff700 1 -- 172.21.15.112:0/1656885040 >> 172.21.15.112:0/1656885040 conn(0x7f8b2c06a200 msgr2=0x7f8b2c06a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:26.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.395+0000 7f8b31bff700 1 -- 172.21.15.112:0/1656885040 shutdown_connections 2023-09-12T16:07:26.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.396+0000 7f8b31bff700 1 -- 172.21.15.112:0/1656885040 wait complete. 2023-09-12T16:07:26.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.396+0000 7f58859ff700 1 -- 172.21.15.112:0/2020272524 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f586c06a650 msgr2=0x7f586c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:26.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.397+0000 7f58859ff700 1 --2- 172.21.15.112:0/2020272524 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f586c06a650 0x7f586c06cb10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5870000c00 tx=0x7f58700047c0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.397+0000 7f58859ff700 1 -- 172.21.15.112:0/2020272524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f58800c8460 msgr2=0x7f58800b13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:26.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.397+0000 7f58859ff700 1 --2- 172.21.15.112:0/2020272524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f58800c8460 0x7f58800b13e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f587800cbc0 tx=0x7f587800cf80 comp rx=0 tx=0).stop 2023-09-12T16:07:26.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.396+0000 7f7e965ff700 1 -- 172.21.15.112:0/344494518 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7e70005860 con 0x7f7e900c84f0 2023-09-12T16:07:26.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.397+0000 7f58859ff700 1 -- 172.21.15.112:0/2020272524 shutdown_connections 2023-09-12T16:07:26.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.397+0000 7f58859ff700 1 --2- 172.21.15.112:0/2020272524 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f586c06a650 0x7f586c06cb10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.397+0000 7f58859ff700 1 --2- 172.21.15.112:0/2020272524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58800c8840 0x7f588014d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.397+0000 7f58859ff700 1 --2- 172.21.15.112:0/2020272524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58800af390 0x7f58800c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.397+0000 7f58859ff700 1 --2- 172.21.15.112:0/2020272524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f58800c8460 0x7f58800b13e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.397+0000 7f58859ff700 1 -- 172.21.15.112:0/2020272524 >> 172.21.15.112:0/2020272524 conn(0x7f588006a200 msgr2=0x7f58800cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:26.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.397+0000 7f58859ff700 1 -- 172.21.15.112:0/2020272524 shutdown_connections 2023-09-12T16:07:26.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.397+0000 7f58859ff700 1 -- 172.21.15.112:0/2020272524 wait complete. 2023-09-12T16:07:26.403 INFO:teuthology.orchestra.run.smithi112.stdout:55834574858 2023-09-12T16:07:26.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.398+0000 7f7e8cff9700 1 -- 172.21.15.112:0/344494518 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7e80058670 con 0x7f7e900c84f0 2023-09-12T16:07:26.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.400+0000 7f1e037ff700 1 -- 172.21.15.112:0/4269257718 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1ddc005150 con 0x7f1dfc0ce5d0 2023-09-12T16:07:26.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.403+0000 7f0d481ff700 1 -- 172.21.15.112:0/2441837292 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0d28005150 con 0x7f0d400c8460 2023-09-12T16:07:26.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.402+0000 7f7e965ff700 1 -- 172.21.15.112:0/344494518 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7e7c06a650 msgr2=0x7f7e7c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:26.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.402+0000 7f7e965ff700 1 --2- 172.21.15.112:0/344494518 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7e7c06a650 0x7f7e7c06cb10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7e84000f60 tx=0x7f7e84007a40 comp rx=0 tx=0).stop 2023-09-12T16:07:26.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.403+0000 7f7e965ff700 1 -- 172.21.15.112:0/344494518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e900c84f0 msgr2=0x7f7e900c3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:26.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.403+0000 7f7e965ff700 1 --2- 172.21.15.112:0/344494518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e900c84f0 0x7f7e900c3680 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7e8000e9f0 tx=0x7f7e8000edb0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.406 INFO:teuthology.orchestra.run.smithi112.stdout:55834574858 2023-09-12T16:07:26.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.401+0000 7f1dedffb700 1 -- 172.21.15.112:0/4269257718 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1df00569f0 con 0x7f1dfc0ce5d0 2023-09-12T16:07:26.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.403+0000 7f0d367fc700 1 -- 172.21.15.112:0/2441837292 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d3c016020 con 0x7f0d400c8460 2023-09-12T16:07:26.407 INFO:teuthology.orchestra.run.smithi112.stdout:55834574857 2023-09-12T16:07:26.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.404+0000 7f7e965ff700 1 -- 172.21.15.112:0/344494518 shutdown_connections 2023-09-12T16:07:26.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.404+0000 7f7e965ff700 1 --2- 172.21.15.112:0/344494518 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7e7c06a650 0x7f7e7c06cb10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.404+0000 7f7e965ff700 1 --2- 172.21.15.112:0/344494518 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e900c9be0 0x7f7e900c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.404+0000 7f7e965ff700 1 --2- 172.21.15.112:0/344494518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e9006e320 0x7f7e900c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.404+0000 7f7e965ff700 1 --2- 172.21.15.112:0/344494518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e900c84f0 0x7f7e900c3680 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.404+0000 7f7e965ff700 1 -- 172.21.15.112:0/344494518 >> 172.21.15.112:0/344494518 conn(0x7f7e9006a650 msgr2=0x7f7e9014e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:26.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.404+0000 7f7e965ff700 1 -- 172.21.15.112:0/344494518 shutdown_connections 2023-09-12T16:07:26.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.404+0000 7f7e965ff700 1 -- 172.21.15.112:0/344494518 wait complete. 2023-09-12T16:07:26.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.406+0000 7f1e037ff700 1 -- 172.21.15.112:0/4269257718 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f1de006a650 msgr2=0x7f1de006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:26.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.406+0000 7f1e037ff700 1 --2- 172.21.15.112:0/4269257718 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f1de006a650 0x7f1de006cb10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0d07f0 tx=0x7f1df80047c0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.406+0000 7f1e037ff700 1 -- 172.21.15.112:0/4269257718 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1dfc0ce5d0 msgr2=0x7f1dfc0c6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:26.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.406+0000 7f1e037ff700 1 --2- 172.21.15.112:0/4269257718 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1dfc0ce5d0 0x7f1dfc0c6a90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1df000c450 tx=0x7f1df000c810 comp rx=0 tx=0).stop 2023-09-12T16:07:26.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.406+0000 7f1e037ff700 1 -- 172.21.15.112:0/4269257718 shutdown_connections 2023-09-12T16:07:26.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.406+0000 7f1e037ff700 1 --2- 172.21.15.112:0/4269257718 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f1de006a650 0x7f1de006cb10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.406+0000 7f1e037ff700 1 --2- 172.21.15.112:0/4269257718 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1dfc0ce5d0 0x7f1dfc0c6a90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.406+0000 7f1e037ff700 1 --2- 172.21.15.112:0/4269257718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dfc0c9040 0x7f1dfc0af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.406+0000 7f1e037ff700 1 --2- 172.21.15.112:0/4269257718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dfc15b920 0x7f1dfc0c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.406+0000 7f1e037ff700 1 -- 172.21.15.112:0/4269257718 >> 172.21.15.112:0/4269257718 conn(0x7f1dfc09abe0 msgr2=0x7f1dfc0b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:26.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.407+0000 7f0d481ff700 1 -- 172.21.15.112:0/2441837292 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f0d2406a650 msgr2=0x7f0d2406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:26.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.407+0000 7f0d481ff700 1 --2- 172.21.15.112:0/2441837292 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f0d2406a650 0x7f0d2406cb10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0d38009230 tx=0x7f0d380047c0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.407+0000 7f0d481ff700 1 -- 172.21.15.112:0/2441837292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d400c8460 msgr2=0x7f0d40145530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:26.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.407+0000 7f0d481ff700 1 --2- 172.21.15.112:0/2441837292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d400c8460 0x7f0d40145530 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c00cbf0 tx=0x7f0d3c0021c0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.408+0000 7f0d481ff700 1 -- 172.21.15.112:0/2441837292 shutdown_connections 2023-09-12T16:07:26.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.408+0000 7f0d481ff700 1 --2- 172.21.15.112:0/2441837292 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f0d2406a650 0x7f0d2406cb10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.408+0000 7f0d481ff700 1 --2- 172.21.15.112:0/2441837292 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d400af390 0x7f0d400c26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.408+0000 7f0d481ff700 1 --2- 172.21.15.112:0/2441837292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d400c8840 0x7f0d40145a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.408+0000 7f0d481ff700 1 --2- 172.21.15.112:0/2441837292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d400c8460 0x7f0d40145530 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.408+0000 7f0d481ff700 1 -- 172.21.15.112:0/2441837292 >> 172.21.15.112:0/2441837292 conn(0x7f0d4006a200 msgr2=0x7f0d400cd810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:26.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.408+0000 7f0d481ff700 1 -- 172.21.15.112:0/2441837292 shutdown_connections 2023-09-12T16:07:26.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.408+0000 7f0d481ff700 1 -- 172.21.15.112:0/2441837292 wait complete. 2023-09-12T16:07:26.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.407+0000 7f1e037ff700 1 -- 172.21.15.112:0/4269257718 shutdown_connections 2023-09-12T16:07:26.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.407+0000 7f1e037ff700 1 -- 172.21.15.112:0/4269257718 wait complete. 2023-09-12T16:07:26.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.410+0000 7fb6201ff700 1 -- 172.21.15.112:0/3881288503 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb600005150 con 0x7fb61815f480 2023-09-12T16:07:26.416 INFO:teuthology.orchestra.run.smithi112.stdout:55834574858 2023-09-12T16:07:26.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.411+0000 7fb60e7fc700 1 -- 172.21.15.112:0/3881288503 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb608057f70 con 0x7fb61815f480 2023-09-12T16:07:26.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.416+0000 7fb6201ff700 1 -- 172.21.15.112:0/3881288503 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb5fc06a5d0 msgr2=0x7fb5fc06ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:26.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.416+0000 7fb6201ff700 1 --2- 172.21.15.112:0/3881288503 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb5fc06a5d0 0x7fb5fc06ca90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb610000f80 tx=0x7fb610014040 comp rx=0 tx=0).stop 2023-09-12T16:07:26.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.416+0000 7fb6201ff700 1 -- 172.21.15.112:0/3881288503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb61815f480 msgr2=0x7fb6180ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:26.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.416+0000 7fb6201ff700 1 --2- 172.21.15.112:0/3881288503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb61815f480 0x7fb6180ca590 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb60800c400 tx=0x7fb60800c710 comp rx=0 tx=0).stop 2023-09-12T16:07:26.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.416+0000 7fb6201ff700 1 -- 172.21.15.112:0/3881288503 shutdown_connections 2023-09-12T16:07:26.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.416+0000 7fb6201ff700 1 --2- 172.21.15.112:0/3881288503 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb5fc06a5d0 0x7fb5fc06ca90 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb610000f80 tx=0x7fb610014040 comp rx=0 tx=0).stop 2023-09-12T16:07:26.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.416+0000 7fb6201ff700 1 --2- 172.21.15.112:0/3881288503 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6180b28f0 0x7fb6181542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.416+0000 7fb6201ff700 1 --2- 172.21.15.112:0/3881288503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb61815f480 0x7fb6180ca590 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.416+0000 7fb6201ff700 1 --2- 172.21.15.112:0/3881288503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6180cdfb0 0x7fb618159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.416+0000 7fb6201ff700 1 -- 172.21.15.112:0/3881288503 >> 172.21.15.112:0/3881288503 conn(0x7fb6180d1930 msgr2=0x7fb6180c57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:26.420 INFO:teuthology.orchestra.run.smithi112.stdout:55834574859 2023-09-12T16:07:26.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.416+0000 7fde5edff700 1 -- 172.21.15.112:0/1020968222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fde38005150 con 0x7fde5806e320 2023-09-12T16:07:26.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.417+0000 7fde557fa700 1 -- 172.21.15.112:0/1020968222 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fde48017020 con 0x7fde5806e320 2023-09-12T16:07:26.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.420+0000 7fdbcf7ff700 1 -- 172.21.15.112:0/112051865 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fdbc815ef00 con 0x7fdbc80c8840 2023-09-12T16:07:26.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.420+0000 7fb6201ff700 1 -- 172.21.15.112:0/3881288503 shutdown_connections 2023-09-12T16:07:26.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.421+0000 7fb6201ff700 1 -- 172.21.15.112:0/3881288503 wait complete. 2023-09-12T16:07:26.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.422+0000 7fde5edff700 1 -- 172.21.15.112:0/1020968222 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fde4406a680 msgr2=0x7fde4406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:26.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.422+0000 7fde5edff700 1 --2- 172.21.15.112:0/1020968222 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fde4406a680 0x7fde4406cb40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fde5814d5d0 tx=0x7fde4c005ae0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.422+0000 7fde5edff700 1 -- 172.21.15.112:0/1020968222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde5806e320 msgr2=0x7fde580c4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:26.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.422+0000 7fde5edff700 1 --2- 172.21.15.112:0/1020968222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde5806e320 0x7fde580c4580 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fde4800c4e0 tx=0x7fde4800c8a0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.422+0000 7fde5edff700 1 -- 172.21.15.112:0/1020968222 shutdown_connections 2023-09-12T16:07:26.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.422+0000 7fde5edff700 1 --2- 172.21.15.112:0/1020968222 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fde4406a680 0x7fde4406cb40 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fde5814d5d0 tx=0x7fde4c005ae0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.422+0000 7fde5edff700 1 --2- 172.21.15.112:0/1020968222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde580c9be0 0x7fde58149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.422+0000 7fde5edff700 1 --2- 172.21.15.112:0/1020968222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde5806e320 0x7fde580c4580 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.422+0000 7fde5edff700 1 --2- 172.21.15.112:0/1020968222 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde580c84f0 0x7fde580c2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.422+0000 7fde5edff700 1 -- 172.21.15.112:0/1020968222 >> 172.21.15.112:0/1020968222 conn(0x7fde5806a650 msgr2=0x7fde580af1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:26.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.423+0000 7fdbbdffb700 1 -- 172.21.15.112:0/112051865 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdbc0017090 con 0x7fdbc80c8840 2023-09-12T16:07:26.426 INFO:teuthology.orchestra.run.smithi112.stdout:55834574858 2023-09-12T16:07:26.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.427+0000 7fdbcf7ff700 1 -- 172.21.15.112:0/112051865 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdbac06a650 msgr2=0x7fdbac06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:26.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.427+0000 7fdbcf7ff700 1 --2- 172.21.15.112:0/112051865 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdbac06a650 0x7fdbac06cb10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8071810 tx=0x7fdbb8005c80 comp rx=0 tx=0).stop 2023-09-12T16:07:26.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.427+0000 7fdbcf7ff700 1 -- 172.21.15.112:0/112051865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbc80c8840 msgr2=0x7fdbc80c6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:26.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.427+0000 7fdbcf7ff700 1 --2- 172.21.15.112:0/112051865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbc80c8840 0x7fdbc80c6d60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000c7d0 tx=0x7fdbc000cae0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.427+0000 7fde5edff700 1 -- 172.21.15.112:0/1020968222 shutdown_connections 2023-09-12T16:07:26.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.428+0000 7fde5edff700 1 -- 172.21.15.112:0/1020968222 wait complete. 2023-09-12T16:07:26.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2023-09-12T16:07:26.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2023-09-12T16:07:26.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.433+0000 7fdbcf7ff700 1 -- 172.21.15.112:0/112051865 shutdown_connections 2023-09-12T16:07:26.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.433+0000 7fdbcf7ff700 1 --2- 172.21.15.112:0/112051865 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdbac06a650 0x7fdbac06cb10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.433+0000 7fdbcf7ff700 1 --2- 172.21.15.112:0/112051865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbc80c8840 0x7fdbc80c6d60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.433+0000 7fdbcf7ff700 1 --2- 172.21.15.112:0/112051865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc80af390 0x7fdbc814e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.433+0000 7fdbcf7ff700 1 --2- 172.21.15.112:0/112051865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdbc80c8460 0x7fdbc81f1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:26.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.433+0000 7fdbcf7ff700 1 -- 172.21.15.112:0/112051865 >> 172.21.15.112:0/112051865 conn(0x7fdbc806a200 msgr2=0x7fdbc806a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:26.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.434+0000 7fdbcf7ff700 1 -- 172.21.15.112:0/112051865 shutdown_connections 2023-09-12T16:07:26.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:26.434+0000 7fdbcf7ff700 1 -- 172.21.15.112:0/112051865 wait complete. 2023-09-12T16:07:26.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.5 2023-09-12T16:07:26.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2023-09-12T16:07:26.444 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2023-09-12T16:07:26.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.0 2023-09-12T16:07:26.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.6 2023-09-12T16:07:26.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.7 2023-09-12T16:07:27.435 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-12T16:07:27.436 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-12T16:07:27.443 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-12T16:07:27.444 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-12T16:07:27.446 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-12T16:07:27.452 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-12T16:07:27.457 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-12T16:07:27.461 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-12T16:07:27.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.773+0000 7fe633dff700 1 -- 172.21.15.112:0/3165041474 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe62c0af390 msgr2=0x7fe62c0af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:27.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.773+0000 7fe633dff700 1 --2- 172.21.15.112:0/3165041474 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe62c0af390 0x7fe62c0af770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0b0030 tx=0x7fe62400b380 comp rx=0 tx=0).stop 2023-09-12T16:07:27.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.774+0000 7fe633dff700 1 -- 172.21.15.112:0/3165041474 shutdown_connections 2023-09-12T16:07:27.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.774+0000 7fe633dff700 1 --2- 172.21.15.112:0/3165041474 >> v2:172.21.15.144:3300/0 conn(0x7fe62c072310 0x7fe62c15fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.774+0000 7fe633dff700 1 --2- 172.21.15.112:0/3165041474 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe62c0af390 0x7fe62c0af770 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.774+0000 7fe633dff700 1 --2- 172.21.15.112:0/3165041474 >> v2:172.21.15.112:3300/0 conn(0x7fe62c071e90 0x7fe62c15f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.774+0000 7fe633dff700 1 -- 172.21.15.112:0/3165041474 >> 172.21.15.112:0/3165041474 conn(0x7fe62c06a200 msgr2=0x7fe62c06a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:27.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.774+0000 7fe633dff700 1 -- 172.21.15.112:0/3165041474 shutdown_connections 2023-09-12T16:07:27.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.774+0000 7fe633dff700 1 -- 172.21.15.112:0/3165041474 wait complete. 2023-09-12T16:07:27.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.776+0000 7fe633dff700 1 Processor -- start 2023-09-12T16:07:27.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.777+0000 7fde665ff700 1 -- 172.21.15.112:0/2436601844 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde600cceb0 msgr2=0x7fde600ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:27.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.777+0000 7fde665ff700 1 --2- 172.21.15.112:0/2436601844 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde600cceb0 0x7fde600ce090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fde540098c0 tx=0x7fde54009bd0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.776+0000 7fe633dff700 1 -- start start 2023-09-12T16:07:27.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.778+0000 7fe633dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe62c071e90 0x7fe62c0aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.778+0000 7fe633dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe62c072310 0x7fe62c0c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.778+0000 7fe633dff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe62c0af390 0x7fe62c155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.778+0000 7fe633dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c0b0e90 con 0x7fe62c071e90 2023-09-12T16:07:27.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.778+0000 7fe633dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c0c4ac0 con 0x7fe62c072310 2023-09-12T16:07:27.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.778+0000 7fe633dff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c0c4d60 con 0x7fe62c0af390 2023-09-12T16:07:27.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.779+0000 7fe631b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe62c071e90 0x7fe62c0aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.779+0000 7fe631b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe62c071e90 0x7fe62c0aea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52270/0 (socket says 172.21.15.112:52270) 2023-09-12T16:07:27.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.779+0000 7fe631b9b700 1 -- 172.21.15.112:0/3029571883 learned_addr learned my addr 172.21.15.112:0/3029571883 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:27.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.779+0000 7fe63139a700 1 --2- 172.21.15.112:0/3029571883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe62c072310 0x7fe62c0c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.780+0000 7fe63239c700 1 --2- 172.21.15.112:0/3029571883 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe62c0af390 0x7fe62c155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.780+0000 7fe63139a700 1 -- 172.21.15.112:0/3029571883 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe62c0af390 msgr2=0x7fe62c155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:27.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.780+0000 7fe63139a700 1 --2- 172.21.15.112:0/3029571883 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe62c0af390 0x7fe62c155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.780+0000 7fe63139a700 1 -- 172.21.15.112:0/3029571883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe62c071e90 msgr2=0x7fe62c0aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:27.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.780+0000 7fe63139a700 1 --2- 172.21.15.112:0/3029571883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe62c071e90 0x7fe62c0aea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.780+0000 7fe63139a700 1 -- 172.21.15.112:0/3029571883 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe624009d00 con 0x7fe62c072310 2023-09-12T16:07:27.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.778+0000 7fde665ff700 1 -- 172.21.15.112:0/2436601844 shutdown_connections 2023-09-12T16:07:27.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.778+0000 7fde665ff700 1 --2- 172.21.15.112:0/2436601844 >> v2:172.21.15.112:3300/0 conn(0x7fde6015b920 0x7fde600d0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.778+0000 7fde665ff700 1 --2- 172.21.15.112:0/2436601844 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde600cceb0 0x7fde600ce090 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.778+0000 7fde665ff700 1 -- 172.21.15.112:0/2436601844 >> 172.21.15.112:0/2436601844 conn(0x7fde6009abe0 msgr2=0x7fde600d1830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:27.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.778+0000 7fde665ff700 1 -- 172.21.15.112:0/2436601844 shutdown_connections 2023-09-12T16:07:27.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.778+0000 7fde665ff700 1 -- 172.21.15.112:0/2436601844 wait complete. 2023-09-12T16:07:27.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.781+0000 7fe63139a700 1 --2- 172.21.15.112:0/3029571883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe62c072310 0x7fe62c0c4580 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe61c00c8f0 tx=0x7fe61c00cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:27.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.782+0000 7fe6227fc700 1 -- 172.21.15.112:0/3029571883 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c004a30 con 0x7fe62c072310 2023-09-12T16:07:27.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.782+0000 7fe6227fc700 1 -- 172.21.15.112:0/3029571883 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe61c004c80 con 0x7fe62c072310 2023-09-12T16:07:27.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.782+0000 7fe633dff700 1 -- 172.21.15.112:0/3029571883 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe62c0c5040 con 0x7fe62c072310 2023-09-12T16:07:27.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.781+0000 7fde665ff700 1 Processor -- start 2023-09-12T16:07:27.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.781+0000 7fde665ff700 1 -- start start 2023-09-12T16:07:27.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.782+0000 7fe6227fc700 1 -- 172.21.15.112:0/3029571883 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c005280 con 0x7fe62c072310 2023-09-12T16:07:27.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.783+0000 7fde665ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde600cceb0 0x7fde6015aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.785+0000 7fde5ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde600cceb0 0x7fde6015aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.785+0000 7fde5ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde600cceb0 0x7fde6015aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52286/0 (socket says 172.21.15.112:52286) 2023-09-12T16:07:27.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.783+0000 7fe633dff700 1 -- 172.21.15.112:0/3029571883 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe62c0c5600 con 0x7fe62c072310 2023-09-12T16:07:27.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.785+0000 7fe633dff700 1 -- 172.21.15.112:0/3029571883 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe62c0c5820 con 0x7fe62c072310 2023-09-12T16:07:27.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.785+0000 7fde665ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde600cd360 0x7fde600ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.785+0000 7fde665ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde6015b920 0x7fde6015e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.785+0000 7fde665ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde600ca920 con 0x7fde600cceb0 2023-09-12T16:07:27.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.785+0000 7fde665ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde600c8710 con 0x7fde6015b920 2023-09-12T16:07:27.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.785+0000 7fde665ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde600c9860 con 0x7fde600cd360 2023-09-12T16:07:27.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.785+0000 7fde64b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde6015b920 0x7fde6015e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.785+0000 7fde64b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde6015b920 0x7fde6015e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.112:56238/0 (socket says 172.21.15.112:56238) 2023-09-12T16:07:27.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.785+0000 7fde64b9c700 1 -- 172.21.15.112:0/659163535 learned_addr learned my addr 172.21.15.112:0/659163535 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:27.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.786+0000 7fde5f7fe700 1 --2- 172.21.15.112:0/659163535 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde600cd360 0x7fde600ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.786+0000 7fde5f7fe700 1 -- 172.21.15.112:0/659163535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde6015b920 msgr2=0x7fde6015e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:27.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.786+0000 7fde5f7fe700 1 --2- 172.21.15.112:0/659163535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde6015b920 0x7fde6015e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.786+0000 7fde5f7fe700 1 -- 172.21.15.112:0/659163535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde600cceb0 msgr2=0x7fde6015aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:27.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.786+0000 7fde5f7fe700 1 --2- 172.21.15.112:0/659163535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde600cceb0 0x7fde6015aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.786+0000 7fde5f7fe700 1 -- 172.21.15.112:0/659163535 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde54009520 con 0x7fde600cd360 2023-09-12T16:07:27.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.787+0000 7fde5f7fe700 1 --2- 172.21.15.112:0/659163535 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde600cd360 0x7fde600ca3e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fde54015000 tx=0x7fde54003c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:27.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.787+0000 7fde5cff9700 1 -- 172.21.15.112:0/659163535 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5401c070 con 0x7fde600cd360 2023-09-12T16:07:27.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.787+0000 7fe6227fc700 1 -- 172.21.15.112:0/3029571883 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe61c0053e0 con 0x7fe62c072310 2023-09-12T16:07:27.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.789+0000 7fe6227fc700 1 --2- 172.21.15.112:0/3029571883 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe61006a650 0x7fe61006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.789+0000 7fe6227fc700 1 -- 172.21.15.112:0/3029571883 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe61c088960 con 0x7fe62c072310 2023-09-12T16:07:27.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.788+0000 7fde5cff9700 1 -- 172.21.15.112:0/659163535 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fde5400f460 con 0x7fde600cd360 2023-09-12T16:07:27.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.788+0000 7fde5cff9700 1 -- 172.21.15.112:0/659163535 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5400f890 con 0x7fde600cd360 2023-09-12T16:07:27.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.789+0000 7fde665ff700 1 -- 172.21.15.112:0/659163535 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde600d2290 con 0x7fde600cd360 2023-09-12T16:07:27.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.789+0000 7fde665ff700 1 -- 172.21.15.112:0/659163535 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde600c8d80 con 0x7fde600cd360 2023-09-12T16:07:27.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.792+0000 7fe631b9b700 1 --2- 172.21.15.112:0/3029571883 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe61006a650 0x7fe61006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.793+0000 7fe631b9b700 1 --2- 172.21.15.112:0/3029571883 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe61006a650 0x7fe61006cb10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe624009610 tx=0x7fe624004b40 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:27.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.794+0000 7fe6227fc700 1 -- 172.21.15.112:0/3029571883 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe61c053b40 con 0x7fe62c072310 2023-09-12T16:07:27.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.794+0000 7fee5a9ff700 1 -- 172.21.15.112:0/2863419238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee541578d0 msgr2=0x7fee540c9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:27.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.794+0000 7fee5a9ff700 1 --2- 172.21.15.112:0/2863419238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee541578d0 0x7fee540c9be0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fee48008570 tx=0x7fee48008880 comp rx=0 tx=0).stop 2023-09-12T16:07:27.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.791+0000 7fde665ff700 1 -- 172.21.15.112:0/659163535 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde60072d90 con 0x7fde600cd360 2023-09-12T16:07:27.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.793+0000 7fde5cff9700 1 -- 172.21.15.112:0/659163535 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fde54020070 con 0x7fde600cd360 2023-09-12T16:07:27.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.795+0000 7fde5cff9700 1 --2- 172.21.15.112:0/659163535 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fde4c06a650 0x7fde4c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.795+0000 7fde5cff9700 1 -- 172.21.15.112:0/659163535 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fde54089d20 con 0x7fde600cd360 2023-09-12T16:07:27.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.795+0000 7fee5a9ff700 1 -- 172.21.15.112:0/2863419238 shutdown_connections 2023-09-12T16:07:27.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.795+0000 7fee5a9ff700 1 --2- 172.21.15.112:0/2863419238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee541578d0 0x7fee540c9be0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.795+0000 7fee5a9ff700 1 --2- 172.21.15.112:0/2863419238 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee540c8c00 0x7fee540cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.795+0000 7fee5a9ff700 1 -- 172.21.15.112:0/2863419238 >> 172.21.15.112:0/2863419238 conn(0x7fee5406a650 msgr2=0x7fee5406c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:27.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.796+0000 7fee5a9ff700 1 -- 172.21.15.112:0/2863419238 shutdown_connections 2023-09-12T16:07:27.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.797+0000 7fde5ffff700 1 --2- 172.21.15.112:0/659163535 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fde4c06a650 0x7fde4c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.796+0000 7fee5a9ff700 1 -- 172.21.15.112:0/2863419238 wait complete. 2023-09-12T16:07:27.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.798+0000 7fde5ffff700 1 --2- 172.21.15.112:0/659163535 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fde4c06a650 0x7fde4c06cb10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fde50009340 tx=0x7fde5000b040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:27.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.799+0000 7fde5cff9700 1 -- 172.21.15.112:0/659163535 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fde540550d0 con 0x7fde600cd360 2023-09-12T16:07:27.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.799+0000 7fee5a9ff700 1 Processor -- start 2023-09-12T16:07:27.803 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.800+0000 7fddd0fff700 1 -- 172.21.15.112:0/3348155360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc15fe40 msgr2=0x7fddcc16b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:27.803 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.800+0000 7fddd0fff700 1 --2- 172.21.15.112:0/3348155360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc15fe40 0x7fddcc16b190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fddc400b0a0 tx=0x7fddc400b3b0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.803 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.800+0000 7fddd0fff700 1 -- 172.21.15.112:0/3348155360 shutdown_connections 2023-09-12T16:07:27.803 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.800+0000 7fddd0fff700 1 --2- 172.21.15.112:0/3348155360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc15fe40 0x7fddcc16b190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.803 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.800+0000 7fddd0fff700 1 -- 172.21.15.112:0/3348155360 >> 172.21.15.112:0/3348155360 conn(0x7fddcc06a200 msgr2=0x7fddcc06a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:27.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.800+0000 7fee5a9ff700 1 -- start start 2023-09-12T16:07:27.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.802+0000 7fee5a9ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee540c8c00 0x7fee541e2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.802+0000 7fee5a9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee540ca120 0x7fee5414dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.802+0000 7fee5a9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee541578d0 0x7fee540c3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.802+0000 7fee5a9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee540c19f0 con 0x7fee541578d0 2023-09-12T16:07:27.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.802+0000 7fee5a9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee540c1c40 con 0x7fee540ca120 2023-09-12T16:07:27.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.802+0000 7fee5a9ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee540c1f20 con 0x7fee540c8c00 2023-09-12T16:07:27.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.803+0000 7fee58f9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee541578d0 0x7fee540c3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.803+0000 7fee58f9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee541578d0 0x7fee540c3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52298/0 (socket says 172.21.15.112:52298) 2023-09-12T16:07:27.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.803+0000 7fee58f9c700 1 -- 172.21.15.112:0/2856093174 learned_addr learned my addr 172.21.15.112:0/2856093174 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:27.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.803+0000 7fee537fe700 1 --2- 172.21.15.112:0/2856093174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee540ca120 0x7fee5414dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.804+0000 7fee53fff700 1 --2- 172.21.15.112:0/2856093174 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee540c8c00 0x7fee541e2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.804+0000 7fee537fe700 1 -- 172.21.15.112:0/2856093174 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee540c8c00 msgr2=0x7fee541e2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:27.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.804+0000 7fee537fe700 1 --2- 172.21.15.112:0/2856093174 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee540c8c00 0x7fee541e2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.804+0000 7fee537fe700 1 -- 172.21.15.112:0/2856093174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee541578d0 msgr2=0x7fee540c3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:27.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.804+0000 7fee537fe700 1 --2- 172.21.15.112:0/2856093174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee541578d0 0x7fee540c3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.804+0000 7fee537fe700 1 -- 172.21.15.112:0/2856093174 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee480081d0 con 0x7fee540ca120 2023-09-12T16:07:27.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.804+0000 7fee58f9c700 1 --2- 172.21.15.112:0/2856093174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee541578d0 0x7fee540c3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:07:27.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.804+0000 7fee53fff700 1 --2- 172.21.15.112:0/2856093174 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee540c8c00 0x7fee541e2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:07:27.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.805+0000 7fddd0fff700 1 -- 172.21.15.112:0/3348155360 shutdown_connections 2023-09-12T16:07:27.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.805+0000 7fddd0fff700 1 -- 172.21.15.112:0/3348155360 wait complete. 2023-09-12T16:07:27.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.808+0000 7fddd0fff700 1 Processor -- start 2023-09-12T16:07:27.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.808+0000 7fddd0fff700 1 -- start start 2023-09-12T16:07:27.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.809+0000 7fddd0fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddcc071e90 0x7fddcc1fe980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.809+0000 7fddd0fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddcc0af390 0x7fddcc0c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.809+0000 7fddd0fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc15fe40 0x7fddcc15aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.809+0000 7fddd0fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc1feec0 con 0x7fddcc0af390 2023-09-12T16:07:27.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.809+0000 7fddd0fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0c78a0 con 0x7fddcc071e90 2023-09-12T16:07:27.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.809+0000 7fddd0fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0c6c90 con 0x7fddcc15fe40 2023-09-12T16:07:27.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.811+0000 7fddca59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddcc071e90 0x7fddcc1fe980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.811+0000 7fddca59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddcc071e90 0x7fddcc1fe980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.112:56266/0 (socket says 172.21.15.112:56266) 2023-09-12T16:07:27.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.811+0000 7fddca59c700 1 -- 172.21.15.112:0/1088741765 learned_addr learned my addr 172.21.15.112:0/1088741765 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:27.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.811+0000 7fddcad9d700 1 --2- 172.21.15.112:0/1088741765 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc15fe40 0x7fddcc15aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.811+0000 7fddca59c700 1 -- 172.21.15.112:0/1088741765 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc15fe40 msgr2=0x7fddcc15aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:27.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.811+0000 7fddca59c700 1 --2- 172.21.15.112:0/1088741765 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc15fe40 0x7fddcc15aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.811+0000 7fddca59c700 1 -- 172.21.15.112:0/1088741765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddcc0af390 msgr2=0x7fddcc0c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:27.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.811+0000 7fddca59c700 1 --2- 172.21.15.112:0/1088741765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddcc0af390 0x7fddcc0c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.811+0000 7fddca59c700 1 -- 172.21.15.112:0/1088741765 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc4009d00 con 0x7fddcc071e90 2023-09-12T16:07:27.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.805+0000 7fee537fe700 1 --2- 172.21.15.112:0/2856093174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee540ca120 0x7fee5414dd70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fee44000f60 tx=0x7fee4400c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:27.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.808+0000 7fee50ff9700 1 -- 172.21.15.112:0/2856093174 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee440052d0 con 0x7fee540ca120 2023-09-12T16:07:27.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.808+0000 7fee50ff9700 1 -- 172.21.15.112:0/2856093174 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fee44005520 con 0x7fee540ca120 2023-09-12T16:07:27.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.808+0000 7fee50ff9700 1 -- 172.21.15.112:0/2856093174 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee440038e0 con 0x7fee540ca120 2023-09-12T16:07:27.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.812+0000 7fddca59c700 1 --2- 172.21.15.112:0/1088741765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddcc071e90 0x7fddcc1fe980 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fddc000c4e0 tx=0x7fddc000c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:27.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.812+0000 7fee5a9ff700 1 -- 172.21.15.112:0/2856093174 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee540c2200 con 0x7fee540ca120 2023-09-12T16:07:27.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.812+0000 7fee5a9ff700 1 -- 172.21.15.112:0/2856093174 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee541e13c0 con 0x7fee540ca120 2023-09-12T16:07:27.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.814+0000 7fee5a9ff700 1 -- 172.21.15.112:0/2856093174 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee540c2390 con 0x7fee540ca120 2023-09-12T16:07:27.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.815+0000 7fddbaffd700 1 -- 172.21.15.112:0/1088741765 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc00052d0 con 0x7fddcc071e90 2023-09-12T16:07:27.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.815+0000 7fddbaffd700 1 -- 172.21.15.112:0/1088741765 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fddc0005520 con 0x7fddcc071e90 2023-09-12T16:07:27.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.815+0000 7fddbaffd700 1 -- 172.21.15.112:0/1088741765 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc00038e0 con 0x7fddcc071e90 2023-09-12T16:07:27.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.816+0000 7fddd0fff700 1 -- 172.21.15.112:0/1088741765 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddcc0c6f70 con 0x7fddcc071e90 2023-09-12T16:07:27.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.816+0000 7fddd0fff700 1 -- 172.21.15.112:0/1088741765 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddcc0c7530 con 0x7fddcc071e90 2023-09-12T16:07:27.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.816+0000 7fee50ff9700 1 -- 172.21.15.112:0/2856093174 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fee44003a40 con 0x7fee540ca120 2023-09-12T16:07:27.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.817+0000 7fee50ff9700 1 --2- 172.21.15.112:0/2856093174 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fee4006a650 0x7fee4006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.818+0000 7fee50ff9700 1 -- 172.21.15.112:0/2856093174 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fee44088310 con 0x7fee540ca120 2023-09-12T16:07:27.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.819+0000 7fee53fff700 1 --2- 172.21.15.112:0/2856093174 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fee4006a650 0x7fee4006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.820+0000 7fddd0fff700 1 -- 172.21.15.112:0/1088741765 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddcc04e300 con 0x7fddcc071e90 2023-09-12T16:07:27.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.820+0000 7fee53fff700 1 --2- 172.21.15.112:0/2856093174 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fee4006a650 0x7fee4006cb10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fee480084c0 tx=0x7fee4800c040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:27.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.822+0000 7fee50ff9700 1 -- 172.21.15.112:0/2856093174 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fee440536d0 con 0x7fee540ca120 2023-09-12T16:07:27.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.824+0000 7fddbaffd700 1 -- 172.21.15.112:0/1088741765 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fddc0003a40 con 0x7fddcc071e90 2023-09-12T16:07:27.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.826+0000 7fddbaffd700 1 --2- 172.21.15.112:0/1088741765 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fddac06a650 0x7fddac06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.826+0000 7fddbaffd700 1 -- 172.21.15.112:0/1088741765 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fddc0088940 con 0x7fddcc071e90 2023-09-12T16:07:27.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.827+0000 7fddbaffd700 1 -- 172.21.15.112:0/1088741765 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fddc0053c40 con 0x7fddcc071e90 2023-09-12T16:07:27.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.828+0000 7fddc9d9b700 1 --2- 172.21.15.112:0/1088741765 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fddac06a650 0x7fddac06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.829+0000 7fddc9d9b700 1 --2- 172.21.15.112:0/1088741765 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fddac06a650 0x7fddac06cb10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fddbc000f60 tx=0x7fddbc007a40 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:27.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.875+0000 7f5f78fff700 1 -- 172.21.15.112:0/551705868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f5c005210 msgr2=0x7f5f5c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:27.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.875+0000 7f5f78fff700 1 --2- 172.21.15.112:0/551705868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f5c005210 0x7f5f5c00ba10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00c6c0 tx=0x7f5f5c005880 comp rx=0 tx=0).stop 2023-09-12T16:07:27.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.875+0000 7f5f72d9d700 1 -- 172.21.15.112:0/551705868 reap_dead start 2023-09-12T16:07:27.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.875+0000 7f5f78fff700 1 -- 172.21.15.112:0/551705868 shutdown_connections 2023-09-12T16:07:27.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.875+0000 7f5f78fff700 1 -- 172.21.15.112:0/551705868 >> 172.21.15.112:0/551705868 conn(0x7f5f7406a200 msgr2=0x7f5f7406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:27.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.875+0000 7f5f78fff700 1 -- 172.21.15.112:0/551705868 shutdown_connections 2023-09-12T16:07:27.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.875+0000 7f5f78fff700 1 -- 172.21.15.112:0/551705868 wait complete. 2023-09-12T16:07:27.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.878+0000 7f5f78fff700 1 Processor -- start 2023-09-12T16:07:27.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.878+0000 7f5f78fff700 1 -- start start 2023-09-12T16:07:27.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.880+0000 7f5f78fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f5c005210 0x7f5f740c3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.880+0000 7f5f78fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f740cd440 0x7f5f740cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.880+0000 7f5f78fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f741f6100 0x7f5f741f65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.880+0000 7f5f78fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f740c3eb0 con 0x7f5f741f6100 2023-09-12T16:07:27.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.880+0000 7f5f78fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f741f6af0 con 0x7f5f5c005210 2023-09-12T16:07:27.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.880+0000 7f5f78fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f741f7960 con 0x7f5f740cd440 2023-09-12T16:07:27.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.881+0000 7f5f72d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f741f6100 0x7f5f741f65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.881+0000 7f5f72d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f741f6100 0x7f5f741f65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52326/0 (socket says 172.21.15.112:52326) 2023-09-12T16:07:27.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.881+0000 7f5f72d9d700 1 -- 172.21.15.112:0/3464746989 learned_addr learned my addr 172.21.15.112:0/3464746989 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:27.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.881+0000 7f5f72d9d700 1 -- 172.21.15.112:0/3464746989 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f740cd440 msgr2=0x7f5f740cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:27.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.881+0000 7f5f72d9d700 1 --2- 172.21.15.112:0/3464746989 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f740cd440 0x7f5f740cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.882+0000 7f5f72d9d700 1 -- 172.21.15.112:0/3464746989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f5c005210 msgr2=0x7f5f740c3970 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-12T16:07:27.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.882+0000 7f5f72d9d700 1 --2- 172.21.15.112:0/3464746989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f5c005210 0x7f5f740c3970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.882+0000 7f5f72d9d700 1 -- 172.21.15.112:0/3464746989 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f740cde00 con 0x7f5f741f6100 2023-09-12T16:07:27.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.882+0000 7f5f72d9d700 1 --2- 172.21.15.112:0/3464746989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f741f6100 0x7f5f741f65b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c011b90 tx=0x7f5f6c011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:27.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.884+0000 7f5f62ffd700 1 -- 172.21.15.112:0/3464746989 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c015070 con 0x7f5f741f6100 2023-09-12T16:07:27.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.884+0000 7f5f62ffd700 1 -- 172.21.15.112:0/3464746989 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5f6c003cf0 con 0x7f5f741f6100 2023-09-12T16:07:27.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.884+0000 7f5f62ffd700 1 -- 172.21.15.112:0/3464746989 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c004270 con 0x7f5f741f6100 2023-09-12T16:07:27.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.884+0000 7f4c3cfff700 1 -- 172.21.15.112:0/908329160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c200078a0 msgr2=0x7f4c20009d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:27.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.884+0000 7f4c3cfff700 1 --2- 172.21.15.112:0/908329160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c200078a0 0x7f4c20009d10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4c28001050 tx=0x7f4c20003860 comp rx=0 tx=0).stop 2023-09-12T16:07:27.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.884+0000 7f4c36d9d700 1 -- 172.21.15.112:0/908329160 reap_dead start 2023-09-12T16:07:27.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.884+0000 7f5f78fff700 1 -- 172.21.15.112:0/3464746989 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f741f6d30 con 0x7f5f741f6100 2023-09-12T16:07:27.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.884+0000 7f5f78fff700 1 -- 172.21.15.112:0/3464746989 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f741f7310 con 0x7f5f741f6100 2023-09-12T16:07:27.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.885+0000 7f5f78fff700 1 -- 172.21.15.112:0/3464746989 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f580052e0 con 0x7f5f741f6100 2023-09-12T16:07:27.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.886+0000 7fb5fe5ff700 1 -- 172.21.15.112:0/4145608029 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5f80af310 msgr2=0x7fb5f80cc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:27.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.886+0000 7fb5fe5ff700 1 --2- 172.21.15.112:0/4145608029 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5f80af310 0x7fb5f80cc200 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec005f00 tx=0x7fb5ec0077c0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.887+0000 7f121a9ff700 1 -- 172.21.15.112:0/1297100287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12141578d0 msgr2=0x7f12140c9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:27.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.887+0000 7f121a9ff700 1 --2- 172.21.15.112:0/1297100287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12141578d0 0x7f12140c9be0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f12140c9060 tx=0x7f120c00b330 comp rx=0 tx=0).stop 2023-09-12T16:07:27.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.887+0000 7fb5fe5ff700 1 -- 172.21.15.112:0/4145608029 shutdown_connections 2023-09-12T16:07:27.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.887+0000 7fb5fe5ff700 1 --2- 172.21.15.112:0/4145608029 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5f80af310 0x7fb5f80cc200 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.887+0000 7fb5fe5ff700 1 --2- 172.21.15.112:0/4145608029 >> v2:172.21.15.112:3300/0 conn(0x7fb5f80cc980 0x7fb5f80af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.887+0000 7fb5fe5ff700 1 -- 172.21.15.112:0/4145608029 >> 172.21.15.112:0/4145608029 conn(0x7fb5f806a200 msgr2=0x7fb5f806a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:27.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.887+0000 7f4c3cfff700 1 -- 172.21.15.112:0/908329160 shutdown_connections 2023-09-12T16:07:27.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.887+0000 7f4c3cfff700 1 -- 172.21.15.112:0/908329160 >> 172.21.15.112:0/908329160 conn(0x7f4c3806a650 msgr2=0x7f4c3806c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:27.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.887+0000 7f121a9ff700 1 -- 172.21.15.112:0/1297100287 shutdown_connections 2023-09-12T16:07:27.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.887+0000 7f121a9ff700 1 --2- 172.21.15.112:0/1297100287 >> v2:172.21.15.144:3300/0 conn(0x7f12140c8c00 0x7f12140cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.887+0000 7f121a9ff700 1 --2- 172.21.15.112:0/1297100287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12141578d0 0x7f12140c9be0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.887+0000 7f121a9ff700 1 -- 172.21.15.112:0/1297100287 >> 172.21.15.112:0/1297100287 conn(0x7f121406a650 msgr2=0x7f121406c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:27.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.888+0000 7fb5fe5ff700 1 -- 172.21.15.112:0/4145608029 shutdown_connections 2023-09-12T16:07:27.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.889+0000 7f5f62ffd700 1 -- 172.21.15.112:0/3464746989 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f5f6c0043d0 con 0x7f5f741f6100 2023-09-12T16:07:27.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.890+0000 7f5f62ffd700 1 --2- 172.21.15.112:0/3464746989 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5f5406a650 0x7f5f5406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.890+0000 7f5f62ffd700 1 -- 172.21.15.112:0/3464746989 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5f6c08a250 con 0x7f5f741f6100 2023-09-12T16:07:27.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.891+0000 7f5f7259c700 1 --2- 172.21.15.112:0/3464746989 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5f5406a650 0x7f5f5406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.893+0000 7f5f7259c700 1 --2- 172.21.15.112:0/3464746989 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5f5406a650 0x7f5f5406cb10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5f740a9e10 tx=0x7f5f64005f90 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:27.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.890+0000 7f121a9ff700 1 -- 172.21.15.112:0/1297100287 shutdown_connections 2023-09-12T16:07:27.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.890+0000 7f121a9ff700 1 -- 172.21.15.112:0/1297100287 wait complete. 2023-09-12T16:07:27.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.893+0000 7f121a9ff700 1 Processor -- start 2023-09-12T16:07:27.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.888+0000 7fb5fe5ff700 1 -- 172.21.15.112:0/4145608029 wait complete. 2023-09-12T16:07:27.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.891+0000 7fb5fe5ff700 1 Processor -- start 2023-09-12T16:07:27.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.891+0000 7fb5fe5ff700 1 -- start start 2023-09-12T16:07:27.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.892+0000 7fb5fe5ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5f80886c0 0x7fb5f8169f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.892+0000 7fb5fe5ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5f80af310 0x7fb5f806c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.892+0000 7fb5fe5ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5f80cc980 0x7fb5f806c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.892+0000 7fb5fe5ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f80bdea0 con 0x7fb5f80cc980 2023-09-12T16:07:27.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.892+0000 7fb5fe5ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f816a810 con 0x7fb5f80af310 2023-09-12T16:07:27.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.892+0000 7fb5fe5ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f80be120 con 0x7fb5f80886c0 2023-09-12T16:07:27.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.893+0000 7fb5f7fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5f80886c0 0x7fb5f8169f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.893+0000 7fb5f7fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5f80886c0 0x7fb5f8169f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.112:38136/0 (socket says 172.21.15.112:38136) 2023-09-12T16:07:27.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.893+0000 7fb5f7fff700 1 -- 172.21.15.112:0/290346461 learned_addr learned my addr 172.21.15.112:0/290346461 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:27.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.894+0000 7fb5f7fff700 1 -- 172.21.15.112:0/290346461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5f80af310 msgr2=0x7fb5f806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:27.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.894+0000 7fb5f7fff700 1 --2- 172.21.15.112:0/290346461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5f80af310 0x7fb5f806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.894+0000 7fb5f7fff700 1 -- 172.21.15.112:0/290346461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5f80cc980 msgr2=0x7fb5f806c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:27.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.894+0000 7fb5f7fff700 1 --2- 172.21.15.112:0/290346461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5f80cc980 0x7fb5f806c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.894+0000 7fb5f7fff700 1 -- 172.21.15.112:0/290346461 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec0071c0 con 0x7fb5f80886c0 2023-09-12T16:07:27.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.894+0000 7fb5f7fff700 1 --2- 172.21.15.112:0/290346461 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5f80886c0 0x7fb5f8169f10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb5f80cd110 tx=0x7fb5ec004680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:27.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.896+0000 7f5f62ffd700 1 -- 172.21.15.112:0/3464746989 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5f6c055550 con 0x7f5f741f6100 2023-09-12T16:07:27.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.894+0000 7f121a9ff700 1 -- start start 2023-09-12T16:07:27.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.896+0000 7f121a9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12140c8c00 0x7f121414a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.896+0000 7f121a9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12140ca120 0x7f12140af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.896+0000 7f121a9ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12141578d0 0x7f12141478f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.896+0000 7f121a9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1214151740 con 0x7f12140c8c00 2023-09-12T16:07:27.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.896+0000 7f121a9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121414a820 con 0x7f12140ca120 2023-09-12T16:07:27.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.896+0000 7f121a9ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12141490b0 con 0x7f12141578d0 2023-09-12T16:07:27.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.897+0000 7f1218f9c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12141578d0 0x7f12141478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.897+0000 7f12137fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12140ca120 0x7f12140af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.897+0000 7f12137fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12140ca120 0x7f12140af900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.112:56334/0 (socket says 172.21.15.112:56334) 2023-09-12T16:07:27.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.897+0000 7f12137fe700 1 -- 172.21.15.112:0/1550165052 learned_addr learned my addr 172.21.15.112:0/1550165052 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:27.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.896+0000 7f4c3cfff700 1 -- 172.21.15.112:0/908329160 shutdown_connections 2023-09-12T16:07:27.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.896+0000 7fb5f4ff9700 1 -- 172.21.15.112:0/290346461 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec00f040 con 0x7fb5f80886c0 2023-09-12T16:07:27.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.896+0000 7fb5f4ff9700 1 -- 172.21.15.112:0/290346461 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb5ec003d40 con 0x7fb5f80886c0 2023-09-12T16:07:27.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.896+0000 7fb5f4ff9700 1 -- 172.21.15.112:0/290346461 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec00c7f0 con 0x7fb5f80886c0 2023-09-12T16:07:27.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.897+0000 7f12137fe700 1 -- 172.21.15.112:0/1550165052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12141578d0 msgr2=0x7f12141478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:27.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.897+0000 7f12137fe700 1 --2- 172.21.15.112:0/1550165052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12141578d0 0x7f12141478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.897+0000 7f12137fe700 1 -- 172.21.15.112:0/1550165052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12140c8c00 msgr2=0x7f121414a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:27.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.897+0000 7f12137fe700 1 --2- 172.21.15.112:0/1550165052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12140c8c00 0x7f121414a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.897+0000 7f12137fe700 1 -- 172.21.15.112:0/1550165052 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120c009c40 con 0x7f12140ca120 2023-09-12T16:07:27.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.898+0000 7f12137fe700 1 --2- 172.21.15.112:0/1550165052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12140ca120 0x7f12140af900 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f120400c700 tx=0x7f120400ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:27.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.898+0000 7f1210ff9700 1 -- 172.21.15.112:0/1550165052 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12040054e0 con 0x7f12140ca120 2023-09-12T16:07:27.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.899+0000 7f1210ff9700 1 -- 172.21.15.112:0/1550165052 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1204003680 con 0x7f12140ca120 2023-09-12T16:07:27.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.899+0000 7f1210ff9700 1 -- 172.21.15.112:0/1550165052 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1204003a90 con 0x7f12140ca120 2023-09-12T16:07:27.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.897+0000 7fb5fe5ff700 1 -- 172.21.15.112:0/290346461 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f80be400 con 0x7fb5f80886c0 2023-09-12T16:07:27.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.897+0000 7fb5fe5ff700 1 -- 172.21.15.112:0/290346461 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f80c6220 con 0x7fb5f80886c0 2023-09-12T16:07:27.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.898+0000 7fb5fe5ff700 1 -- 172.21.15.112:0/290346461 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f80cd2b0 con 0x7fb5f80886c0 2023-09-12T16:07:27.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.899+0000 7f121a9ff700 1 -- 172.21.15.112:0/1550165052 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1214149390 con 0x7f12140ca120 2023-09-12T16:07:27.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.899+0000 7f121a9ff700 1 -- 172.21.15.112:0/1550165052 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1214151c70 con 0x7f12140ca120 2023-09-12T16:07:27.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.896+0000 7f4c3cfff700 1 -- 172.21.15.112:0/908329160 wait complete. 2023-09-12T16:07:27.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.899+0000 7f4c3cfff700 1 Processor -- start 2023-09-12T16:07:27.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.900+0000 7f4c3cfff700 1 -- start start 2023-09-12T16:07:27.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.901+0000 7f4c3cfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c200078a0 0x7f4c380b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.901+0000 7f4c3cfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c381e1400 0x7f4c381e1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.901+0000 7f4c3cfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c38143630 0x7f4c38143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.901+0000 7f4c3cfff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c381e1dc0 con 0x7f4c200078a0 2023-09-12T16:07:27.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.901+0000 7f4c3cfff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c381e35c0 con 0x7f4c381e1400 2023-09-12T16:07:27.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.902+0000 7f4c3cfff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c381e38a0 con 0x7f4c38143630 2023-09-12T16:07:27.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.902+0000 7f4c36d9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c38143630 0x7f4c38143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.902+0000 7f4c36d9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c38143630 0x7f4c38143ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.112:38164/0 (socket says 172.21.15.112:38164) 2023-09-12T16:07:27.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.902+0000 7f4c36d9d700 1 -- 172.21.15.112:0/2816868549 learned_addr learned my addr 172.21.15.112:0/2816868549 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:27.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.903+0000 7f4c36d9d700 1 -- 172.21.15.112:0/2816868549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c381e1400 msgr2=0x7f4c381e1880 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-12T16:07:27.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.903+0000 7f4c36d9d700 1 --2- 172.21.15.112:0/2816868549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c381e1400 0x7f4c381e1880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.903+0000 7f4c36d9d700 1 -- 172.21.15.112:0/2816868549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c200078a0 msgr2=0x7f4c380b2570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-12T16:07:27.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.903+0000 7f4c36d9d700 1 --2- 172.21.15.112:0/2816868549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c200078a0 0x7f4c380b2570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:27.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.903+0000 7f4c36d9d700 1 -- 172.21.15.112:0/2816868549 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c381e3b80 con 0x7f4c38143630 2023-09-12T16:07:27.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.903+0000 7fb5f4ff9700 1 -- 172.21.15.112:0/290346461 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fb5ec00c950 con 0x7fb5f80886c0 2023-09-12T16:07:27.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.904+0000 7f121a9ff700 1 -- 172.21.15.112:0/1550165052 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f40052e0 con 0x7f12140ca120 2023-09-12T16:07:27.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.904+0000 7f1210ff9700 1 -- 172.21.15.112:0/1550165052 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f1204003bf0 con 0x7f12140ca120 2023-09-12T16:07:27.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.906+0000 7f1210ff9700 1 --2- 172.21.15.112:0/1550165052 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f120006a650 0x7f120006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.906+0000 7f1210ff9700 1 -- 172.21.15.112:0/1550165052 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1204088340 con 0x7f12140ca120 2023-09-12T16:07:27.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.910+0000 7f1210ff9700 1 -- 172.21.15.112:0/1550165052 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f1204053640 con 0x7f12140ca120 2023-09-12T16:07:27.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.905+0000 7f4c36d9d700 1 --2- 172.21.15.112:0/2816868549 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c38143630 0x7f4c38143ac0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4c380c9060 tx=0x7f4c30007620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:27.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.905+0000 7f4c26ffd700 1 -- 172.21.15.112:0/2816868549 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c30007da0 con 0x7f4c38143630 2023-09-12T16:07:27.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.905+0000 7f4c26ffd700 1 -- 172.21.15.112:0/2816868549 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4c3000d2e0 con 0x7f4c38143630 2023-09-12T16:07:27.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.905+0000 7f4c26ffd700 1 -- 172.21.15.112:0/2816868549 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3000b660 con 0x7f4c38143630 2023-09-12T16:07:27.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.907+0000 7f4c3cfff700 1 -- 172.21.15.112:0/2816868549 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c381e3e60 con 0x7f4c38143630 2023-09-12T16:07:27.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.908+0000 7f4c3cfff700 1 -- 172.21.15.112:0/2816868549 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c381e31e0 con 0x7f4c38143630 2023-09-12T16:07:27.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.905+0000 7fb5f4ff9700 1 --2- 172.21.15.112:0/290346461 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb5e406a650 0x7fb5e406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.905+0000 7fb5f4ff9700 1 -- 172.21.15.112:0/290346461 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb5ec08a1e0 con 0x7fb5f80886c0 2023-09-12T16:07:27.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.906+0000 7fb5f4ff9700 1 -- 172.21.15.112:0/290346461 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb5ec08a5c0 con 0x7fb5f80886c0 2023-09-12T16:07:27.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.915+0000 7f1213fff700 1 --2- 172.21.15.112:0/1550165052 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f120006a650 0x7f120006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.917+0000 7f1213fff700 1 --2- 172.21.15.112:0/1550165052 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f120006a650 0x7f120006cb10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f120c000f80 tx=0x7f120c004ad0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:27.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.912+0000 7f4c26ffd700 1 -- 172.21.15.112:0/2816868549 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f4c3000b7c0 con 0x7f4c38143630 2023-09-12T16:07:27.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.914+0000 7f4c26ffd700 1 --2- 172.21.15.112:0/2816868549 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f4c1806a650 0x7f4c1806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:27.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.914+0000 7f4c26ffd700 1 -- 172.21.15.112:0/2816868549 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4c300892a0 con 0x7f4c38143630 2023-09-12T16:07:27.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.915+0000 7fb5f77fe700 1 --2- 172.21.15.112:0/290346461 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb5e406a650 0x7fb5e406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.917+0000 7fb5f77fe700 1 --2- 172.21.15.112:0/290346461 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb5e406a650 0x7fb5e406cb10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000ab90 tx=0x7fb5f0009250 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:27.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.918+0000 7f4c3659c700 1 --2- 172.21.15.112:0/2816868549 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f4c1806a650 0x7f4c1806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:27.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.919+0000 7f4c3659c700 1 --2- 172.21.15.112:0/2816868549 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f4c1806a650 0x7f4c1806cb10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4c381f1070 tx=0x7f4c2c005a60 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:27.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.919+0000 7f4c3cfff700 1 -- 172.21.15.112:0/2816868549 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1c0052e0 con 0x7f4c38143630 2023-09-12T16:07:27.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:27.925+0000 7f4c26ffd700 1 -- 172.21.15.112:0/2816868549 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f4c30054510 con 0x7f4c38143630 2023-09-12T16:07:28.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.232+0000 7fe633dff700 1 -- 172.21.15.112:0/3029571883 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe62c04e300 con 0x7fe62c072310 2023-09-12T16:07:28.237 INFO:teuthology.orchestra.run.smithi112.stdout:55834574858 2023-09-12T16:07:28.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.233+0000 7fe6227fc700 1 -- 172.21.15.112:0/3029571883 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe61c057160 con 0x7fe62c072310 2023-09-12T16:07:28.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.238+0000 7fe633dff700 1 -- 172.21.15.112:0/3029571883 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe61006a650 msgr2=0x7fe61006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:28.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.238+0000 7fe633dff700 1 --2- 172.21.15.112:0/3029571883 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe61006a650 0x7fe61006cb10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe624009610 tx=0x7fe624004b40 comp rx=0 tx=0).stop 2023-09-12T16:07:28.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.238+0000 7fe633dff700 1 -- 172.21.15.112:0/3029571883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe62c072310 msgr2=0x7fe62c0c4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:28.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.238+0000 7fe633dff700 1 --2- 172.21.15.112:0/3029571883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe62c072310 0x7fe62c0c4580 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe61c00c8f0 tx=0x7fe61c00cc00 comp rx=0 tx=0).stop 2023-09-12T16:07:28.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.238+0000 7fe633dff700 1 -- 172.21.15.112:0/3029571883 shutdown_connections 2023-09-12T16:07:28.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.238+0000 7fe633dff700 1 --2- 172.21.15.112:0/3029571883 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe61006a650 0x7fe61006cb10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.238+0000 7fe633dff700 1 --2- 172.21.15.112:0/3029571883 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe62c0af390 0x7fe62c155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.238+0000 7fe633dff700 1 --2- 172.21.15.112:0/3029571883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe62c071e90 0x7fe62c0aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.238+0000 7fe633dff700 1 --2- 172.21.15.112:0/3029571883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe62c072310 0x7fe62c0c4580 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.239+0000 7fe633dff700 1 -- 172.21.15.112:0/3029571883 >> 172.21.15.112:0/3029571883 conn(0x7fe62c06a200 msgr2=0x7fe62c15f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:28.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.239+0000 7fe633dff700 1 -- 172.21.15.112:0/3029571883 shutdown_connections 2023-09-12T16:07:28.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.239+0000 7fe633dff700 1 -- 172.21.15.112:0/3029571883 wait complete. 2023-09-12T16:07:28.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.246+0000 7fde665ff700 1 -- 172.21.15.112:0/659163535 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fde600d2740 con 0x7fde600cd360 2023-09-12T16:07:28.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.247+0000 7fde5cff9700 1 -- 172.21.15.112:0/659163535 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fde54027020 con 0x7fde600cd360 2023-09-12T16:07:28.250 INFO:teuthology.orchestra.run.smithi112.stdout:55834574859 2023-09-12T16:07:28.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.251+0000 7fde665ff700 1 -- 172.21.15.112:0/659163535 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fde4c06a650 msgr2=0x7fde4c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:28.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.251+0000 7fde665ff700 1 --2- 172.21.15.112:0/659163535 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fde4c06a650 0x7fde4c06cb10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fde50009340 tx=0x7fde5000b040 comp rx=0 tx=0).stop 2023-09-12T16:07:28.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.251+0000 7fde665ff700 1 -- 172.21.15.112:0/659163535 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde600cd360 msgr2=0x7fde600ca3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:28.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.251+0000 7fde665ff700 1 --2- 172.21.15.112:0/659163535 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde600cd360 0x7fde600ca3e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fde54015000 tx=0x7fde54003c20 comp rx=0 tx=0).stop 2023-09-12T16:07:28.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.252+0000 7fde665ff700 1 -- 172.21.15.112:0/659163535 shutdown_connections 2023-09-12T16:07:28.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.252+0000 7fde665ff700 1 --2- 172.21.15.112:0/659163535 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fde4c06a650 0x7fde4c06cb10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.252+0000 7fde665ff700 1 --2- 172.21.15.112:0/659163535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde6015b920 0x7fde6015e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.252+0000 7fde665ff700 1 --2- 172.21.15.112:0/659163535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde600cceb0 0x7fde6015aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.252+0000 7fde665ff700 1 --2- 172.21.15.112:0/659163535 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde600cd360 0x7fde600ca3e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.252+0000 7fde665ff700 1 -- 172.21.15.112:0/659163535 >> 172.21.15.112:0/659163535 conn(0x7fde6009abe0 msgr2=0x7fde601e6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:28.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.252+0000 7fde665ff700 1 -- 172.21.15.112:0/659163535 shutdown_connections 2023-09-12T16:07:28.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.252+0000 7fde665ff700 1 -- 172.21.15.112:0/659163535 wait complete. 2023-09-12T16:07:28.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.269+0000 7fee5a9ff700 1 -- 172.21.15.112:0/2856093174 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fee541e1640 con 0x7fee540ca120 2023-09-12T16:07:28.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.270+0000 7fee50ff9700 1 -- 172.21.15.112:0/2856093174 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fee44056cf0 con 0x7fee540ca120 2023-09-12T16:07:28.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2023-09-12T16:07:28.273 DEBUG:teuthology.parallel:result is None 2023-09-12T16:07:28.273 INFO:teuthology.orchestra.run.smithi112.stdout:55834574859 2023-09-12T16:07:28.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.277+0000 7fee5a9ff700 1 -- 172.21.15.112:0/2856093174 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fee4006a650 msgr2=0x7fee4006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:28.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.277+0000 7fee5a9ff700 1 --2- 172.21.15.112:0/2856093174 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fee4006a650 0x7fee4006cb10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fee480084c0 tx=0x7fee4800c040 comp rx=0 tx=0).stop 2023-09-12T16:07:28.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.277+0000 7fee5a9ff700 1 -- 172.21.15.112:0/2856093174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee540ca120 msgr2=0x7fee5414dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:28.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.277+0000 7fee5a9ff700 1 --2- 172.21.15.112:0/2856093174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee540ca120 0x7fee5414dd70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fee44000f60 tx=0x7fee4400c790 comp rx=0 tx=0).stop 2023-09-12T16:07:28.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.282+0000 7fee5a9ff700 1 -- 172.21.15.112:0/2856093174 shutdown_connections 2023-09-12T16:07:28.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.282+0000 7fee5a9ff700 1 --2- 172.21.15.112:0/2856093174 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fee4006a650 0x7fee4006cb10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.282+0000 7fee5a9ff700 1 --2- 172.21.15.112:0/2856093174 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee540c8c00 0x7fee541e2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.282+0000 7fee5a9ff700 1 --2- 172.21.15.112:0/2856093174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee541578d0 0x7fee540c3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.282+0000 7fee5a9ff700 1 --2- 172.21.15.112:0/2856093174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee540ca120 0x7fee5414dd70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.282+0000 7fee5a9ff700 1 -- 172.21.15.112:0/2856093174 >> 172.21.15.112:0/2856093174 conn(0x7fee5406a650 msgr2=0x7fee540af020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:28.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2023-09-12T16:07:28.285 DEBUG:teuthology.parallel:result is None 2023-09-12T16:07:28.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.283+0000 7fee5a9ff700 1 -- 172.21.15.112:0/2856093174 shutdown_connections 2023-09-12T16:07:28.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.283+0000 7fee5a9ff700 1 -- 172.21.15.112:0/2856093174 wait complete. 2023-09-12T16:07:28.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.289+0000 7fddd0fff700 1 -- 172.21.15.112:0/1088741765 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fddcc0cd060 con 0x7fddcc071e90 2023-09-12T16:07:28.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.289+0000 7fddbaffd700 1 -- 172.21.15.112:0/1088741765 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fddc0017020 con 0x7fddcc071e90 2023-09-12T16:07:28.289 INFO:teuthology.orchestra.run.smithi112.stdout:55834574858 2023-09-12T16:07:28.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.293+0000 7fddd0fff700 1 -- 172.21.15.112:0/1088741765 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fddac06a650 msgr2=0x7fddac06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:28.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.293+0000 7fddd0fff700 1 --2- 172.21.15.112:0/1088741765 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fddac06a650 0x7fddac06cb10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fddbc000f60 tx=0x7fddbc007a40 comp rx=0 tx=0).stop 2023-09-12T16:07:28.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.293+0000 7fddd0fff700 1 -- 172.21.15.112:0/1088741765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddcc071e90 msgr2=0x7fddcc1fe980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:28.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.293+0000 7fddd0fff700 1 --2- 172.21.15.112:0/1088741765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddcc071e90 0x7fddcc1fe980 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fddc000c4e0 tx=0x7fddc000c8a0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.293+0000 7fddd0fff700 1 -- 172.21.15.112:0/1088741765 shutdown_connections 2023-09-12T16:07:28.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.293+0000 7fddd0fff700 1 --2- 172.21.15.112:0/1088741765 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fddac06a650 0x7fddac06cb10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.293+0000 7fddd0fff700 1 --2- 172.21.15.112:0/1088741765 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc15fe40 0x7fddcc15aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.293+0000 7fddd0fff700 1 --2- 172.21.15.112:0/1088741765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddcc071e90 0x7fddcc1fe980 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.293+0000 7fddd0fff700 1 --2- 172.21.15.112:0/1088741765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddcc0af390 0x7fddcc0c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.293+0000 7fddd0fff700 1 -- 172.21.15.112:0/1088741765 >> 172.21.15.112:0/1088741765 conn(0x7fddcc06a200 msgr2=0x7fddcc156c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:28.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.294+0000 7fddd0fff700 1 -- 172.21.15.112:0/1088741765 shutdown_connections 2023-09-12T16:07:28.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.294+0000 7fddd0fff700 1 -- 172.21.15.112:0/1088741765 wait complete. 2023-09-12T16:07:28.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2023-09-12T16:07:28.315 DEBUG:teuthology.parallel:result is None 2023-09-12T16:07:28.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2023-09-12T16:07:28.323 DEBUG:teuthology.parallel:result is None 2023-09-12T16:07:28.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.327+0000 7f5f78fff700 1 -- 172.21.15.112:0/3464746989 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5f58005150 con 0x7f5f741f6100 2023-09-12T16:07:28.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.328+0000 7f5f62ffd700 1 -- 172.21.15.112:0/3464746989 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5f6c003e60 con 0x7f5f741f6100 2023-09-12T16:07:28.328 INFO:teuthology.orchestra.run.smithi112.stdout:55834574858 2023-09-12T16:07:28.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.330+0000 7f5f78fff700 1 -- 172.21.15.112:0/3464746989 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5f5406a650 msgr2=0x7f5f5406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:28.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.330+0000 7f5f78fff700 1 --2- 172.21.15.112:0/3464746989 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5f5406a650 0x7f5f5406cb10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5f740a9e10 tx=0x7f5f64005f90 comp rx=0 tx=0).stop 2023-09-12T16:07:28.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.330+0000 7f5f78fff700 1 -- 172.21.15.112:0/3464746989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f741f6100 msgr2=0x7f5f741f65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:28.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.330+0000 7f5f78fff700 1 --2- 172.21.15.112:0/3464746989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f741f6100 0x7f5f741f65b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c011b90 tx=0x7f5f6c011bc0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.330+0000 7f5f78fff700 1 -- 172.21.15.112:0/3464746989 shutdown_connections 2023-09-12T16:07:28.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.330+0000 7f5f78fff700 1 --2- 172.21.15.112:0/3464746989 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5f5406a650 0x7f5f5406cb10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.330+0000 7f5f78fff700 1 --2- 172.21.15.112:0/3464746989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f741f6100 0x7f5f741f65b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.330+0000 7f5f78fff700 1 --2- 172.21.15.112:0/3464746989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f5c005210 0x7f5f740c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.330+0000 7f5f78fff700 1 --2- 172.21.15.112:0/3464746989 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f740cd440 0x7f5f740cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.330+0000 7f5f78fff700 1 -- 172.21.15.112:0/3464746989 >> 172.21.15.112:0/3464746989 conn(0x7f5f7406a200 msgr2=0x7f5f74071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:28.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.331+0000 7f5f78fff700 1 -- 172.21.15.112:0/3464746989 shutdown_connections 2023-09-12T16:07:28.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.331+0000 7f5f78fff700 1 -- 172.21.15.112:0/3464746989 wait complete. 2023-09-12T16:07:28.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.337+0000 7f4c3cfff700 1 -- 172.21.15.112:0/2816868549 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4c1c005590 con 0x7f4c38143630 2023-09-12T16:07:28.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.338+0000 7f4c26ffd700 1 -- 172.21.15.112:0/2816868549 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4c3001a020 con 0x7f4c38143630 2023-09-12T16:07:28.338 INFO:teuthology.orchestra.run.smithi112.stdout:55834574860 2023-09-12T16:07:28.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.340+0000 7f4c3cfff700 1 -- 172.21.15.112:0/2816868549 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f4c1806a650 msgr2=0x7f4c1806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:28.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.340+0000 7f4c3cfff700 1 --2- 172.21.15.112:0/2816868549 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f4c1806a650 0x7f4c1806cb10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4c381f1070 tx=0x7f4c2c005a60 comp rx=0 tx=0).stop 2023-09-12T16:07:28.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.340+0000 7f4c3cfff700 1 -- 172.21.15.112:0/2816868549 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c38143630 msgr2=0x7f4c38143ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:28.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.340+0000 7f4c3cfff700 1 --2- 172.21.15.112:0/2816868549 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c38143630 0x7f4c38143ac0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4c380c9060 tx=0x7f4c30007620 comp rx=0 tx=0).stop 2023-09-12T16:07:28.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.340+0000 7f4c3cfff700 1 -- 172.21.15.112:0/2816868549 shutdown_connections 2023-09-12T16:07:28.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.340+0000 7f4c3cfff700 1 --2- 172.21.15.112:0/2816868549 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f4c1806a650 0x7f4c1806cb10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.340+0000 7f4c3cfff700 1 --2- 172.21.15.112:0/2816868549 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c38143630 0x7f4c38143ac0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.340+0000 7f4c3cfff700 1 --2- 172.21.15.112:0/2816868549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c200078a0 0x7f4c380b2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.340+0000 7f4c3cfff700 1 --2- 172.21.15.112:0/2816868549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c381e1400 0x7f4c381e1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.340+0000 7f4c3cfff700 1 -- 172.21.15.112:0/2816868549 >> 172.21.15.112:0/2816868549 conn(0x7f4c3806a650 msgr2=0x7f4c380c6590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:28.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.340+0000 7f4c3cfff700 1 -- 172.21.15.112:0/2816868549 shutdown_connections 2023-09-12T16:07:28.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.341+0000 7f4c3cfff700 1 -- 172.21.15.112:0/2816868549 wait complete. 2023-09-12T16:07:28.351 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2023-09-12T16:07:28.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.352+0000 7fb5fe5ff700 1 -- 172.21.15.112:0/290346461 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fb5f80be920 con 0x7fb5f80886c0 2023-09-12T16:07:28.352 DEBUG:teuthology.parallel:result is None 2023-09-12T16:07:28.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.352+0000 7fb5f4ff9700 1 -- 172.21.15.112:0/290346461 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb5ec0554e0 con 0x7fb5f80886c0 2023-09-12T16:07:28.353 INFO:teuthology.orchestra.run.smithi112.stdout:55834574859 2023-09-12T16:07:28.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.356+0000 7fb5fe5ff700 1 -- 172.21.15.112:0/290346461 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb5e406a650 msgr2=0x7fb5e406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:28.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.356+0000 7fb5fe5ff700 1 --2- 172.21.15.112:0/290346461 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb5e406a650 0x7fb5e406cb10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000ab90 tx=0x7fb5f0009250 comp rx=0 tx=0).stop 2023-09-12T16:07:28.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.356+0000 7fb5fe5ff700 1 -- 172.21.15.112:0/290346461 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5f80886c0 msgr2=0x7fb5f8169f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:28.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.356+0000 7fb5fe5ff700 1 --2- 172.21.15.112:0/290346461 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5f80886c0 0x7fb5f8169f10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb5f80cd110 tx=0x7fb5ec004680 comp rx=0 tx=0).stop 2023-09-12T16:07:28.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.356+0000 7fb5fe5ff700 1 -- 172.21.15.112:0/290346461 shutdown_connections 2023-09-12T16:07:28.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.356+0000 7fb5fe5ff700 1 --2- 172.21.15.112:0/290346461 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb5e406a650 0x7fb5e406cb10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.356+0000 7fb5fe5ff700 1 --2- 172.21.15.112:0/290346461 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5f80886c0 0x7fb5f8169f10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.356+0000 7fb5fe5ff700 1 --2- 172.21.15.112:0/290346461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5f80cc980 0x7fb5f806c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.356+0000 7fb5fe5ff700 1 --2- 172.21.15.112:0/290346461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5f80af310 0x7fb5f806c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.356+0000 7fb5fe5ff700 1 -- 172.21.15.112:0/290346461 >> 172.21.15.112:0/290346461 conn(0x7fb5f806a200 msgr2=0x7fb5f80cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:28.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.356+0000 7fb5fe5ff700 1 -- 172.21.15.112:0/290346461 shutdown_connections 2023-09-12T16:07:28.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.356+0000 7fb5fe5ff700 1 -- 172.21.15.112:0/290346461 wait complete. 2023-09-12T16:07:28.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.6 2023-09-12T16:07:28.361 DEBUG:teuthology.parallel:result is None 2023-09-12T16:07:28.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.361+0000 7f121a9ff700 1 -- 172.21.15.112:0/1550165052 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f11f4005150 con 0x7f12140ca120 2023-09-12T16:07:28.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.362+0000 7f1210ff9700 1 -- 172.21.15.112:0/1550165052 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1204001270 con 0x7f12140ca120 2023-09-12T16:07:28.362 INFO:teuthology.orchestra.run.smithi112.stdout:55834574859 2023-09-12T16:07:28.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.364+0000 7f121a9ff700 1 -- 172.21.15.112:0/1550165052 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f120006a650 msgr2=0x7f120006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:28.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.364+0000 7f121a9ff700 1 --2- 172.21.15.112:0/1550165052 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f120006a650 0x7f120006cb10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f120c000f80 tx=0x7f120c004ad0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.364+0000 7f121a9ff700 1 -- 172.21.15.112:0/1550165052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12140ca120 msgr2=0x7f12140af900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:28.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.364+0000 7f121a9ff700 1 --2- 172.21.15.112:0/1550165052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12140ca120 0x7f12140af900 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f120400c700 tx=0x7f120400ca10 comp rx=0 tx=0).stop 2023-09-12T16:07:28.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.364+0000 7f121a9ff700 1 -- 172.21.15.112:0/1550165052 shutdown_connections 2023-09-12T16:07:28.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.364+0000 7f121a9ff700 1 --2- 172.21.15.112:0/1550165052 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f120006a650 0x7f120006cb10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.364+0000 7f121a9ff700 1 --2- 172.21.15.112:0/1550165052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12141578d0 0x7f12141478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.364+0000 7f121a9ff700 1 --2- 172.21.15.112:0/1550165052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12140c8c00 0x7f121414a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.364+0000 7f121a9ff700 1 --2- 172.21.15.112:0/1550165052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12140ca120 0x7f12140af900 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.364+0000 7f121a9ff700 1 -- 172.21.15.112:0/1550165052 >> 172.21.15.112:0/1550165052 conn(0x7f121406a650 msgr2=0x7f121415a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:28.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.364+0000 7f121a9ff700 1 -- 172.21.15.112:0/1550165052 shutdown_connections 2023-09-12T16:07:28.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.365+0000 7f121a9ff700 1 -- 172.21.15.112:0/1550165052 wait complete. 2023-09-12T16:07:28.376 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2023-09-12T16:07:28.376 DEBUG:teuthology.parallel:result is None 2023-09-12T16:07:28.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2023-09-12T16:07:28.383 DEBUG:teuthology.parallel:result is None 2023-09-12T16:07:28.383 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-12T16:07:28.383 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-12T16:07:28.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.621+0000 7f22187ff700 1 -- 172.21.15.112:0/10775308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22100b28f0 msgr2=0x7f22100cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:28.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.621+0000 7f22187ff700 1 --2- 172.21.15.112:0/10775308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22100b28f0 0x7f22100cd3c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f22100cf400 tx=0x7f220800b380 comp rx=0 tx=0).stop 2023-09-12T16:07:28.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.621+0000 7f22187ff700 1 -- 172.21.15.112:0/10775308 shutdown_connections 2023-09-12T16:07:28.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.621+0000 7f22187ff700 1 --2- 172.21.15.112:0/10775308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22100b28f0 0x7f22100cd3c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.621+0000 7f22187ff700 1 --2- 172.21.15.112:0/10775308 >> v2:172.21.15.144:3300/0 conn(0x7f221015f480 0x7f22100cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.621+0000 7f22187ff700 1 -- 172.21.15.112:0/10775308 >> 172.21.15.112:0/10775308 conn(0x7f22100d1930 msgr2=0x7f22100d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:28.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.621+0000 7f22187ff700 1 -- 172.21.15.112:0/10775308 shutdown_connections 2023-09-12T16:07:28.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.622+0000 7f22187ff700 1 -- 172.21.15.112:0/10775308 wait complete. 2023-09-12T16:07:28.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.624+0000 7f22187ff700 1 Processor -- start 2023-09-12T16:07:28.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.624+0000 7f22187ff700 1 -- start start 2023-09-12T16:07:28.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.625+0000 7f22187ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22100b28f0 0x7f2210158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:28.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.625+0000 7f22187ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22100cdfb0 0x7f2210158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:28.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.625+0000 7f22187ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f221015f480 0x7f22100b6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:28.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.625+0000 7f22187ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22101588a0 con 0x7f22100b28f0 2023-09-12T16:07:28.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.625+0000 7f22187ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22100b7460 con 0x7f22100cdfb0 2023-09-12T16:07:28.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.625+0000 7f22187ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22101590f0 con 0x7f221015f480 2023-09-12T16:07:28.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.625+0000 7f221659b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22100b28f0 0x7f2210158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:28.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.625+0000 7f221659b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22100b28f0 0x7f2210158a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52384/0 (socket says 172.21.15.112:52384) 2023-09-12T16:07:28.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.625+0000 7f221659b700 1 -- 172.21.15.112:0/3305962574 learned_addr learned my addr 172.21.15.112:0/3305962574 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:28.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.625+0000 7f2216d9c700 1 --2- 172.21.15.112:0/3305962574 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f221015f480 0x7f22100b6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:28.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.625+0000 7f2215d9a700 1 --2- 172.21.15.112:0/3305962574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22100cdfb0 0x7f2210158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:28.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.625+0000 7f221659b700 1 -- 172.21.15.112:0/3305962574 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f221015f480 msgr2=0x7f22100b6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:28.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.625+0000 7f221659b700 1 --2- 172.21.15.112:0/3305962574 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f221015f480 0x7f22100b6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.625+0000 7f221659b700 1 -- 172.21.15.112:0/3305962574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22100cdfb0 msgr2=0x7f2210158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:28.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.625+0000 7f221659b700 1 --2- 172.21.15.112:0/3305962574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22100cdfb0 0x7f2210158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.625+0000 7f221659b700 1 -- 172.21.15.112:0/3305962574 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2208009d00 con 0x7f22100b28f0 2023-09-12T16:07:28.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.626+0000 7f221659b700 1 --2- 172.21.15.112:0/3305962574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22100b28f0 0x7f2210158a80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f220c00c900 tx=0x7f220c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:28.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.626+0000 7f2206ffd700 1 -- 172.21.15.112:0/3305962574 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220c007b00 con 0x7f22100b28f0 2023-09-12T16:07:28.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.626+0000 7f2206ffd700 1 -- 172.21.15.112:0/3305962574 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f220c007d50 con 0x7f22100b28f0 2023-09-12T16:07:28.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.626+0000 7f22187ff700 1 -- 172.21.15.112:0/3305962574 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22101593d0 con 0x7f22100b28f0 2023-09-12T16:07:28.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.626+0000 7f2206ffd700 1 -- 172.21.15.112:0/3305962574 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220c004ab0 con 0x7f22100b28f0 2023-09-12T16:07:28.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.626+0000 7f22187ff700 1 -- 172.21.15.112:0/3305962574 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2210159990 con 0x7f22100b28f0 2023-09-12T16:07:28.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.627+0000 7f22187ff700 1 -- 172.21.15.112:0/3305962574 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f221004e300 con 0x7f22100b28f0 2023-09-12T16:07:28.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.628+0000 7f2206ffd700 1 -- 172.21.15.112:0/3305962574 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f220c004c10 con 0x7f22100b28f0 2023-09-12T16:07:28.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.629+0000 7f2206ffd700 1 --2- 172.21.15.112:0/3305962574 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f21f406a580 0x7f21f406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:28.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.629+0000 7f2206ffd700 1 -- 172.21.15.112:0/3305962574 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f220c0890d0 con 0x7f22100b28f0 2023-09-12T16:07:28.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.629+0000 7f2215d9a700 1 --2- 172.21.15.112:0/3305962574 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f21f406a580 0x7f21f406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:28.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.629+0000 7f2215d9a700 1 --2- 172.21.15.112:0/3305962574 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f21f406a580 0x7f21f406ca40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f221015ec90 tx=0x7f2200009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:28.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.633+0000 7f2206ffd700 1 -- 172.21.15.112:0/3305962574 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f220c0543f0 con 0x7f22100b28f0 2023-09-12T16:07:28.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.829+0000 7f22187ff700 1 -- 172.21.15.112:0/3305962574 --> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f22100c5ee0 con 0x7f21f406a580 2023-09-12T16:07:28.839 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.839+0000 7f2206ffd700 1 -- 172.21.15.112:0/3305962574 <== mgr.4176 v2:172.21.15.112:6832/1000013333 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345317 (secure 0 0 0) 0x7f2200015430 con 0x7f21f406a580 2023-09-12T16:07:28.844 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:28.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.844+0000 7f22187ff700 1 -- 172.21.15.112:0/3305962574 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f21f406a580 msgr2=0x7f21f406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:28.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.844+0000 7f22187ff700 1 --2- 172.21.15.112:0/3305962574 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f21f406a580 0x7f21f406ca40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f221015ec90 tx=0x7f2200009040 comp rx=0 tx=0).stop 2023-09-12T16:07:28.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.844+0000 7f22187ff700 1 -- 172.21.15.112:0/3305962574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22100b28f0 msgr2=0x7f2210158a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:28.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.844+0000 7f22187ff700 1 --2- 172.21.15.112:0/3305962574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22100b28f0 0x7f2210158a80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f220c00c900 tx=0x7f220c00ccc0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.844+0000 7f22187ff700 1 -- 172.21.15.112:0/3305962574 shutdown_connections 2023-09-12T16:07:28.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.844+0000 7f22187ff700 1 --2- 172.21.15.112:0/3305962574 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f21f406a580 0x7f21f406ca40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.844+0000 7f22187ff700 1 --2- 172.21.15.112:0/3305962574 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f221015f480 0x7f22100b6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.844+0000 7f22187ff700 1 --2- 172.21.15.112:0/3305962574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22100b28f0 0x7f2210158a80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.844+0000 7f22187ff700 1 --2- 172.21.15.112:0/3305962574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22100cdfb0 0x7f2210158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:28.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.844+0000 7f22187ff700 1 -- 172.21.15.112:0/3305962574 >> 172.21.15.112:0/3305962574 conn(0x7f22100d1930 msgr2=0x7f22100ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:28.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.844+0000 7f22187ff700 1 -- 172.21.15.112:0/3305962574 shutdown_connections 2023-09-12T16:07:28.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:28.844+0000 7f22187ff700 1 -- 172.21.15.112:0/3305962574 wait complete. 2023-09-12T16:07:28.849 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-09-12T16:07:28.862 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-09-12T16:07:28.820207+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219376,"kb_used_data":3204,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755344,"statfs":{"total":773094113280,"available":772869472256,"internally_reserved":0,"allocated":3280896,"data_stored":1987237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002798"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.617354+0000","last_change":"2023-09-12T16:07:00.253786+0000","last_active":"2023-09-12T16:07:04.617354+0000","last_peered":"2023-09-12T16:07:04.617354+0000","last_clean":"2023-09-12T16:07:04.617354+0000","last_became_active":"2023-09-12T16:07:00.251978+0000","last_became_peered":"2023-09-12T16:07:00.251978+0000","last_unstale":"2023-09-12T16:07:04.617354+0000","last_undegraded":"2023-09-12T16:07:04.617354+0000","last_fullsized":"2023-09-12T16:07:04.617354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:19:17.260974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251964+0000","last_change":"2023-09-12T16:07:00.245299+0000","last_active":"2023-09-12T16:07:04.251964+0000","last_peered":"2023-09-12T16:07:04.251964+0000","last_clean":"2023-09-12T16:07:04.251964+0000","last_became_active":"2023-09-12T16:07:00.245040+0000","last_became_peered":"2023-09-12T16:07:00.245040+0000","last_unstale":"2023-09-12T16:07:04.251964+0000","last_undegraded":"2023-09-12T16:07:04.251964+0000","last_fullsized":"2023-09-12T16:07:04.251964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:38:37.389648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257391+0000","last_change":"2023-09-12T16:07:00.219173+0000","last_active":"2023-09-12T16:07:04.257391+0000","last_peered":"2023-09-12T16:07:04.257391+0000","last_clean":"2023-09-12T16:07:04.257391+0000","last_became_active":"2023-09-12T16:07:00.218882+0000","last_became_peered":"2023-09-12T16:07:00.218882+0000","last_unstale":"2023-09-12T16:07:04.257391+0000","last_undegraded":"2023-09-12T16:07:04.257391+0000","last_fullsized":"2023-09-12T16:07:04.257391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:37.582798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262241+0000","last_change":"2023-09-12T16:07:00.246106+0000","last_active":"2023-09-12T16:07:04.262241+0000","last_peered":"2023-09-12T16:07:04.262241+0000","last_clean":"2023-09-12T16:07:04.262241+0000","last_became_active":"2023-09-12T16:07:00.245639+0000","last_became_peered":"2023-09-12T16:07:00.245639+0000","last_unstale":"2023-09-12T16:07:04.262241+0000","last_undegraded":"2023-09-12T16:07:04.262241+0000","last_fullsized":"2023-09-12T16:07:04.262241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:41:27.002114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616202+0000","last_change":"2023-09-12T16:07:00.246089+0000","last_active":"2023-09-12T16:07:04.616202+0000","last_peered":"2023-09-12T16:07:04.616202+0000","last_clean":"2023-09-12T16:07:04.616202+0000","last_became_active":"2023-09-12T16:07:00.245831+0000","last_became_peered":"2023-09-12T16:07:00.245831+0000","last_unstale":"2023-09-12T16:07:04.616202+0000","last_undegraded":"2023-09-12T16:07:04.616202+0000","last_fullsized":"2023-09-12T16:07:04.616202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:11:30.292559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262233+0000","last_change":"2023-09-12T16:07:00.246840+0000","last_active":"2023-09-12T16:07:04.262233+0000","last_peered":"2023-09-12T16:07:04.262233+0000","last_clean":"2023-09-12T16:07:04.262233+0000","last_became_active":"2023-09-12T16:07:00.246570+0000","last_became_peered":"2023-09-12T16:07:00.246570+0000","last_unstale":"2023-09-12T16:07:04.262233+0000","last_undegraded":"2023-09-12T16:07:04.262233+0000","last_fullsized":"2023-09-12T16:07:04.262233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:42:25.200461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616003+0000","last_change":"2023-09-12T16:07:00.251283+0000","last_active":"2023-09-12T16:07:04.616003+0000","last_peered":"2023-09-12T16:07:04.616003+0000","last_clean":"2023-09-12T16:07:04.616003+0000","last_became_active":"2023-09-12T16:07:00.250953+0000","last_became_peered":"2023-09-12T16:07:00.250953+0000","last_unstale":"2023-09-12T16:07:04.616003+0000","last_undegraded":"2023-09-12T16:07:04.616003+0000","last_fullsized":"2023-09-12T16:07:04.616003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:38:37.389648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259047+0000","last_change":"2023-09-12T16:07:00.247292+0000","last_active":"2023-09-12T16:07:04.259047+0000","last_peered":"2023-09-12T16:07:04.259047+0000","last_clean":"2023-09-12T16:07:04.259047+0000","last_became_active":"2023-09-12T16:07:00.246988+0000","last_became_peered":"2023-09-12T16:07:00.246988+0000","last_unstale":"2023-09-12T16:07:04.259047+0000","last_undegraded":"2023-09-12T16:07:04.259047+0000","last_fullsized":"2023-09-12T16:07:04.259047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:55:23.361221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.617248+0000","last_change":"2023-09-12T16:07:00.248892+0000","last_active":"2023-09-12T16:07:04.617248+0000","last_peered":"2023-09-12T16:07:04.617248+0000","last_clean":"2023-09-12T16:07:04.617248+0000","last_became_active":"2023-09-12T16:07:00.248600+0000","last_became_peered":"2023-09-12T16:07:00.248600+0000","last_unstale":"2023-09-12T16:07:04.617248+0000","last_undegraded":"2023-09-12T16:07:04.617248+0000","last_fullsized":"2023-09-12T16:07:04.617248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:42:25.200461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.266142+0000","last_change":"2023-09-12T16:07:00.247355+0000","last_active":"2023-09-12T16:07:04.266142+0000","last_peered":"2023-09-12T16:07:04.266142+0000","last_clean":"2023-09-12T16:07:04.266142+0000","last_became_active":"2023-09-12T16:07:00.247057+0000","last_became_peered":"2023-09-12T16:07:00.247057+0000","last_unstale":"2023-09-12T16:07:04.266142+0000","last_undegraded":"2023-09-12T16:07:04.266142+0000","last_fullsized":"2023-09-12T16:07:04.266142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:14:21.195478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.265053+0000","last_change":"2023-09-12T16:07:00.249260+0000","last_active":"2023-09-12T16:07:04.265053+0000","last_peered":"2023-09-12T16:07:04.265053+0000","last_clean":"2023-09-12T16:07:04.265053+0000","last_became_active":"2023-09-12T16:07:00.248927+0000","last_became_peered":"2023-09-12T16:07:00.248927+0000","last_unstale":"2023-09-12T16:07:04.265053+0000","last_undegraded":"2023-09-12T16:07:04.265053+0000","last_fullsized":"2023-09-12T16:07:04.265053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:37.582798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259993+0000","last_change":"2023-09-12T16:07:00.242778+0000","last_active":"2023-09-12T16:07:04.259993+0000","last_peered":"2023-09-12T16:07:04.259993+0000","last_clean":"2023-09-12T16:07:04.259993+0000","last_became_active":"2023-09-12T16:07:00.242486+0000","last_became_peered":"2023-09-12T16:07:00.242486+0000","last_unstale":"2023-09-12T16:07:04.259993+0000","last_undegraded":"2023-09-12T16:07:04.259993+0000","last_fullsized":"2023-09-12T16:07:04.259993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:44:50.756697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257289+0000","last_change":"2023-09-12T16:07:00.243909+0000","last_active":"2023-09-12T16:07:04.257289+0000","last_peered":"2023-09-12T16:07:04.257289+0000","last_clean":"2023-09-12T16:07:04.257289+0000","last_became_active":"2023-09-12T16:07:00.243407+0000","last_became_peered":"2023-09-12T16:07:00.243407+0000","last_unstale":"2023-09-12T16:07:04.257289+0000","last_undegraded":"2023-09-12T16:07:04.257289+0000","last_fullsized":"2023-09-12T16:07:04.257289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:14:21.195478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257539+0000","last_change":"2023-09-12T16:07:00.238637+0000","last_active":"2023-09-12T16:07:04.257539+0000","last_peered":"2023-09-12T16:07:04.257539+0000","last_clean":"2023-09-12T16:07:04.257539+0000","last_became_active":"2023-09-12T16:07:00.238391+0000","last_became_peered":"2023-09-12T16:07:00.238391+0000","last_unstale":"2023-09-12T16:07:04.257539+0000","last_undegraded":"2023-09-12T16:07:04.257539+0000","last_fullsized":"2023-09-12T16:07:04.257539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:53:20.853979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251492+0000","last_change":"2023-09-12T16:07:00.242098+0000","last_active":"2023-09-12T16:07:04.251492+0000","last_peered":"2023-09-12T16:07:04.251492+0000","last_clean":"2023-09-12T16:07:04.251492+0000","last_became_active":"2023-09-12T16:07:00.241773+0000","last_became_peered":"2023-09-12T16:07:00.241773+0000","last_unstale":"2023-09-12T16:07:04.251492+0000","last_undegraded":"2023-09-12T16:07:04.251492+0000","last_fullsized":"2023-09-12T16:07:04.251492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:53:20.853979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262541+0000","last_change":"2023-09-12T16:07:00.241891+0000","last_active":"2023-09-12T16:07:04.262541+0000","last_peered":"2023-09-12T16:07:04.262541+0000","last_clean":"2023-09-12T16:07:04.262541+0000","last_became_active":"2023-09-12T16:07:00.241300+0000","last_became_peered":"2023-09-12T16:07:00.241300+0000","last_unstale":"2023-09-12T16:07:04.262541+0000","last_undegraded":"2023-09-12T16:07:04.262541+0000","last_fullsized":"2023-09-12T16:07:04.262541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:58.775088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262201+0000","last_change":"2023-09-12T16:07:00.250157+0000","last_active":"2023-09-12T16:07:04.262201+0000","last_peered":"2023-09-12T16:07:04.262201+0000","last_clean":"2023-09-12T16:07:04.262201+0000","last_became_active":"2023-09-12T16:07:00.249481+0000","last_became_peered":"2023-09-12T16:07:00.249481+0000","last_unstale":"2023-09-12T16:07:04.262201+0000","last_undegraded":"2023-09-12T16:07:04.262201+0000","last_fullsized":"2023-09-12T16:07:04.262201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:31.336670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262823+0000","last_change":"2023-09-12T16:07:00.219775+0000","last_active":"2023-09-12T16:07:04.262823+0000","last_peered":"2023-09-12T16:07:04.262823+0000","last_clean":"2023-09-12T16:07:04.262823+0000","last_became_active":"2023-09-12T16:07:00.219459+0000","last_became_peered":"2023-09-12T16:07:00.219459+0000","last_unstale":"2023-09-12T16:07:04.262823+0000","last_undegraded":"2023-09-12T16:07:04.262823+0000","last_fullsized":"2023-09-12T16:07:04.262823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:53:29.565994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.617208+0000","last_change":"2023-09-12T16:07:00.246535+0000","last_active":"2023-09-12T16:07:04.617208+0000","last_peered":"2023-09-12T16:07:04.617208+0000","last_clean":"2023-09-12T16:07:04.617208+0000","last_became_active":"2023-09-12T16:07:00.245971+0000","last_became_peered":"2023-09-12T16:07:00.245971+0000","last_unstale":"2023-09-12T16:07:04.617208+0000","last_undegraded":"2023-09-12T16:07:04.617208+0000","last_fullsized":"2023-09-12T16:07:04.617208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:27:58.457682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.270033+0000","last_change":"2023-09-12T16:07:04.623483+0000","last_active":"2023-09-12T16:07:05.270033+0000","last_peered":"2023-09-12T16:07:05.270033+0000","last_clean":"2023-09-12T16:07:05.270033+0000","last_became_active":"2023-09-12T16:07:04.622859+0000","last_became_peered":"2023-09-12T16:07:04.622859+0000","last_unstale":"2023-09-12T16:07:05.270033+0000","last_undegraded":"2023-09-12T16:07:05.270033+0000","last_fullsized":"2023-09-12T16:07:05.270033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:13:05.956723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257878+0000","last_change":"2023-09-12T16:06:59.234835+0000","last_active":"2023-09-12T16:07:04.257878+0000","last_peered":"2023-09-12T16:07:04.257878+0000","last_clean":"2023-09-12T16:07:04.257878+0000","last_became_active":"2023-09-12T16:06:59.234575+0000","last_became_peered":"2023-09-12T16:06:59.234575+0000","last_unstale":"2023-09-12T16:07:04.257878+0000","last_undegraded":"2023-09-12T16:07:04.257878+0000","last_fullsized":"2023-09-12T16:07:04.257878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:53:28.559875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259666+0000","last_change":"2023-09-12T16:07:00.251627+0000","last_active":"2023-09-12T16:07:04.259666+0000","last_peered":"2023-09-12T16:07:04.259666+0000","last_clean":"2023-09-12T16:07:04.259666+0000","last_became_active":"2023-09-12T16:07:00.251369+0000","last_became_peered":"2023-09-12T16:07:00.251369+0000","last_unstale":"2023-09-12T16:07:04.259666+0000","last_undegraded":"2023-09-12T16:07:04.259666+0000","last_fullsized":"2023-09-12T16:07:04.259666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:13:06.582191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872052+0000","last_change":"2023-09-12T16:07:04.280718+0000","last_active":"2023-09-12T16:07:05.872052+0000","last_peered":"2023-09-12T16:07:05.872052+0000","last_clean":"2023-09-12T16:07:05.872052+0000","last_became_active":"2023-09-12T16:07:04.280197+0000","last_became_peered":"2023-09-12T16:07:04.280197+0000","last_unstale":"2023-09-12T16:07:05.872052+0000","last_undegraded":"2023-09-12T16:07:05.872052+0000","last_fullsized":"2023-09-12T16:07:05.872052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:35.376110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259751+0000","last_change":"2023-09-12T16:06:59.231242+0000","last_active":"2023-09-12T16:07:04.259751+0000","last_peered":"2023-09-12T16:07:04.259751+0000","last_clean":"2023-09-12T16:07:04.259751+0000","last_became_active":"2023-09-12T16:06:59.230937+0000","last_became_peered":"2023-09-12T16:06:59.230937+0000","last_unstale":"2023-09-12T16:07:04.259751+0000","last_undegraded":"2023-09-12T16:07:04.259751+0000","last_fullsized":"2023-09-12T16:07:04.259751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:09:05.056699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257787+0000","last_change":"2023-09-12T16:07:00.248417+0000","last_active":"2023-09-12T16:07:04.257787+0000","last_peered":"2023-09-12T16:07:04.257787+0000","last_clean":"2023-09-12T16:07:04.257787+0000","last_became_active":"2023-09-12T16:07:00.247991+0000","last_became_peered":"2023-09-12T16:07:00.247991+0000","last_unstale":"2023-09-12T16:07:04.257787+0000","last_undegraded":"2023-09-12T16:07:04.257787+0000","last_fullsized":"2023-09-12T16:07:04.257787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:46:52.188371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872328+0000","last_change":"2023-09-12T16:07:04.280463+0000","last_active":"2023-09-12T16:07:05.872328+0000","last_peered":"2023-09-12T16:07:05.872328+0000","last_clean":"2023-09-12T16:07:05.872328+0000","last_became_active":"2023-09-12T16:07:04.279988+0000","last_became_peered":"2023-09-12T16:07:04.279988+0000","last_unstale":"2023-09-12T16:07:05.872328+0000","last_undegraded":"2023-09-12T16:07:05.872328+0000","last_fullsized":"2023-09-12T16:07:05.872328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:41:31.041554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616494+0000","last_change":"2023-09-12T16:06:59.242596+0000","last_active":"2023-09-12T16:07:04.616494+0000","last_peered":"2023-09-12T16:07:04.616494+0000","last_clean":"2023-09-12T16:07:04.616494+0000","last_became_active":"2023-09-12T16:06:59.242307+0000","last_became_peered":"2023-09-12T16:06:59.242307+0000","last_unstale":"2023-09-12T16:07:04.616494+0000","last_undegraded":"2023-09-12T16:07:04.616494+0000","last_fullsized":"2023-09-12T16:07:04.616494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:36.576680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261954+0000","last_change":"2023-09-12T16:07:00.246505+0000","last_active":"2023-09-12T16:07:04.261954+0000","last_peered":"2023-09-12T16:07:04.261954+0000","last_clean":"2023-09-12T16:07:04.261954+0000","last_became_active":"2023-09-12T16:07:00.246205+0000","last_became_peered":"2023-09-12T16:07:00.246205+0000","last_unstale":"2023-09-12T16:07:04.261954+0000","last_undegraded":"2023-09-12T16:07:04.261954+0000","last_fullsized":"2023-09-12T16:07:04.261954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:38:37.389648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.873485+0000","last_change":"2023-09-12T16:07:04.280831+0000","last_active":"2023-09-12T16:07:05.873485+0000","last_peered":"2023-09-12T16:07:05.873485+0000","last_clean":"2023-09-12T16:07:05.873485+0000","last_became_active":"2023-09-12T16:07:04.280464+0000","last_became_peered":"2023-09-12T16:07:04.280464+0000","last_unstale":"2023-09-12T16:07:05.873485+0000","last_undegraded":"2023-09-12T16:07:05.873485+0000","last_fullsized":"2023-09-12T16:07:05.873485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:19:21.300414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616218+0000","last_change":"2023-09-12T16:06:59.241342+0000","last_active":"2023-09-12T16:07:04.616218+0000","last_peered":"2023-09-12T16:07:04.616218+0000","last_clean":"2023-09-12T16:07:04.616218+0000","last_became_active":"2023-09-12T16:06:59.241022+0000","last_became_peered":"2023-09-12T16:06:59.241022+0000","last_unstale":"2023-09-12T16:07:04.616218+0000","last_undegraded":"2023-09-12T16:07:04.616218+0000","last_fullsized":"2023-09-12T16:07:04.616218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:06:29.925466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262524+0000","last_change":"2023-09-12T16:07:00.244619+0000","last_active":"2023-09-12T16:07:04.262524+0000","last_peered":"2023-09-12T16:07:04.262524+0000","last_clean":"2023-09-12T16:07:04.262524+0000","last_became_active":"2023-09-12T16:07:00.244333+0000","last_became_peered":"2023-09-12T16:07:00.244333+0000","last_unstale":"2023-09-12T16:07:04.262524+0000","last_undegraded":"2023-09-12T16:07:04.262524+0000","last_fullsized":"2023-09-12T16:07:04.262524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:36:27.893363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.270612+0000","last_change":"2023-09-12T16:07:04.275913+0000","last_active":"2023-09-12T16:07:05.270612+0000","last_peered":"2023-09-12T16:07:05.270612+0000","last_clean":"2023-09-12T16:07:05.270612+0000","last_became_active":"2023-09-12T16:07:04.275487+0000","last_became_peered":"2023-09-12T16:07:04.275487+0000","last_unstale":"2023-09-12T16:07:05.270612+0000","last_undegraded":"2023-09-12T16:07:05.270612+0000","last_fullsized":"2023-09-12T16:07:05.270612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:09:51.094691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257445+0000","last_change":"2023-09-12T16:06:59.239289+0000","last_active":"2023-09-12T16:07:04.257445+0000","last_peered":"2023-09-12T16:07:04.257445+0000","last_clean":"2023-09-12T16:07:04.257445+0000","last_became_active":"2023-09-12T16:06:59.239069+0000","last_became_peered":"2023-09-12T16:06:59.239069+0000","last_unstale":"2023-09-12T16:07:04.257445+0000","last_undegraded":"2023-09-12T16:07:04.257445+0000","last_fullsized":"2023-09-12T16:07:04.257445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:09:08.619023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259404+0000","last_change":"2023-09-12T16:07:00.238894+0000","last_active":"2023-09-12T16:07:04.259404+0000","last_peered":"2023-09-12T16:07:04.259404+0000","last_clean":"2023-09-12T16:07:04.259404+0000","last_became_active":"2023-09-12T16:07:00.238601+0000","last_became_peered":"2023-09-12T16:07:00.238601+0000","last_unstale":"2023-09-12T16:07:04.259404+0000","last_undegraded":"2023-09-12T16:07:04.259404+0000","last_fullsized":"2023-09-12T16:07:04.259404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:34:50.390861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.272943+0000","last_change":"2023-09-12T16:07:04.280769+0000","last_active":"2023-09-12T16:07:05.272943+0000","last_peered":"2023-09-12T16:07:05.272943+0000","last_clean":"2023-09-12T16:07:05.272943+0000","last_became_active":"2023-09-12T16:07:04.280409+0000","last_became_peered":"2023-09-12T16:07:04.280409+0000","last_unstale":"2023-09-12T16:07:05.272943+0000","last_undegraded":"2023-09-12T16:07:05.272943+0000","last_fullsized":"2023-09-12T16:07:05.272943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:41.622238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.264295+0000","last_change":"2023-09-12T16:06:59.239375+0000","last_active":"2023-09-12T16:07:04.264295+0000","last_peered":"2023-09-12T16:07:04.264295+0000","last_clean":"2023-09-12T16:07:04.264295+0000","last_became_active":"2023-09-12T16:06:59.239006+0000","last_became_peered":"2023-09-12T16:06:59.239006+0000","last_unstale":"2023-09-12T16:07:04.264295+0000","last_undegraded":"2023-09-12T16:07:04.264295+0000","last_fullsized":"2023-09-12T16:07:04.264295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:34:49.384742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257984+0000","last_change":"2023-09-12T16:07:00.235720+0000","last_active":"2023-09-12T16:07:04.257984+0000","last_peered":"2023-09-12T16:07:04.257984+0000","last_clean":"2023-09-12T16:07:04.257984+0000","last_became_active":"2023-09-12T16:07:00.235413+0000","last_became_peered":"2023-09-12T16:07:00.235413+0000","last_unstale":"2023-09-12T16:07:04.257984+0000","last_undegraded":"2023-09-12T16:07:04.257984+0000","last_fullsized":"2023-09-12T16:07:04.257984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:58.775088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.273910+0000","last_change":"2023-09-12T16:07:04.285511+0000","last_active":"2023-09-12T16:07:05.273910+0000","last_peered":"2023-09-12T16:07:05.273910+0000","last_clean":"2023-09-12T16:07:05.273910+0000","last_became_active":"2023-09-12T16:07:04.284941+0000","last_became_peered":"2023-09-12T16:07:04.284941+0000","last_unstale":"2023-09-12T16:07:05.273910+0000","last_undegraded":"2023-09-12T16:07:05.273910+0000","last_fullsized":"2023-09-12T16:07:05.273910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:36:31.932803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258379+0000","last_change":"2023-09-12T16:06:59.238189+0000","last_active":"2023-09-12T16:07:04.258379+0000","last_peered":"2023-09-12T16:07:04.258379+0000","last_clean":"2023-09-12T16:07:04.258379+0000","last_became_active":"2023-09-12T16:06:59.237927+0000","last_became_peered":"2023-09-12T16:06:59.237927+0000","last_unstale":"2023-09-12T16:07:04.258379+0000","last_undegraded":"2023-09-12T16:07:04.258379+0000","last_fullsized":"2023-09-12T16:07:04.258379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:05:48.783727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258852+0000","last_change":"2023-09-12T16:07:00.237348+0000","last_active":"2023-09-12T16:07:04.258852+0000","last_peered":"2023-09-12T16:07:04.258852+0000","last_clean":"2023-09-12T16:07:04.258852+0000","last_became_active":"2023-09-12T16:07:00.237064+0000","last_became_peered":"2023-09-12T16:07:00.237064+0000","last_unstale":"2023-09-12T16:07:04.258852+0000","last_undegraded":"2023-09-12T16:07:04.258852+0000","last_fullsized":"2023-09-12T16:07:04.258852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:46:52.188371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.873074+0000","last_change":"2023-09-12T16:07:04.623981+0000","last_active":"2023-09-12T16:07:05.873074+0000","last_peered":"2023-09-12T16:07:05.873074+0000","last_clean":"2023-09-12T16:07:05.873074+0000","last_became_active":"2023-09-12T16:07:04.623554+0000","last_became_peered":"2023-09-12T16:07:04.623554+0000","last_unstale":"2023-09-12T16:07:05.873074+0000","last_undegraded":"2023-09-12T16:07:05.873074+0000","last_fullsized":"2023-09-12T16:07:05.873074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:07:23.213336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262386+0000","last_change":"2023-09-12T16:06:59.231146+0000","last_active":"2023-09-12T16:07:04.262386+0000","last_peered":"2023-09-12T16:07:04.262386+0000","last_clean":"2023-09-12T16:07:04.262386+0000","last_became_active":"2023-09-12T16:06:59.230810+0000","last_became_peered":"2023-09-12T16:06:59.230810+0000","last_unstale":"2023-09-12T16:07:04.262386+0000","last_undegraded":"2023-09-12T16:07:04.262386+0000","last_fullsized":"2023-09-12T16:07:04.262386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:57:34.819094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251603+0000","last_change":"2023-09-12T16:07:00.240426+0000","last_active":"2023-09-12T16:07:04.251603+0000","last_peered":"2023-09-12T16:07:04.251603+0000","last_clean":"2023-09-12T16:07:04.251603+0000","last_became_active":"2023-09-12T16:07:00.240156+0000","last_became_peered":"2023-09-12T16:07:00.240156+0000","last_unstale":"2023-09-12T16:07:04.251603+0000","last_undegraded":"2023-09-12T16:07:04.251603+0000","last_fullsized":"2023-09-12T16:07:04.251603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:08:00.209264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.269958+0000","last_change":"2023-09-12T16:07:04.622076+0000","last_active":"2023-09-12T16:07:05.269958+0000","last_peered":"2023-09-12T16:07:05.269958+0000","last_clean":"2023-09-12T16:07:05.269958+0000","last_became_active":"2023-09-12T16:07:04.621688+0000","last_became_peered":"2023-09-12T16:07:04.621688+0000","last_unstale":"2023-09-12T16:07:05.269958+0000","last_undegraded":"2023-09-12T16:07:05.269958+0000","last_fullsized":"2023-09-12T16:07:05.269958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:14:22.302046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.265441+0000","last_change":"2023-09-12T16:06:59.240104+0000","last_active":"2023-09-12T16:07:04.265441+0000","last_peered":"2023-09-12T16:07:04.265441+0000","last_clean":"2023-09-12T16:07:04.265441+0000","last_became_active":"2023-09-12T16:06:59.239833+0000","last_became_peered":"2023-09-12T16:06:59.239833+0000","last_unstale":"2023-09-12T16:07:04.265441+0000","last_undegraded":"2023-09-12T16:07:04.265441+0000","last_fullsized":"2023-09-12T16:07:04.265441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:44:49.750579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262969+0000","last_change":"2023-09-12T16:07:00.243340+0000","last_active":"2023-09-12T16:07:04.262969+0000","last_peered":"2023-09-12T16:07:04.262969+0000","last_clean":"2023-09-12T16:07:04.262969+0000","last_became_active":"2023-09-12T16:07:00.243070+0000","last_became_peered":"2023-09-12T16:07:00.243070+0000","last_unstale":"2023-09-12T16:07:04.262969+0000","last_undegraded":"2023-09-12T16:07:04.262969+0000","last_fullsized":"2023-09-12T16:07:04.262969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:11:30.292559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.269916+0000","last_change":"2023-09-12T16:07:04.276182+0000","last_active":"2023-09-12T16:07:05.269916+0000","last_peered":"2023-09-12T16:07:05.269916+0000","last_clean":"2023-09-12T16:07:05.269916+0000","last_became_active":"2023-09-12T16:07:04.275578+0000","last_became_peered":"2023-09-12T16:07:04.275578+0000","last_unstale":"2023-09-12T16:07:05.269916+0000","last_undegraded":"2023-09-12T16:07:05.269916+0000","last_fullsized":"2023-09-12T16:07:05.269916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:40.671615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262877+0000","last_change":"2023-09-12T16:06:59.239648+0000","last_active":"2023-09-12T16:07:04.262877+0000","last_peered":"2023-09-12T16:07:04.262877+0000","last_clean":"2023-09-12T16:07:04.262877+0000","last_became_active":"2023-09-12T16:06:59.238170+0000","last_became_peered":"2023-09-12T16:06:59.238170+0000","last_unstale":"2023-09-12T16:07:04.262877+0000","last_undegraded":"2023-09-12T16:07:04.262877+0000","last_fullsized":"2023-09-12T16:07:04.262877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:53:19.847861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258027+0000","last_change":"2023-09-12T16:07:00.248255+0000","last_active":"2023-09-12T16:07:04.258027+0000","last_peered":"2023-09-12T16:07:04.258027+0000","last_clean":"2023-09-12T16:07:04.258027+0000","last_became_active":"2023-09-12T16:07:00.247645+0000","last_became_peered":"2023-09-12T16:07:00.247645+0000","last_unstale":"2023-09-12T16:07:04.258027+0000","last_undegraded":"2023-09-12T16:07:04.258027+0000","last_fullsized":"2023-09-12T16:07:04.258027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:08:00.209264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.873715+0000","last_change":"2023-09-12T16:07:04.272173+0000","last_active":"2023-09-12T16:07:05.873715+0000","last_peered":"2023-09-12T16:07:05.873715+0000","last_clean":"2023-09-12T16:07:05.873715+0000","last_became_active":"2023-09-12T16:07:04.271748+0000","last_became_peered":"2023-09-12T16:07:04.271748+0000","last_unstale":"2023-09-12T16:07:05.873715+0000","last_undegraded":"2023-09-12T16:07:05.873715+0000","last_fullsized":"2023-09-12T16:07:05.873715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:12:22.733151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.252189+0000","last_change":"2023-09-12T16:06:59.230783+0000","last_active":"2023-09-12T16:07:04.252189+0000","last_peered":"2023-09-12T16:07:04.252189+0000","last_clean":"2023-09-12T16:07:04.252189+0000","last_became_active":"2023-09-12T16:06:59.229319+0000","last_became_peered":"2023-09-12T16:06:59.229319+0000","last_unstale":"2023-09-12T16:07:04.252189+0000","last_undegraded":"2023-09-12T16:07:04.252189+0000","last_fullsized":"2023-09-12T16:07:04.252189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:09:05.056699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259921+0000","last_change":"2023-09-12T16:07:00.242166+0000","last_active":"2023-09-12T16:07:04.259921+0000","last_peered":"2023-09-12T16:07:04.259921+0000","last_clean":"2023-09-12T16:07:04.259921+0000","last_became_active":"2023-09-12T16:07:00.241914+0000","last_became_peered":"2023-09-12T16:07:00.241914+0000","last_unstale":"2023-09-12T16:07:04.259921+0000","last_undegraded":"2023-09-12T16:07:04.259921+0000","last_fullsized":"2023-09-12T16:07:04.259921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:09:09.625141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.871620+0000","last_change":"2023-09-12T16:07:04.275261+0000","last_active":"2023-09-12T16:07:05.871620+0000","last_peered":"2023-09-12T16:07:05.871620+0000","last_clean":"2023-09-12T16:07:05.871620+0000","last_became_active":"2023-09-12T16:07:04.274860+0000","last_became_peered":"2023-09-12T16:07:04.274860+0000","last_unstale":"2023-09-12T16:07:05.871620+0000","last_undegraded":"2023-09-12T16:07:05.871620+0000","last_fullsized":"2023-09-12T16:07:05.871620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:29:33.285508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:17.593597+0000","last_change":"2023-09-12T16:06:59.236346+0000","last_active":"2023-09-12T16:07:17.593597+0000","last_peered":"2023-09-12T16:07:17.593597+0000","last_clean":"2023-09-12T16:07:17.593597+0000","last_became_active":"2023-09-12T16:06:59.235979+0000","last_became_peered":"2023-09-12T16:06:59.235979+0000","last_unstale":"2023-09-12T16:07:17.593597+0000","last_undegraded":"2023-09-12T16:07:17.593597+0000","last_fullsized":"2023-09-12T16:07:17.593597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:06:29.925466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.617193+0000","last_change":"2023-09-12T16:07:00.246722+0000","last_active":"2023-09-12T16:07:04.617193+0000","last_peered":"2023-09-12T16:07:04.617193+0000","last_clean":"2023-09-12T16:07:04.617193+0000","last_became_active":"2023-09-12T16:07:00.246249+0000","last_became_peered":"2023-09-12T16:07:00.246249+0000","last_unstale":"2023-09-12T16:07:04.617193+0000","last_undegraded":"2023-09-12T16:07:04.617193+0000","last_fullsized":"2023-09-12T16:07:04.617193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:41:27.002114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872920+0000","last_change":"2023-09-12T16:07:04.624400+0000","last_active":"2023-09-12T16:07:05.872920+0000","last_peered":"2023-09-12T16:07:05.872920+0000","last_clean":"2023-09-12T16:07:05.872920+0000","last_became_active":"2023-09-12T16:07:04.623377+0000","last_became_peered":"2023-09-12T16:07:04.623377+0000","last_unstale":"2023-09-12T16:07:05.872920+0000","last_undegraded":"2023-09-12T16:07:05.872920+0000","last_fullsized":"2023-09-12T16:07:05.872920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:14:22.302046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258240+0000","last_change":"2023-09-12T16:06:59.235950+0000","last_active":"2023-09-12T16:07:04.258240+0000","last_peered":"2023-09-12T16:07:04.258240+0000","last_clean":"2023-09-12T16:07:04.258240+0000","last_became_active":"2023-09-12T16:06:59.235661+0000","last_became_peered":"2023-09-12T16:06:59.235661+0000","last_unstale":"2023-09-12T16:07:04.258240+0000","last_undegraded":"2023-09-12T16:07:04.258240+0000","last_fullsized":"2023-09-12T16:07:04.258240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:54:02.241554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257618+0000","last_change":"2023-09-12T16:07:00.246401+0000","last_active":"2023-09-12T16:07:04.257618+0000","last_peered":"2023-09-12T16:07:04.257618+0000","last_clean":"2023-09-12T16:07:04.257618+0000","last_became_active":"2023-09-12T16:07:00.246137+0000","last_became_peered":"2023-09-12T16:07:00.246137+0000","last_unstale":"2023-09-12T16:07:04.257618+0000","last_undegraded":"2023-09-12T16:07:04.257618+0000","last_fullsized":"2023-09-12T16:07:04.257618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:57:35.825213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.270749+0000","last_change":"2023-09-12T16:07:04.619237+0000","last_active":"2023-09-12T16:07:05.270749+0000","last_peered":"2023-09-12T16:07:05.270749+0000","last_clean":"2023-09-12T16:07:05.270749+0000","last_became_active":"2023-09-12T16:07:04.618830+0000","last_became_peered":"2023-09-12T16:07:04.618830+0000","last_unstale":"2023-09-12T16:07:05.270749+0000","last_undegraded":"2023-09-12T16:07:05.270749+0000","last_fullsized":"2023-09-12T16:07:05.270749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T16:16:29.162777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261955+0000","last_change":"2023-09-12T16:06:59.232841+0000","last_active":"2023-09-12T16:07:04.261955+0000","last_peered":"2023-09-12T16:07:04.261955+0000","last_clean":"2023-09-12T16:07:04.261955+0000","last_became_active":"2023-09-12T16:06:59.232536+0000","last_became_peered":"2023-09-12T16:06:59.232536+0000","last_unstale":"2023-09-12T16:07:04.261955+0000","last_undegraded":"2023-09-12T16:07:04.261955+0000","last_fullsized":"2023-09-12T16:07:04.261955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:46:51.182253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616294+0000","last_change":"2023-09-12T16:07:00.255342+0000","last_active":"2023-09-12T16:07:04.616294+0000","last_peered":"2023-09-12T16:07:04.616294+0000","last_clean":"2023-09-12T16:07:04.616294+0000","last_became_active":"2023-09-12T16:07:00.255010+0000","last_became_peered":"2023-09-12T16:07:00.255010+0000","last_unstale":"2023-09-12T16:07:04.616294+0000","last_undegraded":"2023-09-12T16:07:04.616294+0000","last_fullsized":"2023-09-12T16:07:04.616294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:45:15.386898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.270784+0000","last_change":"2023-09-12T16:07:04.622772+0000","last_active":"2023-09-12T16:07:05.270784+0000","last_peered":"2023-09-12T16:07:05.270784+0000","last_clean":"2023-09-12T16:07:05.270784+0000","last_became_active":"2023-09-12T16:07:04.622386+0000","last_became_peered":"2023-09-12T16:07:04.622386+0000","last_unstale":"2023-09-12T16:07:05.270784+0000","last_undegraded":"2023-09-12T16:07:05.270784+0000","last_fullsized":"2023-09-12T16:07:05.270784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:11:56.544503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.267852+0000","last_change":"2023-09-12T16:06:59.236957+0000","last_active":"2023-09-12T16:07:04.267852+0000","last_peered":"2023-09-12T16:07:04.267852+0000","last_clean":"2023-09-12T16:07:04.267852+0000","last_became_active":"2023-09-12T16:06:59.236675+0000","last_became_peered":"2023-09-12T16:06:59.236675+0000","last_unstale":"2023-09-12T16:07:04.267852+0000","last_undegraded":"2023-09-12T16:07:04.267852+0000","last_fullsized":"2023-09-12T16:07:04.267852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:09:08.619023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.264778+0000","last_change":"2023-09-12T16:07:00.239896+0000","last_active":"2023-09-12T16:07:04.264778+0000","last_peered":"2023-09-12T16:07:04.264778+0000","last_clean":"2023-09-12T16:07:04.264778+0000","last_became_active":"2023-09-12T16:07:00.239523+0000","last_became_peered":"2023-09-12T16:07:00.239523+0000","last_unstale":"2023-09-12T16:07:04.264778+0000","last_undegraded":"2023-09-12T16:07:04.264778+0000","last_fullsized":"2023-09-12T16:07:04.264778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:57:35.825213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872900+0000","last_change":"2023-09-12T16:07:04.276870+0000","last_active":"2023-09-12T16:07:05.872900+0000","last_peered":"2023-09-12T16:07:05.872900+0000","last_clean":"2023-09-12T16:07:05.872900+0000","last_became_active":"2023-09-12T16:07:04.276394+0000","last_became_peered":"2023-09-12T16:07:04.276394+0000","last_unstale":"2023-09-12T16:07:05.872900+0000","last_undegraded":"2023-09-12T16:07:05.872900+0000","last_fullsized":"2023-09-12T16:07:05.872900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:12:22.733151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259472+0000","last_change":"2023-09-12T16:06:59.233084+0000","last_active":"2023-09-12T16:07:04.259472+0000","last_peered":"2023-09-12T16:07:04.259472+0000","last_clean":"2023-09-12T16:07:04.259472+0000","last_became_active":"2023-09-12T16:06:59.232748+0000","last_became_peered":"2023-09-12T16:06:59.232748+0000","last_unstale":"2023-09-12T16:07:04.259472+0000","last_undegraded":"2023-09-12T16:07:04.259472+0000","last_fullsized":"2023-09-12T16:07:04.259472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:55:00.108889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616161+0000","last_change":"2023-09-12T16:07:00.245561+0000","last_active":"2023-09-12T16:07:04.616161+0000","last_peered":"2023-09-12T16:07:04.616161+0000","last_clean":"2023-09-12T16:07:04.616161+0000","last_became_active":"2023-09-12T16:07:00.245297+0000","last_became_peered":"2023-09-12T16:07:00.245297+0000","last_unstale":"2023-09-12T16:07:04.616161+0000","last_undegraded":"2023-09-12T16:07:04.616161+0000","last_fullsized":"2023-09-12T16:07:04.616161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:13:06.582191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872174+0000","last_change":"2023-09-12T16:07:04.276692+0000","last_active":"2023-09-12T16:07:05.872174+0000","last_peered":"2023-09-12T16:07:05.872174+0000","last_clean":"2023-09-12T16:07:05.872174+0000","last_became_active":"2023-09-12T16:07:04.276305+0000","last_became_peered":"2023-09-12T16:07:04.276305+0000","last_unstale":"2023-09-12T16:07:05.872174+0000","last_undegraded":"2023-09-12T16:07:05.872174+0000","last_fullsized":"2023-09-12T16:07:05.872174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:28:02.497121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.260584+0000","last_change":"2023-09-12T16:06:59.228623+0000","last_active":"2023-09-12T16:07:04.260584+0000","last_peered":"2023-09-12T16:07:04.260584+0000","last_clean":"2023-09-12T16:07:04.260584+0000","last_became_active":"2023-09-12T16:06:59.228249+0000","last_became_peered":"2023-09-12T16:06:59.228249+0000","last_unstale":"2023-09-12T16:07:04.260584+0000","last_undegraded":"2023-09-12T16:07:04.260584+0000","last_fullsized":"2023-09-12T16:07:04.260584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:49:47.563558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616629+0000","last_change":"2023-09-12T16:07:00.252935+0000","last_active":"2023-09-12T16:07:04.616629+0000","last_peered":"2023-09-12T16:07:04.616629+0000","last_clean":"2023-09-12T16:07:04.616629+0000","last_became_active":"2023-09-12T16:07:00.252647+0000","last_became_peered":"2023-09-12T16:07:00.252647+0000","last_unstale":"2023-09-12T16:07:04.616629+0000","last_undegraded":"2023-09-12T16:07:04.616629+0000","last_fullsized":"2023-09-12T16:07:04.616629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:31.336670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.871785+0000","last_change":"2023-09-12T16:07:04.270006+0000","last_active":"2023-09-12T16:07:05.871785+0000","last_peered":"2023-09-12T16:07:05.871785+0000","last_clean":"2023-09-12T16:07:05.871785+0000","last_became_active":"2023-09-12T16:07:04.269505+0000","last_became_peered":"2023-09-12T16:07:04.269505+0000","last_unstale":"2023-09-12T16:07:05.871785+0000","last_undegraded":"2023-09-12T16:07:05.871785+0000","last_fullsized":"2023-09-12T16:07:05.871785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:07:23.213336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251774+0000","last_change":"2023-09-12T16:06:59.234205+0000","last_active":"2023-09-12T16:07:04.251774+0000","last_peered":"2023-09-12T16:07:04.251774+0000","last_clean":"2023-09-12T16:07:04.251774+0000","last_became_active":"2023-09-12T16:06:59.233923+0000","last_became_peered":"2023-09-12T16:06:59.233923+0000","last_unstale":"2023-09-12T16:07:04.251774+0000","last_undegraded":"2023-09-12T16:07:04.251774+0000","last_fullsized":"2023-09-12T16:07:04.251774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:09:08.619023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262579+0000","last_change":"2023-09-12T16:07:00.242588+0000","last_active":"2023-09-12T16:07:04.262579+0000","last_peered":"2023-09-12T16:07:04.262579+0000","last_clean":"2023-09-12T16:07:04.262579+0000","last_became_active":"2023-09-12T16:07:00.242329+0000","last_became_peered":"2023-09-12T16:07:00.242329+0000","last_unstale":"2023-09-12T16:07:04.262579+0000","last_undegraded":"2023-09-12T16:07:04.262579+0000","last_fullsized":"2023-09-12T16:07:04.262579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:45:15.386898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.871795+0000","last_change":"2023-09-12T16:07:04.277502+0000","last_active":"2023-09-12T16:07:05.871795+0000","last_peered":"2023-09-12T16:07:05.871795+0000","last_clean":"2023-09-12T16:07:05.871795+0000","last_became_active":"2023-09-12T16:07:04.277124+0000","last_became_peered":"2023-09-12T16:07:04.277124+0000","last_unstale":"2023-09-12T16:07:05.871795+0000","last_undegraded":"2023-09-12T16:07:05.871795+0000","last_fullsized":"2023-09-12T16:07:05.871795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:08:08.942117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261852+0000","last_change":"2023-09-12T16:06:59.230496+0000","last_active":"2023-09-12T16:07:04.261852+0000","last_peered":"2023-09-12T16:07:04.261852+0000","last_clean":"2023-09-12T16:07:04.261852+0000","last_became_active":"2023-09-12T16:06:59.229861+0000","last_became_peered":"2023-09-12T16:06:59.229861+0000","last_unstale":"2023-09-12T16:07:04.261852+0000","last_undegraded":"2023-09-12T16:07:04.261852+0000","last_fullsized":"2023-09-12T16:07:04.261852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:36.576680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259685+0000","last_change":"2023-09-12T16:07:00.238162+0000","last_active":"2023-09-12T16:07:04.259685+0000","last_peered":"2023-09-12T16:07:04.259685+0000","last_clean":"2023-09-12T16:07:04.259685+0000","last_became_active":"2023-09-12T16:07:00.237811+0000","last_became_peered":"2023-09-12T16:07:00.237811+0000","last_unstale":"2023-09-12T16:07:04.259685+0000","last_undegraded":"2023-09-12T16:07:04.259685+0000","last_fullsized":"2023-09-12T16:07:04.259685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:53:29.565994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872588+0000","last_change":"2023-09-12T16:07:04.277513+0000","last_active":"2023-09-12T16:07:05.872588+0000","last_peered":"2023-09-12T16:07:05.872588+0000","last_clean":"2023-09-12T16:07:05.872588+0000","last_became_active":"2023-09-12T16:07:04.277127+0000","last_became_peered":"2023-09-12T16:07:04.277127+0000","last_unstale":"2023-09-12T16:07:05.872588+0000","last_undegraded":"2023-09-12T16:07:05.872588+0000","last_fullsized":"2023-09-12T16:07:05.872588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:35:14.402111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251417+0000","last_change":"2023-09-12T16:07:00.241609+0000","last_active":"2023-09-12T16:07:04.251417+0000","last_peered":"2023-09-12T16:07:04.251417+0000","last_clean":"2023-09-12T16:07:04.251417+0000","last_became_active":"2023-09-12T16:07:00.241320+0000","last_became_peered":"2023-09-12T16:07:00.241320+0000","last_unstale":"2023-09-12T16:07:04.251417+0000","last_undegraded":"2023-09-12T16:07:04.251417+0000","last_fullsized":"2023-09-12T16:07:04.251417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:58:37.106438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259080+0000","last_change":"2023-09-12T16:06:59.234032+0000","last_active":"2023-09-12T16:07:04.259080+0000","last_peered":"2023-09-12T16:07:04.259080+0000","last_clean":"2023-09-12T16:07:04.259080+0000","last_became_active":"2023-09-12T16:06:59.233608+0000","last_became_peered":"2023-09-12T16:06:59.233608+0000","last_unstale":"2023-09-12T16:07:04.259080+0000","last_undegraded":"2023-09-12T16:07:04.259080+0000","last_fullsized":"2023-09-12T16:07:04.259080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:02:44.404892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.273604+0000","last_change":"2023-09-12T16:07:04.619647+0000","last_active":"2023-09-12T16:07:05.273604+0000","last_peered":"2023-09-12T16:07:05.273604+0000","last_clean":"2023-09-12T16:07:05.273604+0000","last_became_active":"2023-09-12T16:07:04.618758+0000","last_became_peered":"2023-09-12T16:07:04.618758+0000","last_unstale":"2023-09-12T16:07:05.273604+0000","last_undegraded":"2023-09-12T16:07:05.273604+0000","last_fullsized":"2023-09-12T16:07:05.273604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:11:34.331999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257837+0000","last_change":"2023-09-12T16:07:00.247265+0000","last_active":"2023-09-12T16:07:04.257837+0000","last_peered":"2023-09-12T16:07:04.257837+0000","last_clean":"2023-09-12T16:07:04.257837+0000","last_became_active":"2023-09-12T16:07:00.246967+0000","last_became_peered":"2023-09-12T16:07:00.246967+0000","last_unstale":"2023-09-12T16:07:04.257837+0000","last_undegraded":"2023-09-12T16:07:04.257837+0000","last_fullsized":"2023-09-12T16:07:04.257837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:58:37.106438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261947+0000","last_change":"2023-09-12T16:06:59.232424+0000","last_active":"2023-09-12T16:07:04.261947+0000","last_peered":"2023-09-12T16:07:04.261947+0000","last_clean":"2023-09-12T16:07:04.261947+0000","last_became_active":"2023-09-12T16:06:59.232084+0000","last_became_peered":"2023-09-12T16:06:59.232084+0000","last_unstale":"2023-09-12T16:07:04.261947+0000","last_undegraded":"2023-09-12T16:07:04.261947+0000","last_fullsized":"2023-09-12T16:07:04.261947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:55:22.355102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.615901+0000","last_change":"2023-09-12T16:06:50.214088+0000","last_active":"2023-09-12T16:07:04.615901+0000","last_peered":"2023-09-12T16:07:04.615901+0000","last_clean":"2023-09-12T16:07:04.615901+0000","last_became_active":"2023-09-12T16:06:50.213622+0000","last_became_peered":"2023-09-12T16:06:50.213622+0000","last_unstale":"2023-09-12T16:07:04.615901+0000","last_undegraded":"2023-09-12T16:07:04.615901+0000","last_fullsized":"2023-09-12T16:07:04.615901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:49.077619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:49.077619+0000","last_clean_scrub_stamp":"2023-09-12T16:06:49.077619+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:18:36.870572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.873037+0000","last_change":"2023-09-12T16:07:04.619724+0000","last_active":"2023-09-12T16:07:05.873037+0000","last_peered":"2023-09-12T16:07:05.873037+0000","last_clean":"2023-09-12T16:07:05.873037+0000","last_became_active":"2023-09-12T16:07:04.619332+0000","last_became_peered":"2023-09-12T16:07:04.619332+0000","last_unstale":"2023-09-12T16:07:05.873037+0000","last_undegraded":"2023-09-12T16:07:05.873037+0000","last_fullsized":"2023-09-12T16:07:05.873037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:29:33.285508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257135+0000","last_change":"2023-09-12T16:07:00.235625+0000","last_active":"2023-09-12T16:07:04.257135+0000","last_peered":"2023-09-12T16:07:04.257135+0000","last_clean":"2023-09-12T16:07:04.257135+0000","last_became_active":"2023-09-12T16:07:00.235331+0000","last_became_peered":"2023-09-12T16:07:00.235331+0000","last_unstale":"2023-09-12T16:07:04.257135+0000","last_undegraded":"2023-09-12T16:07:04.257135+0000","last_fullsized":"2023-09-12T16:07:04.257135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:05:49.789846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616019+0000","last_change":"2023-09-12T16:06:59.235516+0000","last_active":"2023-09-12T16:07:04.616019+0000","last_peered":"2023-09-12T16:07:04.616019+0000","last_clean":"2023-09-12T16:07:04.616019+0000","last_became_active":"2023-09-12T16:06:59.235199+0000","last_became_peered":"2023-09-12T16:06:59.235199+0000","last_unstale":"2023-09-12T16:07:04.616019+0000","last_undegraded":"2023-09-12T16:07:04.616019+0000","last_fullsized":"2023-09-12T16:07:04.616019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:55:00.108889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872606+0000","last_change":"2023-09-12T16:07:04.619215+0000","last_active":"2023-09-12T16:07:05.872606+0000","last_peered":"2023-09-12T16:07:05.872606+0000","last_clean":"2023-09-12T16:07:05.872606+0000","last_became_active":"2023-09-12T16:07:04.618728+0000","last_became_peered":"2023-09-12T16:07:04.618728+0000","last_unstale":"2023-09-12T16:07:05.872606+0000","last_undegraded":"2023-09-12T16:07:05.872606+0000","last_fullsized":"2023-09-12T16:07:05.872606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:19:21.300414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616251+0000","last_change":"2023-09-12T16:06:59.243165+0000","last_active":"2023-09-12T16:07:04.616251+0000","last_peered":"2023-09-12T16:07:04.616251+0000","last_clean":"2023-09-12T16:07:04.616251+0000","last_became_active":"2023-09-12T16:06:59.242849+0000","last_became_peered":"2023-09-12T16:06:59.242849+0000","last_unstale":"2023-09-12T16:07:04.616251+0000","last_undegraded":"2023-09-12T16:07:04.616251+0000","last_fullsized":"2023-09-12T16:07:04.616251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:55:22.355102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251893+0000","last_change":"2023-09-12T16:07:00.246431+0000","last_active":"2023-09-12T16:07:04.251893+0000","last_peered":"2023-09-12T16:07:04.251893+0000","last_clean":"2023-09-12T16:07:04.251893+0000","last_became_active":"2023-09-12T16:07:00.246167+0000","last_became_peered":"2023-09-12T16:07:00.246167+0000","last_unstale":"2023-09-12T16:07:04.251893+0000","last_undegraded":"2023-09-12T16:07:04.251893+0000","last_fullsized":"2023-09-12T16:07:04.251893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:14:21.195478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.269732+0000","last_change":"2023-09-12T16:07:04.619600+0000","last_active":"2023-09-12T16:07:05.269732+0000","last_peered":"2023-09-12T16:07:05.269732+0000","last_clean":"2023-09-12T16:07:05.269732+0000","last_became_active":"2023-09-12T16:07:04.619212+0000","last_became_peered":"2023-09-12T16:07:04.619212+0000","last_unstale":"2023-09-12T16:07:05.269732+0000","last_undegraded":"2023-09-12T16:07:05.269732+0000","last_fullsized":"2023-09-12T16:07:05.269732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:35:14.402111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.200180+0000","last_change":"2023-09-12T16:06:59.238333+0000","last_active":"2023-09-12T16:07:05.200180+0000","last_peered":"2023-09-12T16:07:05.200180+0000","last_clean":"2023-09-12T16:07:05.200180+0000","last_became_active":"2023-09-12T16:06:59.237813+0000","last_became_peered":"2023-09-12T16:06:59.237813+0000","last_unstale":"2023-09-12T16:07:05.200180+0000","last_undegraded":"2023-09-12T16:07:05.200180+0000","last_fullsized":"2023-09-12T16:07:05.200180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:05:48.783727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261856+0000","last_change":"2023-09-12T16:07:00.243068+0000","last_active":"2023-09-12T16:07:04.261856+0000","last_peered":"2023-09-12T16:07:04.261856+0000","last_clean":"2023-09-12T16:07:04.261856+0000","last_became_active":"2023-09-12T16:07:00.242602+0000","last_became_peered":"2023-09-12T16:07:00.242602+0000","last_unstale":"2023-09-12T16:07:04.261856+0000","last_undegraded":"2023-09-12T16:07:04.261856+0000","last_fullsized":"2023-09-12T16:07:04.261856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:31.336670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872330+0000","last_change":"2023-09-12T16:07:04.619568+0000","last_active":"2023-09-12T16:07:05.872330+0000","last_peered":"2023-09-12T16:07:05.872330+0000","last_clean":"2023-09-12T16:07:05.872330+0000","last_became_active":"2023-09-12T16:07:04.619080+0000","last_became_peered":"2023-09-12T16:07:04.619080+0000","last_unstale":"2023-09-12T16:07:05.872330+0000","last_undegraded":"2023-09-12T16:07:05.872330+0000","last_fullsized":"2023-09-12T16:07:05.872330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:45:19.426338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.265308+0000","last_change":"2023-09-12T16:06:59.239587+0000","last_active":"2023-09-12T16:07:04.265308+0000","last_peered":"2023-09-12T16:07:04.265308+0000","last_clean":"2023-09-12T16:07:04.265308+0000","last_became_active":"2023-09-12T16:06:59.239216+0000","last_became_peered":"2023-09-12T16:06:59.239216+0000","last_unstale":"2023-09-12T16:07:04.265308+0000","last_undegraded":"2023-09-12T16:07:04.265308+0000","last_fullsized":"2023-09-12T16:07:04.265308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:53:28.559875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257463+0000","last_change":"2023-09-12T16:07:00.240585+0000","last_active":"2023-09-12T16:07:04.257463+0000","last_peered":"2023-09-12T16:07:04.257463+0000","last_clean":"2023-09-12T16:07:04.257463+0000","last_became_active":"2023-09-12T16:07:00.240323+0000","last_became_peered":"2023-09-12T16:07:00.240323+0000","last_unstale":"2023-09-12T16:07:04.257463+0000","last_undegraded":"2023-09-12T16:07:04.257463+0000","last_fullsized":"2023-09-12T16:07:04.257463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:55:23.361221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872379+0000","last_change":"2023-09-12T16:07:04.281034+0000","last_active":"2023-09-12T16:07:05.872379+0000","last_peered":"2023-09-12T16:07:05.872379+0000","last_clean":"2023-09-12T16:07:05.872379+0000","last_became_active":"2023-09-12T16:07:04.280525+0000","last_became_peered":"2023-09-12T16:07:04.280525+0000","last_unstale":"2023-09-12T16:07:05.872379+0000","last_undegraded":"2023-09-12T16:07:05.872379+0000","last_fullsized":"2023-09-12T16:07:05.872379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:42:29.239901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.615895+0000","last_change":"2023-09-12T16:06:59.236011+0000","last_active":"2023-09-12T16:07:04.615895+0000","last_peered":"2023-09-12T16:07:04.615895+0000","last_clean":"2023-09-12T16:07:04.615895+0000","last_became_active":"2023-09-12T16:06:59.235750+0000","last_became_peered":"2023-09-12T16:06:59.235750+0000","last_unstale":"2023-09-12T16:07:04.615895+0000","last_undegraded":"2023-09-12T16:07:04.615895+0000","last_fullsized":"2023-09-12T16:07:04.615895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:44:49.750579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259787+0000","last_change":"2023-09-12T16:07:00.232052+0000","last_active":"2023-09-12T16:07:04.259787+0000","last_peered":"2023-09-12T16:07:04.259787+0000","last_clean":"2023-09-12T16:07:04.259787+0000","last_became_active":"2023-09-12T16:07:00.231763+0000","last_became_peered":"2023-09-12T16:07:00.231763+0000","last_unstale":"2023-09-12T16:07:04.259787+0000","last_undegraded":"2023-09-12T16:07:04.259787+0000","last_fullsized":"2023-09-12T16:07:04.259787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:06:30.931584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872351+0000","last_change":"2023-09-12T16:07:04.619604+0000","last_active":"2023-09-12T16:07:05.872351+0000","last_peered":"2023-09-12T16:07:05.872351+0000","last_clean":"2023-09-12T16:07:05.872351+0000","last_became_active":"2023-09-12T16:07:04.619196+0000","last_became_peered":"2023-09-12T16:07:04.619196+0000","last_unstale":"2023-09-12T16:07:05.872351+0000","last_undegraded":"2023-09-12T16:07:05.872351+0000","last_fullsized":"2023-09-12T16:07:05.872351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:27:51.938138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251490+0000","last_change":"2023-09-12T16:06:59.235568+0000","last_active":"2023-09-12T16:07:04.251490+0000","last_peered":"2023-09-12T16:07:04.251490+0000","last_clean":"2023-09-12T16:07:04.251490+0000","last_became_active":"2023-09-12T16:06:59.235300+0000","last_became_peered":"2023-09-12T16:06:59.235300+0000","last_unstale":"2023-09-12T16:07:04.251490+0000","last_undegraded":"2023-09-12T16:07:04.251490+0000","last_fullsized":"2023-09-12T16:07:04.251490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:34:49.384742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258950+0000","last_change":"2023-09-12T16:07:00.244717+0000","last_active":"2023-09-12T16:07:04.258950+0000","last_peered":"2023-09-12T16:07:04.258950+0000","last_clean":"2023-09-12T16:07:04.258950+0000","last_became_active":"2023-09-12T16:07:00.244448+0000","last_became_peered":"2023-09-12T16:07:00.244448+0000","last_unstale":"2023-09-12T16:07:04.258950+0000","last_undegraded":"2023-09-12T16:07:04.258950+0000","last_fullsized":"2023-09-12T16:07:04.258950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:37.582798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872677+0000","last_change":"2023-09-12T16:07:04.280641+0000","last_active":"2023-09-12T16:07:05.872677+0000","last_peered":"2023-09-12T16:07:05.872677+0000","last_clean":"2023-09-12T16:07:05.872677+0000","last_became_active":"2023-09-12T16:07:04.280192+0000","last_became_peered":"2023-09-12T16:07:04.280192+0000","last_unstale":"2023-09-12T16:07:05.872677+0000","last_undegraded":"2023-09-12T16:07:05.872677+0000","last_fullsized":"2023-09-12T16:07:05.872677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:36:31.932803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.252402+0000","last_change":"2023-09-12T16:06:59.226827+0000","last_active":"2023-09-12T16:07:04.252402+0000","last_peered":"2023-09-12T16:07:04.252402+0000","last_clean":"2023-09-12T16:07:04.252402+0000","last_became_active":"2023-09-12T16:06:59.226354+0000","last_became_peered":"2023-09-12T16:06:59.226354+0000","last_unstale":"2023-09-12T16:07:04.252402+0000","last_undegraded":"2023-09-12T16:07:04.252402+0000","last_fullsized":"2023-09-12T16:07:04.252402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:57:34.819094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257528+0000","last_change":"2023-09-12T16:07:00.243653+0000","last_active":"2023-09-12T16:07:04.257528+0000","last_peered":"2023-09-12T16:07:04.257528+0000","last_clean":"2023-09-12T16:07:04.257528+0000","last_became_active":"2023-09-12T16:07:00.243093+0000","last_became_peered":"2023-09-12T16:07:00.243093+0000","last_unstale":"2023-09-12T16:07:04.257528+0000","last_undegraded":"2023-09-12T16:07:04.257528+0000","last_fullsized":"2023-09-12T16:07:04.257528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:58.775088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872439+0000","last_change":"2023-09-12T16:07:04.274627+0000","last_active":"2023-09-12T16:07:05.872439+0000","last_peered":"2023-09-12T16:07:05.872439+0000","last_clean":"2023-09-12T16:07:05.872439+0000","last_became_active":"2023-09-12T16:07:04.274161+0000","last_became_peered":"2023-09-12T16:07:04.274161+0000","last_unstale":"2023-09-12T16:07:05.872439+0000","last_undegraded":"2023-09-12T16:07:05.872439+0000","last_fullsized":"2023-09-12T16:07:05.872439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:11:34.331999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616307+0000","last_change":"2023-09-12T16:06:59.238849+0000","last_active":"2023-09-12T16:07:04.616307+0000","last_peered":"2023-09-12T16:07:04.616307+0000","last_clean":"2023-09-12T16:07:04.616307+0000","last_became_active":"2023-09-12T16:06:59.238511+0000","last_became_peered":"2023-09-12T16:06:59.238511+0000","last_unstale":"2023-09-12T16:07:04.616307+0000","last_undegraded":"2023-09-12T16:07:04.616307+0000","last_fullsized":"2023-09-12T16:07:04.616307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:09:05.056699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.266098+0000","last_change":"2023-09-12T16:07:00.236595+0000","last_active":"2023-09-12T16:07:04.266098+0000","last_peered":"2023-09-12T16:07:04.266098+0000","last_clean":"2023-09-12T16:07:04.266098+0000","last_became_active":"2023-09-12T16:07:00.236274+0000","last_became_peered":"2023-09-12T16:07:00.236274+0000","last_unstale":"2023-09-12T16:07:04.266098+0000","last_undegraded":"2023-09-12T16:07:04.266098+0000","last_fullsized":"2023-09-12T16:07:04.266098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:55:23.361221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.273966+0000","last_change":"2023-09-12T16:07:04.619296+0000","last_active":"2023-09-12T16:07:05.273966+0000","last_peered":"2023-09-12T16:07:05.273966+0000","last_clean":"2023-09-12T16:07:05.273966+0000","last_became_active":"2023-09-12T16:07:04.618720+0000","last_became_peered":"2023-09-12T16:07:04.618720+0000","last_unstale":"2023-09-12T16:07:05.273966+0000","last_undegraded":"2023-09-12T16:07:05.273966+0000","last_fullsized":"2023-09-12T16:07:05.273966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:45:19.426338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261342+0000","last_change":"2023-09-12T16:06:59.238054+0000","last_active":"2023-09-12T16:07:04.261342+0000","last_peered":"2023-09-12T16:07:04.261342+0000","last_clean":"2023-09-12T16:07:04.261342+0000","last_became_active":"2023-09-12T16:06:59.237786+0000","last_became_peered":"2023-09-12T16:06:59.237786+0000","last_unstale":"2023-09-12T16:07:04.261342+0000","last_undegraded":"2023-09-12T16:07:04.261342+0000","last_fullsized":"2023-09-12T16:07:04.261342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:49:47.563558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616530+0000","last_change":"2023-09-12T16:07:00.249587+0000","last_active":"2023-09-12T16:07:04.616530+0000","last_peered":"2023-09-12T16:07:04.616530+0000","last_clean":"2023-09-12T16:07:04.616530+0000","last_became_active":"2023-09-12T16:07:00.249288+0000","last_became_peered":"2023-09-12T16:07:00.249288+0000","last_unstale":"2023-09-12T16:07:04.616530+0000","last_undegraded":"2023-09-12T16:07:04.616530+0000","last_fullsized":"2023-09-12T16:07:04.616530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:36:27.893363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872455+0000","last_change":"2023-09-12T16:07:04.269929+0000","last_active":"2023-09-12T16:07:05.872455+0000","last_peered":"2023-09-12T16:07:05.872455+0000","last_clean":"2023-09-12T16:07:05.872455+0000","last_became_active":"2023-09-12T16:07:04.269553+0000","last_became_peered":"2023-09-12T16:07:04.269553+0000","last_unstale":"2023-09-12T16:07:05.872455+0000","last_undegraded":"2023-09-12T16:07:05.872455+0000","last_fullsized":"2023-09-12T16:07:05.872455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:42:29.239901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.252147+0000","last_change":"2023-09-12T16:06:59.222437+0000","last_active":"2023-09-12T16:07:04.252147+0000","last_peered":"2023-09-12T16:07:04.252147+0000","last_clean":"2023-09-12T16:07:04.252147+0000","last_became_active":"2023-09-12T16:06:59.222099+0000","last_became_peered":"2023-09-12T16:06:59.222099+0000","last_unstale":"2023-09-12T16:07:04.252147+0000","last_undegraded":"2023-09-12T16:07:04.252147+0000","last_fullsized":"2023-09-12T16:07:04.252147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:44:49.750579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262052+0000","last_change":"2023-09-12T16:07:00.246299+0000","last_active":"2023-09-12T16:07:04.262052+0000","last_peered":"2023-09-12T16:07:04.262052+0000","last_clean":"2023-09-12T16:07:04.262052+0000","last_became_active":"2023-09-12T16:07:00.245786+0000","last_became_peered":"2023-09-12T16:07:00.245786+0000","last_unstale":"2023-09-12T16:07:04.262052+0000","last_undegraded":"2023-09-12T16:07:04.262052+0000","last_fullsized":"2023-09-12T16:07:04.262052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:27:58.457682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.871863+0000","last_change":"2023-09-12T16:07:04.619216+0000","last_active":"2023-09-12T16:07:05.871863+0000","last_peered":"2023-09-12T16:07:05.871863+0000","last_clean":"2023-09-12T16:07:05.871863+0000","last_became_active":"2023-09-12T16:07:04.618772+0000","last_became_peered":"2023-09-12T16:07:04.618772+0000","last_unstale":"2023-09-12T16:07:05.871863+0000","last_undegraded":"2023-09-12T16:07:05.871863+0000","last_fullsized":"2023-09-12T16:07:05.871863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:40.671615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262737+0000","last_change":"2023-09-12T16:06:59.237315+0000","last_active":"2023-09-12T16:07:04.262737+0000","last_peered":"2023-09-12T16:07:04.262737+0000","last_clean":"2023-09-12T16:07:04.262737+0000","last_became_active":"2023-09-12T16:06:59.237042+0000","last_became_peered":"2023-09-12T16:06:59.237042+0000","last_unstale":"2023-09-12T16:07:04.262737+0000","last_undegraded":"2023-09-12T16:07:04.262737+0000","last_fullsized":"2023-09-12T16:07:04.262737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:34:01.502780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.617354+0000","last_change":"2023-09-12T16:07:00.252987+0000","last_active":"2023-09-12T16:07:04.617354+0000","last_peered":"2023-09-12T16:07:04.617354+0000","last_clean":"2023-09-12T16:07:04.617354+0000","last_became_active":"2023-09-12T16:07:00.252715+0000","last_became_peered":"2023-09-12T16:07:00.252715+0000","last_unstale":"2023-09-12T16:07:04.617354+0000","last_undegraded":"2023-09-12T16:07:04.617354+0000","last_fullsized":"2023-09-12T16:07:04.617354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:12:18.693711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.264873+0000","last_change":"2023-09-12T16:07:00.239692+0000","last_active":"2023-09-12T16:07:04.264873+0000","last_peered":"2023-09-12T16:07:04.264873+0000","last_clean":"2023-09-12T16:07:04.264873+0000","last_became_active":"2023-09-12T16:07:00.239382+0000","last_became_peered":"2023-09-12T16:07:00.239382+0000","last_unstale":"2023-09-12T16:07:04.264873+0000","last_undegraded":"2023-09-12T16:07:04.264873+0000","last_fullsized":"2023-09-12T16:07:04.264873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:58:37.106438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258921+0000","last_change":"2023-09-12T16:07:00.243624+0000","last_active":"2023-09-12T16:07:04.258921+0000","last_peered":"2023-09-12T16:07:04.258921+0000","last_clean":"2023-09-12T16:07:04.258921+0000","last_became_active":"2023-09-12T16:07:00.243363+0000","last_became_peered":"2023-09-12T16:07:00.243363+0000","last_unstale":"2023-09-12T16:07:04.258921+0000","last_undegraded":"2023-09-12T16:07:04.258921+0000","last_fullsized":"2023-09-12T16:07:04.258921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:06:30.931584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262048+0000","last_change":"2023-09-12T16:07:00.247135+0000","last_active":"2023-09-12T16:07:04.262048+0000","last_peered":"2023-09-12T16:07:04.262048+0000","last_clean":"2023-09-12T16:07:04.262048+0000","last_became_active":"2023-09-12T16:07:00.245531+0000","last_became_peered":"2023-09-12T16:07:00.245531+0000","last_unstale":"2023-09-12T16:07:04.262048+0000","last_undegraded":"2023-09-12T16:07:04.262048+0000","last_fullsized":"2023-09-12T16:07:04.262048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:12:18.693711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258068+0000","last_change":"2023-09-12T16:07:00.235877+0000","last_active":"2023-09-12T16:07:04.258068+0000","last_peered":"2023-09-12T16:07:04.258068+0000","last_clean":"2023-09-12T16:07:04.258068+0000","last_became_active":"2023-09-12T16:07:00.235463+0000","last_became_peered":"2023-09-12T16:07:00.235463+0000","last_unstale":"2023-09-12T16:07:04.258068+0000","last_undegraded":"2023-09-12T16:07:04.258068+0000","last_fullsized":"2023-09-12T16:07:04.258068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:14:21.195478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261764+0000","last_change":"2023-09-12T16:07:00.239178+0000","last_active":"2023-09-12T16:07:04.261764+0000","last_peered":"2023-09-12T16:07:04.261764+0000","last_clean":"2023-09-12T16:07:04.261764+0000","last_became_active":"2023-09-12T16:07:00.237641+0000","last_became_peered":"2023-09-12T16:07:00.237641+0000","last_unstale":"2023-09-12T16:07:04.261764+0000","last_undegraded":"2023-09-12T16:07:04.261764+0000","last_fullsized":"2023-09-12T16:07:04.261764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:08:00.209264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.252078+0000","last_change":"2023-09-12T16:07:00.240120+0000","last_active":"2023-09-12T16:07:04.252078+0000","last_peered":"2023-09-12T16:07:04.252078+0000","last_clean":"2023-09-12T16:07:04.252078+0000","last_became_active":"2023-09-12T16:07:00.239826+0000","last_became_peered":"2023-09-12T16:07:00.239826+0000","last_unstale":"2023-09-12T16:07:04.252078+0000","last_undegraded":"2023-09-12T16:07:04.252078+0000","last_fullsized":"2023-09-12T16:07:04.252078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:58.775088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.266947+0000","last_change":"2023-09-12T16:07:00.242920+0000","last_active":"2023-09-12T16:07:04.266947+0000","last_peered":"2023-09-12T16:07:04.266947+0000","last_clean":"2023-09-12T16:07:04.266947+0000","last_became_active":"2023-09-12T16:07:00.242640+0000","last_became_peered":"2023-09-12T16:07:00.242640+0000","last_unstale":"2023-09-12T16:07:04.266947+0000","last_undegraded":"2023-09-12T16:07:04.266947+0000","last_fullsized":"2023-09-12T16:07:04.266947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:46:52.188371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261946+0000","last_change":"2023-09-12T16:07:00.236628+0000","last_active":"2023-09-12T16:07:04.261946+0000","last_peered":"2023-09-12T16:07:04.261946+0000","last_clean":"2023-09-12T16:07:04.261946+0000","last_became_active":"2023-09-12T16:07:00.236285+0000","last_became_peered":"2023-09-12T16:07:00.236285+0000","last_unstale":"2023-09-12T16:07:04.261946+0000","last_undegraded":"2023-09-12T16:07:04.261946+0000","last_fullsized":"2023-09-12T16:07:04.261946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:38:37.389648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262483+0000","last_change":"2023-09-12T16:07:00.242101+0000","last_active":"2023-09-12T16:07:04.262483+0000","last_peered":"2023-09-12T16:07:04.262483+0000","last_clean":"2023-09-12T16:07:04.262483+0000","last_became_active":"2023-09-12T16:07:00.241617+0000","last_became_peered":"2023-09-12T16:07:00.241617+0000","last_unstale":"2023-09-12T16:07:04.262483+0000","last_undegraded":"2023-09-12T16:07:04.262483+0000","last_fullsized":"2023-09-12T16:07:04.262483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:13:06.582191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258456+0000","last_change":"2023-09-12T16:07:00.236987+0000","last_active":"2023-09-12T16:07:04.258456+0000","last_peered":"2023-09-12T16:07:04.258456+0000","last_clean":"2023-09-12T16:07:04.258456+0000","last_became_active":"2023-09-12T16:07:00.236642+0000","last_became_peered":"2023-09-12T16:07:00.236642+0000","last_unstale":"2023-09-12T16:07:04.258456+0000","last_undegraded":"2023-09-12T16:07:04.258456+0000","last_fullsized":"2023-09-12T16:07:04.258456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:53:20.853979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262134+0000","last_change":"2023-09-12T16:07:00.246004+0000","last_active":"2023-09-12T16:07:04.262134+0000","last_peered":"2023-09-12T16:07:04.262134+0000","last_clean":"2023-09-12T16:07:04.262134+0000","last_became_active":"2023-09-12T16:07:00.245625+0000","last_became_peered":"2023-09-12T16:07:00.245625+0000","last_unstale":"2023-09-12T16:07:04.262134+0000","last_undegraded":"2023-09-12T16:07:04.262134+0000","last_fullsized":"2023-09-12T16:07:04.262134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:19:17.260974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258148+0000","last_change":"2023-09-12T16:07:00.246340+0000","last_active":"2023-09-12T16:07:04.258148+0000","last_peered":"2023-09-12T16:07:04.258148+0000","last_clean":"2023-09-12T16:07:04.258148+0000","last_became_active":"2023-09-12T16:07:00.246060+0000","last_became_peered":"2023-09-12T16:07:00.246060+0000","last_unstale":"2023-09-12T16:07:04.258148+0000","last_undegraded":"2023-09-12T16:07:04.258148+0000","last_fullsized":"2023-09-12T16:07:04.258148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:58:37.106438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.266833+0000","last_change":"2023-09-12T16:07:00.238100+0000","last_active":"2023-09-12T16:07:04.266833+0000","last_peered":"2023-09-12T16:07:04.266833+0000","last_clean":"2023-09-12T16:07:04.266833+0000","last_became_active":"2023-09-12T16:07:00.237802+0000","last_became_peered":"2023-09-12T16:07:00.237802+0000","last_unstale":"2023-09-12T16:07:04.266833+0000","last_undegraded":"2023-09-12T16:07:04.266833+0000","last_fullsized":"2023-09-12T16:07:04.266833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:53:20.853979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":689767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-12T16:07:28.870 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-12T16:07:29.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.103+0000 7fd8c1dff700 1 -- 172.21.15.112:0/1955228631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8bc0cdfb0 msgr2=0x7fd8bc0d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:29.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.103+0000 7fd8c1dff700 1 --2- 172.21.15.112:0/1955228631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8bc0cdfb0 0x7fd8bc0d03c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0cf400 tx=0x7fd8b0009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:29.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.103+0000 7fd8c1dff700 1 -- 172.21.15.112:0/1955228631 shutdown_connections 2023-09-12T16:07:29.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.103+0000 7fd8c1dff700 1 --2- 172.21.15.112:0/1955228631 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8bc0b28f0 0x7fd8bc0c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:29.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.103+0000 7fd8c1dff700 1 --2- 172.21.15.112:0/1955228631 >> v2:172.21.15.144:3300/0 conn(0x7fd8bc15f480 0x7fd8bc0cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:29.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.103+0000 7fd8c1dff700 1 --2- 172.21.15.112:0/1955228631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8bc0cdfb0 0x7fd8bc0d03c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:29.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.103+0000 7fd8c1dff700 1 -- 172.21.15.112:0/1955228631 >> 172.21.15.112:0/1955228631 conn(0x7fd8bc0d1930 msgr2=0x7fd8bc0d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:29.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.103+0000 7fd8c1dff700 1 -- 172.21.15.112:0/1955228631 shutdown_connections 2023-09-12T16:07:29.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.103+0000 7fd8c1dff700 1 -- 172.21.15.112:0/1955228631 wait complete. 2023-09-12T16:07:29.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.105+0000 7fd8c1dff700 1 Processor -- start 2023-09-12T16:07:29.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.105+0000 7fd8c1dff700 1 -- start start 2023-09-12T16:07:29.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.106+0000 7fd8c1dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8bc0b28f0 0x7fd8bc1f23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:29.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.106+0000 7fd8c1dff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8bc0cdfb0 0x7fd8bc0b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:29.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.106+0000 7fd8c1dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8bc15f480 0x7fd8bc1f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:29.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.106+0000 7fd8c1dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc0c94a0 con 0x7fd8bc15f480 2023-09-12T16:07:29.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.106+0000 7fd8c1dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc0cb690 con 0x7fd8bc0b28f0 2023-09-12T16:07:29.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.106+0000 7fd8c1dff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc0c8e70 con 0x7fd8bc0cdfb0 2023-09-12T16:07:29.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.106+0000 7fd8bbfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8bc15f480 0x7fd8bc1f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:29.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.106+0000 7fd8bbfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8bc15f480 0x7fd8bc1f50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52394/0 (socket says 172.21.15.112:52394) 2023-09-12T16:07:29.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.106+0000 7fd8bbfff700 1 -- 172.21.15.112:0/2535100350 learned_addr learned my addr 172.21.15.112:0/2535100350 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:29.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.106+0000 7fd8baffd700 1 --2- 172.21.15.112:0/2535100350 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8bc0cdfb0 0x7fd8bc0b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:29.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.106+0000 7fd8bb7fe700 1 --2- 172.21.15.112:0/2535100350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8bc0b28f0 0x7fd8bc1f23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:29.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.107+0000 7fd8bbfff700 1 -- 172.21.15.112:0/2535100350 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8bc0cdfb0 msgr2=0x7fd8bc0b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:29.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.107+0000 7fd8bbfff700 1 --2- 172.21.15.112:0/2535100350 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8bc0cdfb0 0x7fd8bc0b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:29.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.107+0000 7fd8bbfff700 1 -- 172.21.15.112:0/2535100350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8bc0b28f0 msgr2=0x7fd8bc1f23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:29.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.107+0000 7fd8bbfff700 1 --2- 172.21.15.112:0/2535100350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8bc0b28f0 0x7fd8bc1f23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:29.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.107+0000 7fd8bbfff700 1 -- 172.21.15.112:0/2535100350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b00095f0 con 0x7fd8bc15f480 2023-09-12T16:07:29.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.107+0000 7fd8bbfff700 1 --2- 172.21.15.112:0/2535100350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8bc15f480 0x7fd8bc1f50a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4007cb0 tx=0x7fd8b4009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:29.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.107+0000 7fd8a3fff700 1 -- 172.21.15.112:0/2535100350 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4017070 con 0x7fd8bc15f480 2023-09-12T16:07:29.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.107+0000 7fd8a3fff700 1 -- 172.21.15.112:0/2535100350 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd8b400f040 con 0x7fd8bc15f480 2023-09-12T16:07:29.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.107+0000 7fd8c1dff700 1 -- 172.21.15.112:0/2535100350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8bc0b6f40 con 0x7fd8bc15f480 2023-09-12T16:07:29.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.107+0000 7fd8a3fff700 1 -- 172.21.15.112:0/2535100350 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b400d8f0 con 0x7fd8bc15f480 2023-09-12T16:07:29.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.107+0000 7fd8c1dff700 1 -- 172.21.15.112:0/2535100350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8bc0c9130 con 0x7fd8bc15f480 2023-09-12T16:07:29.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.108+0000 7fd8c1dff700 1 -- 172.21.15.112:0/2535100350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8bc072aa0 con 0x7fd8bc15f480 2023-09-12T16:07:29.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.109+0000 7fd8a3fff700 1 -- 172.21.15.112:0/2535100350 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fd8b400da50 con 0x7fd8bc15f480 2023-09-12T16:07:29.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.110+0000 7fd8a3fff700 1 --2- 172.21.15.112:0/2535100350 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd8a806a580 0x7fd8a806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:29.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.110+0000 7fd8a3fff700 1 -- 172.21.15.112:0/2535100350 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd8b4088b70 con 0x7fd8bc15f480 2023-09-12T16:07:29.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.110+0000 7fd8bb7fe700 1 --2- 172.21.15.112:0/2535100350 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd8a806a580 0x7fd8a806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:29.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.111+0000 7fd8bb7fe700 1 --2- 172.21.15.112:0/2535100350 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd8a806a580 0x7fd8a806ca40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00bbc0 tx=0x7fd8ac00b390 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:29.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.115+0000 7fd8a3fff700 1 -- 172.21.15.112:0/2535100350 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd8b4053ce0 con 0x7fd8bc15f480 2023-09-12T16:07:29.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.308+0000 7fd8c1dff700 1 -- 172.21.15.112:0/2535100350 --> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8bc0d0dd0 con 0x7fd8a806a580 2023-09-12T16:07:29.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.318+0000 7fd8a3fff700 1 -- 172.21.15.112:0/2535100350 <== mgr.4176 v2:172.21.15.112:6832/1000013333 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345317 (secure 0 0 0) 0x7fd8bc0d0dd0 con 0x7fd8a806a580 2023-09-12T16:07:29.323 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:29.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.322+0000 7fd8c1dff700 1 -- 172.21.15.112:0/2535100350 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd8a806a580 msgr2=0x7fd8a806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:29.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.323+0000 7fd8c1dff700 1 --2- 172.21.15.112:0/2535100350 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd8a806a580 0x7fd8a806ca40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00bbc0 tx=0x7fd8ac00b390 comp rx=0 tx=0).stop 2023-09-12T16:07:29.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.323+0000 7fd8c1dff700 1 -- 172.21.15.112:0/2535100350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8bc15f480 msgr2=0x7fd8bc1f50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:29.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.323+0000 7fd8c1dff700 1 --2- 172.21.15.112:0/2535100350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8bc15f480 0x7fd8bc1f50a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4007cb0 tx=0x7fd8b4009f70 comp rx=0 tx=0).stop 2023-09-12T16:07:29.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.323+0000 7fd8c1dff700 1 -- 172.21.15.112:0/2535100350 shutdown_connections 2023-09-12T16:07:29.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.323+0000 7fd8c1dff700 1 --2- 172.21.15.112:0/2535100350 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd8a806a580 0x7fd8a806ca40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:29.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.323+0000 7fd8c1dff700 1 --2- 172.21.15.112:0/2535100350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8bc15f480 0x7fd8bc1f50a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:29.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.323+0000 7fd8c1dff700 1 --2- 172.21.15.112:0/2535100350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8bc0b28f0 0x7fd8bc1f23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:29.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.323+0000 7fd8c1dff700 1 --2- 172.21.15.112:0/2535100350 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8bc0cdfb0 0x7fd8bc0b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:29.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.323+0000 7fd8c1dff700 1 -- 172.21.15.112:0/2535100350 >> 172.21.15.112:0/2535100350 conn(0x7fd8bc0d1930 msgr2=0x7fd8bc15e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:29.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.323+0000 7fd8c1dff700 1 -- 172.21.15.112:0/2535100350 shutdown_connections 2023-09-12T16:07:29.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.323+0000 7fd8c1dff700 1 -- 172.21.15.112:0/2535100350 wait complete. 2023-09-12T16:07:29.328 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-09-12T16:07:29.341 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-09-12T16:07:28.820207+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219376,"kb_used_data":3204,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755344,"statfs":{"total":773094113280,"available":772869472256,"internally_reserved":0,"allocated":3280896,"data_stored":1987237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002798"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.617354+0000","last_change":"2023-09-12T16:07:00.253786+0000","last_active":"2023-09-12T16:07:04.617354+0000","last_peered":"2023-09-12T16:07:04.617354+0000","last_clean":"2023-09-12T16:07:04.617354+0000","last_became_active":"2023-09-12T16:07:00.251978+0000","last_became_peered":"2023-09-12T16:07:00.251978+0000","last_unstale":"2023-09-12T16:07:04.617354+0000","last_undegraded":"2023-09-12T16:07:04.617354+0000","last_fullsized":"2023-09-12T16:07:04.617354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:19:17.260974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251964+0000","last_change":"2023-09-12T16:07:00.245299+0000","last_active":"2023-09-12T16:07:04.251964+0000","last_peered":"2023-09-12T16:07:04.251964+0000","last_clean":"2023-09-12T16:07:04.251964+0000","last_became_active":"2023-09-12T16:07:00.245040+0000","last_became_peered":"2023-09-12T16:07:00.245040+0000","last_unstale":"2023-09-12T16:07:04.251964+0000","last_undegraded":"2023-09-12T16:07:04.251964+0000","last_fullsized":"2023-09-12T16:07:04.251964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:38:37.389648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257391+0000","last_change":"2023-09-12T16:07:00.219173+0000","last_active":"2023-09-12T16:07:04.257391+0000","last_peered":"2023-09-12T16:07:04.257391+0000","last_clean":"2023-09-12T16:07:04.257391+0000","last_became_active":"2023-09-12T16:07:00.218882+0000","last_became_peered":"2023-09-12T16:07:00.218882+0000","last_unstale":"2023-09-12T16:07:04.257391+0000","last_undegraded":"2023-09-12T16:07:04.257391+0000","last_fullsized":"2023-09-12T16:07:04.257391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:37.582798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262241+0000","last_change":"2023-09-12T16:07:00.246106+0000","last_active":"2023-09-12T16:07:04.262241+0000","last_peered":"2023-09-12T16:07:04.262241+0000","last_clean":"2023-09-12T16:07:04.262241+0000","last_became_active":"2023-09-12T16:07:00.245639+0000","last_became_peered":"2023-09-12T16:07:00.245639+0000","last_unstale":"2023-09-12T16:07:04.262241+0000","last_undegraded":"2023-09-12T16:07:04.262241+0000","last_fullsized":"2023-09-12T16:07:04.262241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:41:27.002114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616202+0000","last_change":"2023-09-12T16:07:00.246089+0000","last_active":"2023-09-12T16:07:04.616202+0000","last_peered":"2023-09-12T16:07:04.616202+0000","last_clean":"2023-09-12T16:07:04.616202+0000","last_became_active":"2023-09-12T16:07:00.245831+0000","last_became_peered":"2023-09-12T16:07:00.245831+0000","last_unstale":"2023-09-12T16:07:04.616202+0000","last_undegraded":"2023-09-12T16:07:04.616202+0000","last_fullsized":"2023-09-12T16:07:04.616202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:11:30.292559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262233+0000","last_change":"2023-09-12T16:07:00.246840+0000","last_active":"2023-09-12T16:07:04.262233+0000","last_peered":"2023-09-12T16:07:04.262233+0000","last_clean":"2023-09-12T16:07:04.262233+0000","last_became_active":"2023-09-12T16:07:00.246570+0000","last_became_peered":"2023-09-12T16:07:00.246570+0000","last_unstale":"2023-09-12T16:07:04.262233+0000","last_undegraded":"2023-09-12T16:07:04.262233+0000","last_fullsized":"2023-09-12T16:07:04.262233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:42:25.200461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616003+0000","last_change":"2023-09-12T16:07:00.251283+0000","last_active":"2023-09-12T16:07:04.616003+0000","last_peered":"2023-09-12T16:07:04.616003+0000","last_clean":"2023-09-12T16:07:04.616003+0000","last_became_active":"2023-09-12T16:07:00.250953+0000","last_became_peered":"2023-09-12T16:07:00.250953+0000","last_unstale":"2023-09-12T16:07:04.616003+0000","last_undegraded":"2023-09-12T16:07:04.616003+0000","last_fullsized":"2023-09-12T16:07:04.616003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:38:37.389648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259047+0000","last_change":"2023-09-12T16:07:00.247292+0000","last_active":"2023-09-12T16:07:04.259047+0000","last_peered":"2023-09-12T16:07:04.259047+0000","last_clean":"2023-09-12T16:07:04.259047+0000","last_became_active":"2023-09-12T16:07:00.246988+0000","last_became_peered":"2023-09-12T16:07:00.246988+0000","last_unstale":"2023-09-12T16:07:04.259047+0000","last_undegraded":"2023-09-12T16:07:04.259047+0000","last_fullsized":"2023-09-12T16:07:04.259047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:55:23.361221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.617248+0000","last_change":"2023-09-12T16:07:00.248892+0000","last_active":"2023-09-12T16:07:04.617248+0000","last_peered":"2023-09-12T16:07:04.617248+0000","last_clean":"2023-09-12T16:07:04.617248+0000","last_became_active":"2023-09-12T16:07:00.248600+0000","last_became_peered":"2023-09-12T16:07:00.248600+0000","last_unstale":"2023-09-12T16:07:04.617248+0000","last_undegraded":"2023-09-12T16:07:04.617248+0000","last_fullsized":"2023-09-12T16:07:04.617248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:42:25.200461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.266142+0000","last_change":"2023-09-12T16:07:00.247355+0000","last_active":"2023-09-12T16:07:04.266142+0000","last_peered":"2023-09-12T16:07:04.266142+0000","last_clean":"2023-09-12T16:07:04.266142+0000","last_became_active":"2023-09-12T16:07:00.247057+0000","last_became_peered":"2023-09-12T16:07:00.247057+0000","last_unstale":"2023-09-12T16:07:04.266142+0000","last_undegraded":"2023-09-12T16:07:04.266142+0000","last_fullsized":"2023-09-12T16:07:04.266142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:14:21.195478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.265053+0000","last_change":"2023-09-12T16:07:00.249260+0000","last_active":"2023-09-12T16:07:04.265053+0000","last_peered":"2023-09-12T16:07:04.265053+0000","last_clean":"2023-09-12T16:07:04.265053+0000","last_became_active":"2023-09-12T16:07:00.248927+0000","last_became_peered":"2023-09-12T16:07:00.248927+0000","last_unstale":"2023-09-12T16:07:04.265053+0000","last_undegraded":"2023-09-12T16:07:04.265053+0000","last_fullsized":"2023-09-12T16:07:04.265053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:37.582798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259993+0000","last_change":"2023-09-12T16:07:00.242778+0000","last_active":"2023-09-12T16:07:04.259993+0000","last_peered":"2023-09-12T16:07:04.259993+0000","last_clean":"2023-09-12T16:07:04.259993+0000","last_became_active":"2023-09-12T16:07:00.242486+0000","last_became_peered":"2023-09-12T16:07:00.242486+0000","last_unstale":"2023-09-12T16:07:04.259993+0000","last_undegraded":"2023-09-12T16:07:04.259993+0000","last_fullsized":"2023-09-12T16:07:04.259993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:44:50.756697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257289+0000","last_change":"2023-09-12T16:07:00.243909+0000","last_active":"2023-09-12T16:07:04.257289+0000","last_peered":"2023-09-12T16:07:04.257289+0000","last_clean":"2023-09-12T16:07:04.257289+0000","last_became_active":"2023-09-12T16:07:00.243407+0000","last_became_peered":"2023-09-12T16:07:00.243407+0000","last_unstale":"2023-09-12T16:07:04.257289+0000","last_undegraded":"2023-09-12T16:07:04.257289+0000","last_fullsized":"2023-09-12T16:07:04.257289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:14:21.195478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257539+0000","last_change":"2023-09-12T16:07:00.238637+0000","last_active":"2023-09-12T16:07:04.257539+0000","last_peered":"2023-09-12T16:07:04.257539+0000","last_clean":"2023-09-12T16:07:04.257539+0000","last_became_active":"2023-09-12T16:07:00.238391+0000","last_became_peered":"2023-09-12T16:07:00.238391+0000","last_unstale":"2023-09-12T16:07:04.257539+0000","last_undegraded":"2023-09-12T16:07:04.257539+0000","last_fullsized":"2023-09-12T16:07:04.257539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:53:20.853979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251492+0000","last_change":"2023-09-12T16:07:00.242098+0000","last_active":"2023-09-12T16:07:04.251492+0000","last_peered":"2023-09-12T16:07:04.251492+0000","last_clean":"2023-09-12T16:07:04.251492+0000","last_became_active":"2023-09-12T16:07:00.241773+0000","last_became_peered":"2023-09-12T16:07:00.241773+0000","last_unstale":"2023-09-12T16:07:04.251492+0000","last_undegraded":"2023-09-12T16:07:04.251492+0000","last_fullsized":"2023-09-12T16:07:04.251492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:53:20.853979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262541+0000","last_change":"2023-09-12T16:07:00.241891+0000","last_active":"2023-09-12T16:07:04.262541+0000","last_peered":"2023-09-12T16:07:04.262541+0000","last_clean":"2023-09-12T16:07:04.262541+0000","last_became_active":"2023-09-12T16:07:00.241300+0000","last_became_peered":"2023-09-12T16:07:00.241300+0000","last_unstale":"2023-09-12T16:07:04.262541+0000","last_undegraded":"2023-09-12T16:07:04.262541+0000","last_fullsized":"2023-09-12T16:07:04.262541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:58.775088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262201+0000","last_change":"2023-09-12T16:07:00.250157+0000","last_active":"2023-09-12T16:07:04.262201+0000","last_peered":"2023-09-12T16:07:04.262201+0000","last_clean":"2023-09-12T16:07:04.262201+0000","last_became_active":"2023-09-12T16:07:00.249481+0000","last_became_peered":"2023-09-12T16:07:00.249481+0000","last_unstale":"2023-09-12T16:07:04.262201+0000","last_undegraded":"2023-09-12T16:07:04.262201+0000","last_fullsized":"2023-09-12T16:07:04.262201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:31.336670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262823+0000","last_change":"2023-09-12T16:07:00.219775+0000","last_active":"2023-09-12T16:07:04.262823+0000","last_peered":"2023-09-12T16:07:04.262823+0000","last_clean":"2023-09-12T16:07:04.262823+0000","last_became_active":"2023-09-12T16:07:00.219459+0000","last_became_peered":"2023-09-12T16:07:00.219459+0000","last_unstale":"2023-09-12T16:07:04.262823+0000","last_undegraded":"2023-09-12T16:07:04.262823+0000","last_fullsized":"2023-09-12T16:07:04.262823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:53:29.565994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.617208+0000","last_change":"2023-09-12T16:07:00.246535+0000","last_active":"2023-09-12T16:07:04.617208+0000","last_peered":"2023-09-12T16:07:04.617208+0000","last_clean":"2023-09-12T16:07:04.617208+0000","last_became_active":"2023-09-12T16:07:00.245971+0000","last_became_peered":"2023-09-12T16:07:00.245971+0000","last_unstale":"2023-09-12T16:07:04.617208+0000","last_undegraded":"2023-09-12T16:07:04.617208+0000","last_fullsized":"2023-09-12T16:07:04.617208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:27:58.457682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.270033+0000","last_change":"2023-09-12T16:07:04.623483+0000","last_active":"2023-09-12T16:07:05.270033+0000","last_peered":"2023-09-12T16:07:05.270033+0000","last_clean":"2023-09-12T16:07:05.270033+0000","last_became_active":"2023-09-12T16:07:04.622859+0000","last_became_peered":"2023-09-12T16:07:04.622859+0000","last_unstale":"2023-09-12T16:07:05.270033+0000","last_undegraded":"2023-09-12T16:07:05.270033+0000","last_fullsized":"2023-09-12T16:07:05.270033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:13:05.956723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257878+0000","last_change":"2023-09-12T16:06:59.234835+0000","last_active":"2023-09-12T16:07:04.257878+0000","last_peered":"2023-09-12T16:07:04.257878+0000","last_clean":"2023-09-12T16:07:04.257878+0000","last_became_active":"2023-09-12T16:06:59.234575+0000","last_became_peered":"2023-09-12T16:06:59.234575+0000","last_unstale":"2023-09-12T16:07:04.257878+0000","last_undegraded":"2023-09-12T16:07:04.257878+0000","last_fullsized":"2023-09-12T16:07:04.257878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:53:28.559875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259666+0000","last_change":"2023-09-12T16:07:00.251627+0000","last_active":"2023-09-12T16:07:04.259666+0000","last_peered":"2023-09-12T16:07:04.259666+0000","last_clean":"2023-09-12T16:07:04.259666+0000","last_became_active":"2023-09-12T16:07:00.251369+0000","last_became_peered":"2023-09-12T16:07:00.251369+0000","last_unstale":"2023-09-12T16:07:04.259666+0000","last_undegraded":"2023-09-12T16:07:04.259666+0000","last_fullsized":"2023-09-12T16:07:04.259666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:13:06.582191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872052+0000","last_change":"2023-09-12T16:07:04.280718+0000","last_active":"2023-09-12T16:07:05.872052+0000","last_peered":"2023-09-12T16:07:05.872052+0000","last_clean":"2023-09-12T16:07:05.872052+0000","last_became_active":"2023-09-12T16:07:04.280197+0000","last_became_peered":"2023-09-12T16:07:04.280197+0000","last_unstale":"2023-09-12T16:07:05.872052+0000","last_undegraded":"2023-09-12T16:07:05.872052+0000","last_fullsized":"2023-09-12T16:07:05.872052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:35.376110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259751+0000","last_change":"2023-09-12T16:06:59.231242+0000","last_active":"2023-09-12T16:07:04.259751+0000","last_peered":"2023-09-12T16:07:04.259751+0000","last_clean":"2023-09-12T16:07:04.259751+0000","last_became_active":"2023-09-12T16:06:59.230937+0000","last_became_peered":"2023-09-12T16:06:59.230937+0000","last_unstale":"2023-09-12T16:07:04.259751+0000","last_undegraded":"2023-09-12T16:07:04.259751+0000","last_fullsized":"2023-09-12T16:07:04.259751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:09:05.056699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257787+0000","last_change":"2023-09-12T16:07:00.248417+0000","last_active":"2023-09-12T16:07:04.257787+0000","last_peered":"2023-09-12T16:07:04.257787+0000","last_clean":"2023-09-12T16:07:04.257787+0000","last_became_active":"2023-09-12T16:07:00.247991+0000","last_became_peered":"2023-09-12T16:07:00.247991+0000","last_unstale":"2023-09-12T16:07:04.257787+0000","last_undegraded":"2023-09-12T16:07:04.257787+0000","last_fullsized":"2023-09-12T16:07:04.257787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:46:52.188371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872328+0000","last_change":"2023-09-12T16:07:04.280463+0000","last_active":"2023-09-12T16:07:05.872328+0000","last_peered":"2023-09-12T16:07:05.872328+0000","last_clean":"2023-09-12T16:07:05.872328+0000","last_became_active":"2023-09-12T16:07:04.279988+0000","last_became_peered":"2023-09-12T16:07:04.279988+0000","last_unstale":"2023-09-12T16:07:05.872328+0000","last_undegraded":"2023-09-12T16:07:05.872328+0000","last_fullsized":"2023-09-12T16:07:05.872328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:41:31.041554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616494+0000","last_change":"2023-09-12T16:06:59.242596+0000","last_active":"2023-09-12T16:07:04.616494+0000","last_peered":"2023-09-12T16:07:04.616494+0000","last_clean":"2023-09-12T16:07:04.616494+0000","last_became_active":"2023-09-12T16:06:59.242307+0000","last_became_peered":"2023-09-12T16:06:59.242307+0000","last_unstale":"2023-09-12T16:07:04.616494+0000","last_undegraded":"2023-09-12T16:07:04.616494+0000","last_fullsized":"2023-09-12T16:07:04.616494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:36.576680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261954+0000","last_change":"2023-09-12T16:07:00.246505+0000","last_active":"2023-09-12T16:07:04.261954+0000","last_peered":"2023-09-12T16:07:04.261954+0000","last_clean":"2023-09-12T16:07:04.261954+0000","last_became_active":"2023-09-12T16:07:00.246205+0000","last_became_peered":"2023-09-12T16:07:00.246205+0000","last_unstale":"2023-09-12T16:07:04.261954+0000","last_undegraded":"2023-09-12T16:07:04.261954+0000","last_fullsized":"2023-09-12T16:07:04.261954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:38:37.389648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.873485+0000","last_change":"2023-09-12T16:07:04.280831+0000","last_active":"2023-09-12T16:07:05.873485+0000","last_peered":"2023-09-12T16:07:05.873485+0000","last_clean":"2023-09-12T16:07:05.873485+0000","last_became_active":"2023-09-12T16:07:04.280464+0000","last_became_peered":"2023-09-12T16:07:04.280464+0000","last_unstale":"2023-09-12T16:07:05.873485+0000","last_undegraded":"2023-09-12T16:07:05.873485+0000","last_fullsized":"2023-09-12T16:07:05.873485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:19:21.300414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616218+0000","last_change":"2023-09-12T16:06:59.241342+0000","last_active":"2023-09-12T16:07:04.616218+0000","last_peered":"2023-09-12T16:07:04.616218+0000","last_clean":"2023-09-12T16:07:04.616218+0000","last_became_active":"2023-09-12T16:06:59.241022+0000","last_became_peered":"2023-09-12T16:06:59.241022+0000","last_unstale":"2023-09-12T16:07:04.616218+0000","last_undegraded":"2023-09-12T16:07:04.616218+0000","last_fullsized":"2023-09-12T16:07:04.616218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:06:29.925466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262524+0000","last_change":"2023-09-12T16:07:00.244619+0000","last_active":"2023-09-12T16:07:04.262524+0000","last_peered":"2023-09-12T16:07:04.262524+0000","last_clean":"2023-09-12T16:07:04.262524+0000","last_became_active":"2023-09-12T16:07:00.244333+0000","last_became_peered":"2023-09-12T16:07:00.244333+0000","last_unstale":"2023-09-12T16:07:04.262524+0000","last_undegraded":"2023-09-12T16:07:04.262524+0000","last_fullsized":"2023-09-12T16:07:04.262524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:36:27.893363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.270612+0000","last_change":"2023-09-12T16:07:04.275913+0000","last_active":"2023-09-12T16:07:05.270612+0000","last_peered":"2023-09-12T16:07:05.270612+0000","last_clean":"2023-09-12T16:07:05.270612+0000","last_became_active":"2023-09-12T16:07:04.275487+0000","last_became_peered":"2023-09-12T16:07:04.275487+0000","last_unstale":"2023-09-12T16:07:05.270612+0000","last_undegraded":"2023-09-12T16:07:05.270612+0000","last_fullsized":"2023-09-12T16:07:05.270612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:09:51.094691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257445+0000","last_change":"2023-09-12T16:06:59.239289+0000","last_active":"2023-09-12T16:07:04.257445+0000","last_peered":"2023-09-12T16:07:04.257445+0000","last_clean":"2023-09-12T16:07:04.257445+0000","last_became_active":"2023-09-12T16:06:59.239069+0000","last_became_peered":"2023-09-12T16:06:59.239069+0000","last_unstale":"2023-09-12T16:07:04.257445+0000","last_undegraded":"2023-09-12T16:07:04.257445+0000","last_fullsized":"2023-09-12T16:07:04.257445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:09:08.619023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259404+0000","last_change":"2023-09-12T16:07:00.238894+0000","last_active":"2023-09-12T16:07:04.259404+0000","last_peered":"2023-09-12T16:07:04.259404+0000","last_clean":"2023-09-12T16:07:04.259404+0000","last_became_active":"2023-09-12T16:07:00.238601+0000","last_became_peered":"2023-09-12T16:07:00.238601+0000","last_unstale":"2023-09-12T16:07:04.259404+0000","last_undegraded":"2023-09-12T16:07:04.259404+0000","last_fullsized":"2023-09-12T16:07:04.259404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:34:50.390861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.272943+0000","last_change":"2023-09-12T16:07:04.280769+0000","last_active":"2023-09-12T16:07:05.272943+0000","last_peered":"2023-09-12T16:07:05.272943+0000","last_clean":"2023-09-12T16:07:05.272943+0000","last_became_active":"2023-09-12T16:07:04.280409+0000","last_became_peered":"2023-09-12T16:07:04.280409+0000","last_unstale":"2023-09-12T16:07:05.272943+0000","last_undegraded":"2023-09-12T16:07:05.272943+0000","last_fullsized":"2023-09-12T16:07:05.272943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:41.622238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.264295+0000","last_change":"2023-09-12T16:06:59.239375+0000","last_active":"2023-09-12T16:07:04.264295+0000","last_peered":"2023-09-12T16:07:04.264295+0000","last_clean":"2023-09-12T16:07:04.264295+0000","last_became_active":"2023-09-12T16:06:59.239006+0000","last_became_peered":"2023-09-12T16:06:59.239006+0000","last_unstale":"2023-09-12T16:07:04.264295+0000","last_undegraded":"2023-09-12T16:07:04.264295+0000","last_fullsized":"2023-09-12T16:07:04.264295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:34:49.384742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257984+0000","last_change":"2023-09-12T16:07:00.235720+0000","last_active":"2023-09-12T16:07:04.257984+0000","last_peered":"2023-09-12T16:07:04.257984+0000","last_clean":"2023-09-12T16:07:04.257984+0000","last_became_active":"2023-09-12T16:07:00.235413+0000","last_became_peered":"2023-09-12T16:07:00.235413+0000","last_unstale":"2023-09-12T16:07:04.257984+0000","last_undegraded":"2023-09-12T16:07:04.257984+0000","last_fullsized":"2023-09-12T16:07:04.257984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:58.775088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.273910+0000","last_change":"2023-09-12T16:07:04.285511+0000","last_active":"2023-09-12T16:07:05.273910+0000","last_peered":"2023-09-12T16:07:05.273910+0000","last_clean":"2023-09-12T16:07:05.273910+0000","last_became_active":"2023-09-12T16:07:04.284941+0000","last_became_peered":"2023-09-12T16:07:04.284941+0000","last_unstale":"2023-09-12T16:07:05.273910+0000","last_undegraded":"2023-09-12T16:07:05.273910+0000","last_fullsized":"2023-09-12T16:07:05.273910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:36:31.932803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258379+0000","last_change":"2023-09-12T16:06:59.238189+0000","last_active":"2023-09-12T16:07:04.258379+0000","last_peered":"2023-09-12T16:07:04.258379+0000","last_clean":"2023-09-12T16:07:04.258379+0000","last_became_active":"2023-09-12T16:06:59.237927+0000","last_became_peered":"2023-09-12T16:06:59.237927+0000","last_unstale":"2023-09-12T16:07:04.258379+0000","last_undegraded":"2023-09-12T16:07:04.258379+0000","last_fullsized":"2023-09-12T16:07:04.258379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:05:48.783727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258852+0000","last_change":"2023-09-12T16:07:00.237348+0000","last_active":"2023-09-12T16:07:04.258852+0000","last_peered":"2023-09-12T16:07:04.258852+0000","last_clean":"2023-09-12T16:07:04.258852+0000","last_became_active":"2023-09-12T16:07:00.237064+0000","last_became_peered":"2023-09-12T16:07:00.237064+0000","last_unstale":"2023-09-12T16:07:04.258852+0000","last_undegraded":"2023-09-12T16:07:04.258852+0000","last_fullsized":"2023-09-12T16:07:04.258852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:46:52.188371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.873074+0000","last_change":"2023-09-12T16:07:04.623981+0000","last_active":"2023-09-12T16:07:05.873074+0000","last_peered":"2023-09-12T16:07:05.873074+0000","last_clean":"2023-09-12T16:07:05.873074+0000","last_became_active":"2023-09-12T16:07:04.623554+0000","last_became_peered":"2023-09-12T16:07:04.623554+0000","last_unstale":"2023-09-12T16:07:05.873074+0000","last_undegraded":"2023-09-12T16:07:05.873074+0000","last_fullsized":"2023-09-12T16:07:05.873074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:07:23.213336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262386+0000","last_change":"2023-09-12T16:06:59.231146+0000","last_active":"2023-09-12T16:07:04.262386+0000","last_peered":"2023-09-12T16:07:04.262386+0000","last_clean":"2023-09-12T16:07:04.262386+0000","last_became_active":"2023-09-12T16:06:59.230810+0000","last_became_peered":"2023-09-12T16:06:59.230810+0000","last_unstale":"2023-09-12T16:07:04.262386+0000","last_undegraded":"2023-09-12T16:07:04.262386+0000","last_fullsized":"2023-09-12T16:07:04.262386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:57:34.819094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251603+0000","last_change":"2023-09-12T16:07:00.240426+0000","last_active":"2023-09-12T16:07:04.251603+0000","last_peered":"2023-09-12T16:07:04.251603+0000","last_clean":"2023-09-12T16:07:04.251603+0000","last_became_active":"2023-09-12T16:07:00.240156+0000","last_became_peered":"2023-09-12T16:07:00.240156+0000","last_unstale":"2023-09-12T16:07:04.251603+0000","last_undegraded":"2023-09-12T16:07:04.251603+0000","last_fullsized":"2023-09-12T16:07:04.251603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:08:00.209264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.269958+0000","last_change":"2023-09-12T16:07:04.622076+0000","last_active":"2023-09-12T16:07:05.269958+0000","last_peered":"2023-09-12T16:07:05.269958+0000","last_clean":"2023-09-12T16:07:05.269958+0000","last_became_active":"2023-09-12T16:07:04.621688+0000","last_became_peered":"2023-09-12T16:07:04.621688+0000","last_unstale":"2023-09-12T16:07:05.269958+0000","last_undegraded":"2023-09-12T16:07:05.269958+0000","last_fullsized":"2023-09-12T16:07:05.269958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:14:22.302046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.265441+0000","last_change":"2023-09-12T16:06:59.240104+0000","last_active":"2023-09-12T16:07:04.265441+0000","last_peered":"2023-09-12T16:07:04.265441+0000","last_clean":"2023-09-12T16:07:04.265441+0000","last_became_active":"2023-09-12T16:06:59.239833+0000","last_became_peered":"2023-09-12T16:06:59.239833+0000","last_unstale":"2023-09-12T16:07:04.265441+0000","last_undegraded":"2023-09-12T16:07:04.265441+0000","last_fullsized":"2023-09-12T16:07:04.265441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:44:49.750579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262969+0000","last_change":"2023-09-12T16:07:00.243340+0000","last_active":"2023-09-12T16:07:04.262969+0000","last_peered":"2023-09-12T16:07:04.262969+0000","last_clean":"2023-09-12T16:07:04.262969+0000","last_became_active":"2023-09-12T16:07:00.243070+0000","last_became_peered":"2023-09-12T16:07:00.243070+0000","last_unstale":"2023-09-12T16:07:04.262969+0000","last_undegraded":"2023-09-12T16:07:04.262969+0000","last_fullsized":"2023-09-12T16:07:04.262969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:11:30.292559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.269916+0000","last_change":"2023-09-12T16:07:04.276182+0000","last_active":"2023-09-12T16:07:05.269916+0000","last_peered":"2023-09-12T16:07:05.269916+0000","last_clean":"2023-09-12T16:07:05.269916+0000","last_became_active":"2023-09-12T16:07:04.275578+0000","last_became_peered":"2023-09-12T16:07:04.275578+0000","last_unstale":"2023-09-12T16:07:05.269916+0000","last_undegraded":"2023-09-12T16:07:05.269916+0000","last_fullsized":"2023-09-12T16:07:05.269916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:40.671615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262877+0000","last_change":"2023-09-12T16:06:59.239648+0000","last_active":"2023-09-12T16:07:04.262877+0000","last_peered":"2023-09-12T16:07:04.262877+0000","last_clean":"2023-09-12T16:07:04.262877+0000","last_became_active":"2023-09-12T16:06:59.238170+0000","last_became_peered":"2023-09-12T16:06:59.238170+0000","last_unstale":"2023-09-12T16:07:04.262877+0000","last_undegraded":"2023-09-12T16:07:04.262877+0000","last_fullsized":"2023-09-12T16:07:04.262877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:53:19.847861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258027+0000","last_change":"2023-09-12T16:07:00.248255+0000","last_active":"2023-09-12T16:07:04.258027+0000","last_peered":"2023-09-12T16:07:04.258027+0000","last_clean":"2023-09-12T16:07:04.258027+0000","last_became_active":"2023-09-12T16:07:00.247645+0000","last_became_peered":"2023-09-12T16:07:00.247645+0000","last_unstale":"2023-09-12T16:07:04.258027+0000","last_undegraded":"2023-09-12T16:07:04.258027+0000","last_fullsized":"2023-09-12T16:07:04.258027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:08:00.209264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.873715+0000","last_change":"2023-09-12T16:07:04.272173+0000","last_active":"2023-09-12T16:07:05.873715+0000","last_peered":"2023-09-12T16:07:05.873715+0000","last_clean":"2023-09-12T16:07:05.873715+0000","last_became_active":"2023-09-12T16:07:04.271748+0000","last_became_peered":"2023-09-12T16:07:04.271748+0000","last_unstale":"2023-09-12T16:07:05.873715+0000","last_undegraded":"2023-09-12T16:07:05.873715+0000","last_fullsized":"2023-09-12T16:07:05.873715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:12:22.733151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.252189+0000","last_change":"2023-09-12T16:06:59.230783+0000","last_active":"2023-09-12T16:07:04.252189+0000","last_peered":"2023-09-12T16:07:04.252189+0000","last_clean":"2023-09-12T16:07:04.252189+0000","last_became_active":"2023-09-12T16:06:59.229319+0000","last_became_peered":"2023-09-12T16:06:59.229319+0000","last_unstale":"2023-09-12T16:07:04.252189+0000","last_undegraded":"2023-09-12T16:07:04.252189+0000","last_fullsized":"2023-09-12T16:07:04.252189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:09:05.056699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259921+0000","last_change":"2023-09-12T16:07:00.242166+0000","last_active":"2023-09-12T16:07:04.259921+0000","last_peered":"2023-09-12T16:07:04.259921+0000","last_clean":"2023-09-12T16:07:04.259921+0000","last_became_active":"2023-09-12T16:07:00.241914+0000","last_became_peered":"2023-09-12T16:07:00.241914+0000","last_unstale":"2023-09-12T16:07:04.259921+0000","last_undegraded":"2023-09-12T16:07:04.259921+0000","last_fullsized":"2023-09-12T16:07:04.259921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:09:09.625141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.871620+0000","last_change":"2023-09-12T16:07:04.275261+0000","last_active":"2023-09-12T16:07:05.871620+0000","last_peered":"2023-09-12T16:07:05.871620+0000","last_clean":"2023-09-12T16:07:05.871620+0000","last_became_active":"2023-09-12T16:07:04.274860+0000","last_became_peered":"2023-09-12T16:07:04.274860+0000","last_unstale":"2023-09-12T16:07:05.871620+0000","last_undegraded":"2023-09-12T16:07:05.871620+0000","last_fullsized":"2023-09-12T16:07:05.871620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:29:33.285508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:17.593597+0000","last_change":"2023-09-12T16:06:59.236346+0000","last_active":"2023-09-12T16:07:17.593597+0000","last_peered":"2023-09-12T16:07:17.593597+0000","last_clean":"2023-09-12T16:07:17.593597+0000","last_became_active":"2023-09-12T16:06:59.235979+0000","last_became_peered":"2023-09-12T16:06:59.235979+0000","last_unstale":"2023-09-12T16:07:17.593597+0000","last_undegraded":"2023-09-12T16:07:17.593597+0000","last_fullsized":"2023-09-12T16:07:17.593597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:06:29.925466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.617193+0000","last_change":"2023-09-12T16:07:00.246722+0000","last_active":"2023-09-12T16:07:04.617193+0000","last_peered":"2023-09-12T16:07:04.617193+0000","last_clean":"2023-09-12T16:07:04.617193+0000","last_became_active":"2023-09-12T16:07:00.246249+0000","last_became_peered":"2023-09-12T16:07:00.246249+0000","last_unstale":"2023-09-12T16:07:04.617193+0000","last_undegraded":"2023-09-12T16:07:04.617193+0000","last_fullsized":"2023-09-12T16:07:04.617193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:41:27.002114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872920+0000","last_change":"2023-09-12T16:07:04.624400+0000","last_active":"2023-09-12T16:07:05.872920+0000","last_peered":"2023-09-12T16:07:05.872920+0000","last_clean":"2023-09-12T16:07:05.872920+0000","last_became_active":"2023-09-12T16:07:04.623377+0000","last_became_peered":"2023-09-12T16:07:04.623377+0000","last_unstale":"2023-09-12T16:07:05.872920+0000","last_undegraded":"2023-09-12T16:07:05.872920+0000","last_fullsized":"2023-09-12T16:07:05.872920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:14:22.302046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258240+0000","last_change":"2023-09-12T16:06:59.235950+0000","last_active":"2023-09-12T16:07:04.258240+0000","last_peered":"2023-09-12T16:07:04.258240+0000","last_clean":"2023-09-12T16:07:04.258240+0000","last_became_active":"2023-09-12T16:06:59.235661+0000","last_became_peered":"2023-09-12T16:06:59.235661+0000","last_unstale":"2023-09-12T16:07:04.258240+0000","last_undegraded":"2023-09-12T16:07:04.258240+0000","last_fullsized":"2023-09-12T16:07:04.258240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:54:02.241554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257618+0000","last_change":"2023-09-12T16:07:00.246401+0000","last_active":"2023-09-12T16:07:04.257618+0000","last_peered":"2023-09-12T16:07:04.257618+0000","last_clean":"2023-09-12T16:07:04.257618+0000","last_became_active":"2023-09-12T16:07:00.246137+0000","last_became_peered":"2023-09-12T16:07:00.246137+0000","last_unstale":"2023-09-12T16:07:04.257618+0000","last_undegraded":"2023-09-12T16:07:04.257618+0000","last_fullsized":"2023-09-12T16:07:04.257618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:57:35.825213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.270749+0000","last_change":"2023-09-12T16:07:04.619237+0000","last_active":"2023-09-12T16:07:05.270749+0000","last_peered":"2023-09-12T16:07:05.270749+0000","last_clean":"2023-09-12T16:07:05.270749+0000","last_became_active":"2023-09-12T16:07:04.618830+0000","last_became_peered":"2023-09-12T16:07:04.618830+0000","last_unstale":"2023-09-12T16:07:05.270749+0000","last_undegraded":"2023-09-12T16:07:05.270749+0000","last_fullsized":"2023-09-12T16:07:05.270749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T16:16:29.162777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261955+0000","last_change":"2023-09-12T16:06:59.232841+0000","last_active":"2023-09-12T16:07:04.261955+0000","last_peered":"2023-09-12T16:07:04.261955+0000","last_clean":"2023-09-12T16:07:04.261955+0000","last_became_active":"2023-09-12T16:06:59.232536+0000","last_became_peered":"2023-09-12T16:06:59.232536+0000","last_unstale":"2023-09-12T16:07:04.261955+0000","last_undegraded":"2023-09-12T16:07:04.261955+0000","last_fullsized":"2023-09-12T16:07:04.261955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:46:51.182253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616294+0000","last_change":"2023-09-12T16:07:00.255342+0000","last_active":"2023-09-12T16:07:04.616294+0000","last_peered":"2023-09-12T16:07:04.616294+0000","last_clean":"2023-09-12T16:07:04.616294+0000","last_became_active":"2023-09-12T16:07:00.255010+0000","last_became_peered":"2023-09-12T16:07:00.255010+0000","last_unstale":"2023-09-12T16:07:04.616294+0000","last_undegraded":"2023-09-12T16:07:04.616294+0000","last_fullsized":"2023-09-12T16:07:04.616294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:45:15.386898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.270784+0000","last_change":"2023-09-12T16:07:04.622772+0000","last_active":"2023-09-12T16:07:05.270784+0000","last_peered":"2023-09-12T16:07:05.270784+0000","last_clean":"2023-09-12T16:07:05.270784+0000","last_became_active":"2023-09-12T16:07:04.622386+0000","last_became_peered":"2023-09-12T16:07:04.622386+0000","last_unstale":"2023-09-12T16:07:05.270784+0000","last_undegraded":"2023-09-12T16:07:05.270784+0000","last_fullsized":"2023-09-12T16:07:05.270784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:11:56.544503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.267852+0000","last_change":"2023-09-12T16:06:59.236957+0000","last_active":"2023-09-12T16:07:04.267852+0000","last_peered":"2023-09-12T16:07:04.267852+0000","last_clean":"2023-09-12T16:07:04.267852+0000","last_became_active":"2023-09-12T16:06:59.236675+0000","last_became_peered":"2023-09-12T16:06:59.236675+0000","last_unstale":"2023-09-12T16:07:04.267852+0000","last_undegraded":"2023-09-12T16:07:04.267852+0000","last_fullsized":"2023-09-12T16:07:04.267852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:09:08.619023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.264778+0000","last_change":"2023-09-12T16:07:00.239896+0000","last_active":"2023-09-12T16:07:04.264778+0000","last_peered":"2023-09-12T16:07:04.264778+0000","last_clean":"2023-09-12T16:07:04.264778+0000","last_became_active":"2023-09-12T16:07:00.239523+0000","last_became_peered":"2023-09-12T16:07:00.239523+0000","last_unstale":"2023-09-12T16:07:04.264778+0000","last_undegraded":"2023-09-12T16:07:04.264778+0000","last_fullsized":"2023-09-12T16:07:04.264778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:57:35.825213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872900+0000","last_change":"2023-09-12T16:07:04.276870+0000","last_active":"2023-09-12T16:07:05.872900+0000","last_peered":"2023-09-12T16:07:05.872900+0000","last_clean":"2023-09-12T16:07:05.872900+0000","last_became_active":"2023-09-12T16:07:04.276394+0000","last_became_peered":"2023-09-12T16:07:04.276394+0000","last_unstale":"2023-09-12T16:07:05.872900+0000","last_undegraded":"2023-09-12T16:07:05.872900+0000","last_fullsized":"2023-09-12T16:07:05.872900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:12:22.733151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259472+0000","last_change":"2023-09-12T16:06:59.233084+0000","last_active":"2023-09-12T16:07:04.259472+0000","last_peered":"2023-09-12T16:07:04.259472+0000","last_clean":"2023-09-12T16:07:04.259472+0000","last_became_active":"2023-09-12T16:06:59.232748+0000","last_became_peered":"2023-09-12T16:06:59.232748+0000","last_unstale":"2023-09-12T16:07:04.259472+0000","last_undegraded":"2023-09-12T16:07:04.259472+0000","last_fullsized":"2023-09-12T16:07:04.259472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:55:00.108889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616161+0000","last_change":"2023-09-12T16:07:00.245561+0000","last_active":"2023-09-12T16:07:04.616161+0000","last_peered":"2023-09-12T16:07:04.616161+0000","last_clean":"2023-09-12T16:07:04.616161+0000","last_became_active":"2023-09-12T16:07:00.245297+0000","last_became_peered":"2023-09-12T16:07:00.245297+0000","last_unstale":"2023-09-12T16:07:04.616161+0000","last_undegraded":"2023-09-12T16:07:04.616161+0000","last_fullsized":"2023-09-12T16:07:04.616161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:13:06.582191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872174+0000","last_change":"2023-09-12T16:07:04.276692+0000","last_active":"2023-09-12T16:07:05.872174+0000","last_peered":"2023-09-12T16:07:05.872174+0000","last_clean":"2023-09-12T16:07:05.872174+0000","last_became_active":"2023-09-12T16:07:04.276305+0000","last_became_peered":"2023-09-12T16:07:04.276305+0000","last_unstale":"2023-09-12T16:07:05.872174+0000","last_undegraded":"2023-09-12T16:07:05.872174+0000","last_fullsized":"2023-09-12T16:07:05.872174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:28:02.497121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.260584+0000","last_change":"2023-09-12T16:06:59.228623+0000","last_active":"2023-09-12T16:07:04.260584+0000","last_peered":"2023-09-12T16:07:04.260584+0000","last_clean":"2023-09-12T16:07:04.260584+0000","last_became_active":"2023-09-12T16:06:59.228249+0000","last_became_peered":"2023-09-12T16:06:59.228249+0000","last_unstale":"2023-09-12T16:07:04.260584+0000","last_undegraded":"2023-09-12T16:07:04.260584+0000","last_fullsized":"2023-09-12T16:07:04.260584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:49:47.563558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616629+0000","last_change":"2023-09-12T16:07:00.252935+0000","last_active":"2023-09-12T16:07:04.616629+0000","last_peered":"2023-09-12T16:07:04.616629+0000","last_clean":"2023-09-12T16:07:04.616629+0000","last_became_active":"2023-09-12T16:07:00.252647+0000","last_became_peered":"2023-09-12T16:07:00.252647+0000","last_unstale":"2023-09-12T16:07:04.616629+0000","last_undegraded":"2023-09-12T16:07:04.616629+0000","last_fullsized":"2023-09-12T16:07:04.616629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:31.336670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.871785+0000","last_change":"2023-09-12T16:07:04.270006+0000","last_active":"2023-09-12T16:07:05.871785+0000","last_peered":"2023-09-12T16:07:05.871785+0000","last_clean":"2023-09-12T16:07:05.871785+0000","last_became_active":"2023-09-12T16:07:04.269505+0000","last_became_peered":"2023-09-12T16:07:04.269505+0000","last_unstale":"2023-09-12T16:07:05.871785+0000","last_undegraded":"2023-09-12T16:07:05.871785+0000","last_fullsized":"2023-09-12T16:07:05.871785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:07:23.213336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251774+0000","last_change":"2023-09-12T16:06:59.234205+0000","last_active":"2023-09-12T16:07:04.251774+0000","last_peered":"2023-09-12T16:07:04.251774+0000","last_clean":"2023-09-12T16:07:04.251774+0000","last_became_active":"2023-09-12T16:06:59.233923+0000","last_became_peered":"2023-09-12T16:06:59.233923+0000","last_unstale":"2023-09-12T16:07:04.251774+0000","last_undegraded":"2023-09-12T16:07:04.251774+0000","last_fullsized":"2023-09-12T16:07:04.251774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:09:08.619023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262579+0000","last_change":"2023-09-12T16:07:00.242588+0000","last_active":"2023-09-12T16:07:04.262579+0000","last_peered":"2023-09-12T16:07:04.262579+0000","last_clean":"2023-09-12T16:07:04.262579+0000","last_became_active":"2023-09-12T16:07:00.242329+0000","last_became_peered":"2023-09-12T16:07:00.242329+0000","last_unstale":"2023-09-12T16:07:04.262579+0000","last_undegraded":"2023-09-12T16:07:04.262579+0000","last_fullsized":"2023-09-12T16:07:04.262579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:45:15.386898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.871795+0000","last_change":"2023-09-12T16:07:04.277502+0000","last_active":"2023-09-12T16:07:05.871795+0000","last_peered":"2023-09-12T16:07:05.871795+0000","last_clean":"2023-09-12T16:07:05.871795+0000","last_became_active":"2023-09-12T16:07:04.277124+0000","last_became_peered":"2023-09-12T16:07:04.277124+0000","last_unstale":"2023-09-12T16:07:05.871795+0000","last_undegraded":"2023-09-12T16:07:05.871795+0000","last_fullsized":"2023-09-12T16:07:05.871795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:08:08.942117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261852+0000","last_change":"2023-09-12T16:06:59.230496+0000","last_active":"2023-09-12T16:07:04.261852+0000","last_peered":"2023-09-12T16:07:04.261852+0000","last_clean":"2023-09-12T16:07:04.261852+0000","last_became_active":"2023-09-12T16:06:59.229861+0000","last_became_peered":"2023-09-12T16:06:59.229861+0000","last_unstale":"2023-09-12T16:07:04.261852+0000","last_undegraded":"2023-09-12T16:07:04.261852+0000","last_fullsized":"2023-09-12T16:07:04.261852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:36.576680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259685+0000","last_change":"2023-09-12T16:07:00.238162+0000","last_active":"2023-09-12T16:07:04.259685+0000","last_peered":"2023-09-12T16:07:04.259685+0000","last_clean":"2023-09-12T16:07:04.259685+0000","last_became_active":"2023-09-12T16:07:00.237811+0000","last_became_peered":"2023-09-12T16:07:00.237811+0000","last_unstale":"2023-09-12T16:07:04.259685+0000","last_undegraded":"2023-09-12T16:07:04.259685+0000","last_fullsized":"2023-09-12T16:07:04.259685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:53:29.565994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872588+0000","last_change":"2023-09-12T16:07:04.277513+0000","last_active":"2023-09-12T16:07:05.872588+0000","last_peered":"2023-09-12T16:07:05.872588+0000","last_clean":"2023-09-12T16:07:05.872588+0000","last_became_active":"2023-09-12T16:07:04.277127+0000","last_became_peered":"2023-09-12T16:07:04.277127+0000","last_unstale":"2023-09-12T16:07:05.872588+0000","last_undegraded":"2023-09-12T16:07:05.872588+0000","last_fullsized":"2023-09-12T16:07:05.872588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:35:14.402111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251417+0000","last_change":"2023-09-12T16:07:00.241609+0000","last_active":"2023-09-12T16:07:04.251417+0000","last_peered":"2023-09-12T16:07:04.251417+0000","last_clean":"2023-09-12T16:07:04.251417+0000","last_became_active":"2023-09-12T16:07:00.241320+0000","last_became_peered":"2023-09-12T16:07:00.241320+0000","last_unstale":"2023-09-12T16:07:04.251417+0000","last_undegraded":"2023-09-12T16:07:04.251417+0000","last_fullsized":"2023-09-12T16:07:04.251417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:58:37.106438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259080+0000","last_change":"2023-09-12T16:06:59.234032+0000","last_active":"2023-09-12T16:07:04.259080+0000","last_peered":"2023-09-12T16:07:04.259080+0000","last_clean":"2023-09-12T16:07:04.259080+0000","last_became_active":"2023-09-12T16:06:59.233608+0000","last_became_peered":"2023-09-12T16:06:59.233608+0000","last_unstale":"2023-09-12T16:07:04.259080+0000","last_undegraded":"2023-09-12T16:07:04.259080+0000","last_fullsized":"2023-09-12T16:07:04.259080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:02:44.404892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.273604+0000","last_change":"2023-09-12T16:07:04.619647+0000","last_active":"2023-09-12T16:07:05.273604+0000","last_peered":"2023-09-12T16:07:05.273604+0000","last_clean":"2023-09-12T16:07:05.273604+0000","last_became_active":"2023-09-12T16:07:04.618758+0000","last_became_peered":"2023-09-12T16:07:04.618758+0000","last_unstale":"2023-09-12T16:07:05.273604+0000","last_undegraded":"2023-09-12T16:07:05.273604+0000","last_fullsized":"2023-09-12T16:07:05.273604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:11:34.331999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257837+0000","last_change":"2023-09-12T16:07:00.247265+0000","last_active":"2023-09-12T16:07:04.257837+0000","last_peered":"2023-09-12T16:07:04.257837+0000","last_clean":"2023-09-12T16:07:04.257837+0000","last_became_active":"2023-09-12T16:07:00.246967+0000","last_became_peered":"2023-09-12T16:07:00.246967+0000","last_unstale":"2023-09-12T16:07:04.257837+0000","last_undegraded":"2023-09-12T16:07:04.257837+0000","last_fullsized":"2023-09-12T16:07:04.257837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:58:37.106438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261947+0000","last_change":"2023-09-12T16:06:59.232424+0000","last_active":"2023-09-12T16:07:04.261947+0000","last_peered":"2023-09-12T16:07:04.261947+0000","last_clean":"2023-09-12T16:07:04.261947+0000","last_became_active":"2023-09-12T16:06:59.232084+0000","last_became_peered":"2023-09-12T16:06:59.232084+0000","last_unstale":"2023-09-12T16:07:04.261947+0000","last_undegraded":"2023-09-12T16:07:04.261947+0000","last_fullsized":"2023-09-12T16:07:04.261947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:55:22.355102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.615901+0000","last_change":"2023-09-12T16:06:50.214088+0000","last_active":"2023-09-12T16:07:04.615901+0000","last_peered":"2023-09-12T16:07:04.615901+0000","last_clean":"2023-09-12T16:07:04.615901+0000","last_became_active":"2023-09-12T16:06:50.213622+0000","last_became_peered":"2023-09-12T16:06:50.213622+0000","last_unstale":"2023-09-12T16:07:04.615901+0000","last_undegraded":"2023-09-12T16:07:04.615901+0000","last_fullsized":"2023-09-12T16:07:04.615901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:49.077619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:49.077619+0000","last_clean_scrub_stamp":"2023-09-12T16:06:49.077619+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:18:36.870572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.873037+0000","last_change":"2023-09-12T16:07:04.619724+0000","last_active":"2023-09-12T16:07:05.873037+0000","last_peered":"2023-09-12T16:07:05.873037+0000","last_clean":"2023-09-12T16:07:05.873037+0000","last_became_active":"2023-09-12T16:07:04.619332+0000","last_became_peered":"2023-09-12T16:07:04.619332+0000","last_unstale":"2023-09-12T16:07:05.873037+0000","last_undegraded":"2023-09-12T16:07:05.873037+0000","last_fullsized":"2023-09-12T16:07:05.873037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:29:33.285508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257135+0000","last_change":"2023-09-12T16:07:00.235625+0000","last_active":"2023-09-12T16:07:04.257135+0000","last_peered":"2023-09-12T16:07:04.257135+0000","last_clean":"2023-09-12T16:07:04.257135+0000","last_became_active":"2023-09-12T16:07:00.235331+0000","last_became_peered":"2023-09-12T16:07:00.235331+0000","last_unstale":"2023-09-12T16:07:04.257135+0000","last_undegraded":"2023-09-12T16:07:04.257135+0000","last_fullsized":"2023-09-12T16:07:04.257135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:05:49.789846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616019+0000","last_change":"2023-09-12T16:06:59.235516+0000","last_active":"2023-09-12T16:07:04.616019+0000","last_peered":"2023-09-12T16:07:04.616019+0000","last_clean":"2023-09-12T16:07:04.616019+0000","last_became_active":"2023-09-12T16:06:59.235199+0000","last_became_peered":"2023-09-12T16:06:59.235199+0000","last_unstale":"2023-09-12T16:07:04.616019+0000","last_undegraded":"2023-09-12T16:07:04.616019+0000","last_fullsized":"2023-09-12T16:07:04.616019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:55:00.108889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872606+0000","last_change":"2023-09-12T16:07:04.619215+0000","last_active":"2023-09-12T16:07:05.872606+0000","last_peered":"2023-09-12T16:07:05.872606+0000","last_clean":"2023-09-12T16:07:05.872606+0000","last_became_active":"2023-09-12T16:07:04.618728+0000","last_became_peered":"2023-09-12T16:07:04.618728+0000","last_unstale":"2023-09-12T16:07:05.872606+0000","last_undegraded":"2023-09-12T16:07:05.872606+0000","last_fullsized":"2023-09-12T16:07:05.872606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:19:21.300414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616251+0000","last_change":"2023-09-12T16:06:59.243165+0000","last_active":"2023-09-12T16:07:04.616251+0000","last_peered":"2023-09-12T16:07:04.616251+0000","last_clean":"2023-09-12T16:07:04.616251+0000","last_became_active":"2023-09-12T16:06:59.242849+0000","last_became_peered":"2023-09-12T16:06:59.242849+0000","last_unstale":"2023-09-12T16:07:04.616251+0000","last_undegraded":"2023-09-12T16:07:04.616251+0000","last_fullsized":"2023-09-12T16:07:04.616251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:55:22.355102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251893+0000","last_change":"2023-09-12T16:07:00.246431+0000","last_active":"2023-09-12T16:07:04.251893+0000","last_peered":"2023-09-12T16:07:04.251893+0000","last_clean":"2023-09-12T16:07:04.251893+0000","last_became_active":"2023-09-12T16:07:00.246167+0000","last_became_peered":"2023-09-12T16:07:00.246167+0000","last_unstale":"2023-09-12T16:07:04.251893+0000","last_undegraded":"2023-09-12T16:07:04.251893+0000","last_fullsized":"2023-09-12T16:07:04.251893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:14:21.195478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.269732+0000","last_change":"2023-09-12T16:07:04.619600+0000","last_active":"2023-09-12T16:07:05.269732+0000","last_peered":"2023-09-12T16:07:05.269732+0000","last_clean":"2023-09-12T16:07:05.269732+0000","last_became_active":"2023-09-12T16:07:04.619212+0000","last_became_peered":"2023-09-12T16:07:04.619212+0000","last_unstale":"2023-09-12T16:07:05.269732+0000","last_undegraded":"2023-09-12T16:07:05.269732+0000","last_fullsized":"2023-09-12T16:07:05.269732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:35:14.402111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.200180+0000","last_change":"2023-09-12T16:06:59.238333+0000","last_active":"2023-09-12T16:07:05.200180+0000","last_peered":"2023-09-12T16:07:05.200180+0000","last_clean":"2023-09-12T16:07:05.200180+0000","last_became_active":"2023-09-12T16:06:59.237813+0000","last_became_peered":"2023-09-12T16:06:59.237813+0000","last_unstale":"2023-09-12T16:07:05.200180+0000","last_undegraded":"2023-09-12T16:07:05.200180+0000","last_fullsized":"2023-09-12T16:07:05.200180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:05:48.783727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261856+0000","last_change":"2023-09-12T16:07:00.243068+0000","last_active":"2023-09-12T16:07:04.261856+0000","last_peered":"2023-09-12T16:07:04.261856+0000","last_clean":"2023-09-12T16:07:04.261856+0000","last_became_active":"2023-09-12T16:07:00.242602+0000","last_became_peered":"2023-09-12T16:07:00.242602+0000","last_unstale":"2023-09-12T16:07:04.261856+0000","last_undegraded":"2023-09-12T16:07:04.261856+0000","last_fullsized":"2023-09-12T16:07:04.261856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:31.336670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872330+0000","last_change":"2023-09-12T16:07:04.619568+0000","last_active":"2023-09-12T16:07:05.872330+0000","last_peered":"2023-09-12T16:07:05.872330+0000","last_clean":"2023-09-12T16:07:05.872330+0000","last_became_active":"2023-09-12T16:07:04.619080+0000","last_became_peered":"2023-09-12T16:07:04.619080+0000","last_unstale":"2023-09-12T16:07:05.872330+0000","last_undegraded":"2023-09-12T16:07:05.872330+0000","last_fullsized":"2023-09-12T16:07:05.872330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:45:19.426338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.265308+0000","last_change":"2023-09-12T16:06:59.239587+0000","last_active":"2023-09-12T16:07:04.265308+0000","last_peered":"2023-09-12T16:07:04.265308+0000","last_clean":"2023-09-12T16:07:04.265308+0000","last_became_active":"2023-09-12T16:06:59.239216+0000","last_became_peered":"2023-09-12T16:06:59.239216+0000","last_unstale":"2023-09-12T16:07:04.265308+0000","last_undegraded":"2023-09-12T16:07:04.265308+0000","last_fullsized":"2023-09-12T16:07:04.265308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:53:28.559875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257463+0000","last_change":"2023-09-12T16:07:00.240585+0000","last_active":"2023-09-12T16:07:04.257463+0000","last_peered":"2023-09-12T16:07:04.257463+0000","last_clean":"2023-09-12T16:07:04.257463+0000","last_became_active":"2023-09-12T16:07:00.240323+0000","last_became_peered":"2023-09-12T16:07:00.240323+0000","last_unstale":"2023-09-12T16:07:04.257463+0000","last_undegraded":"2023-09-12T16:07:04.257463+0000","last_fullsized":"2023-09-12T16:07:04.257463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:55:23.361221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872379+0000","last_change":"2023-09-12T16:07:04.281034+0000","last_active":"2023-09-12T16:07:05.872379+0000","last_peered":"2023-09-12T16:07:05.872379+0000","last_clean":"2023-09-12T16:07:05.872379+0000","last_became_active":"2023-09-12T16:07:04.280525+0000","last_became_peered":"2023-09-12T16:07:04.280525+0000","last_unstale":"2023-09-12T16:07:05.872379+0000","last_undegraded":"2023-09-12T16:07:05.872379+0000","last_fullsized":"2023-09-12T16:07:05.872379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:42:29.239901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.615895+0000","last_change":"2023-09-12T16:06:59.236011+0000","last_active":"2023-09-12T16:07:04.615895+0000","last_peered":"2023-09-12T16:07:04.615895+0000","last_clean":"2023-09-12T16:07:04.615895+0000","last_became_active":"2023-09-12T16:06:59.235750+0000","last_became_peered":"2023-09-12T16:06:59.235750+0000","last_unstale":"2023-09-12T16:07:04.615895+0000","last_undegraded":"2023-09-12T16:07:04.615895+0000","last_fullsized":"2023-09-12T16:07:04.615895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:44:49.750579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.259787+0000","last_change":"2023-09-12T16:07:00.232052+0000","last_active":"2023-09-12T16:07:04.259787+0000","last_peered":"2023-09-12T16:07:04.259787+0000","last_clean":"2023-09-12T16:07:04.259787+0000","last_became_active":"2023-09-12T16:07:00.231763+0000","last_became_peered":"2023-09-12T16:07:00.231763+0000","last_unstale":"2023-09-12T16:07:04.259787+0000","last_undegraded":"2023-09-12T16:07:04.259787+0000","last_fullsized":"2023-09-12T16:07:04.259787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:06:30.931584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872351+0000","last_change":"2023-09-12T16:07:04.619604+0000","last_active":"2023-09-12T16:07:05.872351+0000","last_peered":"2023-09-12T16:07:05.872351+0000","last_clean":"2023-09-12T16:07:05.872351+0000","last_became_active":"2023-09-12T16:07:04.619196+0000","last_became_peered":"2023-09-12T16:07:04.619196+0000","last_unstale":"2023-09-12T16:07:05.872351+0000","last_undegraded":"2023-09-12T16:07:05.872351+0000","last_fullsized":"2023-09-12T16:07:05.872351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:27:51.938138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.251490+0000","last_change":"2023-09-12T16:06:59.235568+0000","last_active":"2023-09-12T16:07:04.251490+0000","last_peered":"2023-09-12T16:07:04.251490+0000","last_clean":"2023-09-12T16:07:04.251490+0000","last_became_active":"2023-09-12T16:06:59.235300+0000","last_became_peered":"2023-09-12T16:06:59.235300+0000","last_unstale":"2023-09-12T16:07:04.251490+0000","last_undegraded":"2023-09-12T16:07:04.251490+0000","last_fullsized":"2023-09-12T16:07:04.251490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:34:49.384742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258950+0000","last_change":"2023-09-12T16:07:00.244717+0000","last_active":"2023-09-12T16:07:04.258950+0000","last_peered":"2023-09-12T16:07:04.258950+0000","last_clean":"2023-09-12T16:07:04.258950+0000","last_became_active":"2023-09-12T16:07:00.244448+0000","last_became_peered":"2023-09-12T16:07:00.244448+0000","last_unstale":"2023-09-12T16:07:04.258950+0000","last_undegraded":"2023-09-12T16:07:04.258950+0000","last_fullsized":"2023-09-12T16:07:04.258950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:17:37.582798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872677+0000","last_change":"2023-09-12T16:07:04.280641+0000","last_active":"2023-09-12T16:07:05.872677+0000","last_peered":"2023-09-12T16:07:05.872677+0000","last_clean":"2023-09-12T16:07:05.872677+0000","last_became_active":"2023-09-12T16:07:04.280192+0000","last_became_peered":"2023-09-12T16:07:04.280192+0000","last_unstale":"2023-09-12T16:07:05.872677+0000","last_undegraded":"2023-09-12T16:07:05.872677+0000","last_fullsized":"2023-09-12T16:07:05.872677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:36:31.932803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.252402+0000","last_change":"2023-09-12T16:06:59.226827+0000","last_active":"2023-09-12T16:07:04.252402+0000","last_peered":"2023-09-12T16:07:04.252402+0000","last_clean":"2023-09-12T16:07:04.252402+0000","last_became_active":"2023-09-12T16:06:59.226354+0000","last_became_peered":"2023-09-12T16:06:59.226354+0000","last_unstale":"2023-09-12T16:07:04.252402+0000","last_undegraded":"2023-09-12T16:07:04.252402+0000","last_fullsized":"2023-09-12T16:07:04.252402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:57:34.819094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.257528+0000","last_change":"2023-09-12T16:07:00.243653+0000","last_active":"2023-09-12T16:07:04.257528+0000","last_peered":"2023-09-12T16:07:04.257528+0000","last_clean":"2023-09-12T16:07:04.257528+0000","last_became_active":"2023-09-12T16:07:00.243093+0000","last_became_peered":"2023-09-12T16:07:00.243093+0000","last_unstale":"2023-09-12T16:07:04.257528+0000","last_undegraded":"2023-09-12T16:07:04.257528+0000","last_fullsized":"2023-09-12T16:07:04.257528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:58.775088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872439+0000","last_change":"2023-09-12T16:07:04.274627+0000","last_active":"2023-09-12T16:07:05.872439+0000","last_peered":"2023-09-12T16:07:05.872439+0000","last_clean":"2023-09-12T16:07:05.872439+0000","last_became_active":"2023-09-12T16:07:04.274161+0000","last_became_peered":"2023-09-12T16:07:04.274161+0000","last_unstale":"2023-09-12T16:07:05.872439+0000","last_undegraded":"2023-09-12T16:07:05.872439+0000","last_fullsized":"2023-09-12T16:07:05.872439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:11:34.331999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616307+0000","last_change":"2023-09-12T16:06:59.238849+0000","last_active":"2023-09-12T16:07:04.616307+0000","last_peered":"2023-09-12T16:07:04.616307+0000","last_clean":"2023-09-12T16:07:04.616307+0000","last_became_active":"2023-09-12T16:06:59.238511+0000","last_became_peered":"2023-09-12T16:06:59.238511+0000","last_unstale":"2023-09-12T16:07:04.616307+0000","last_undegraded":"2023-09-12T16:07:04.616307+0000","last_fullsized":"2023-09-12T16:07:04.616307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:09:05.056699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.266098+0000","last_change":"2023-09-12T16:07:00.236595+0000","last_active":"2023-09-12T16:07:04.266098+0000","last_peered":"2023-09-12T16:07:04.266098+0000","last_clean":"2023-09-12T16:07:04.266098+0000","last_became_active":"2023-09-12T16:07:00.236274+0000","last_became_peered":"2023-09-12T16:07:00.236274+0000","last_unstale":"2023-09-12T16:07:04.266098+0000","last_undegraded":"2023-09-12T16:07:04.266098+0000","last_fullsized":"2023-09-12T16:07:04.266098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:55:23.361221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.273966+0000","last_change":"2023-09-12T16:07:04.619296+0000","last_active":"2023-09-12T16:07:05.273966+0000","last_peered":"2023-09-12T16:07:05.273966+0000","last_clean":"2023-09-12T16:07:05.273966+0000","last_became_active":"2023-09-12T16:07:04.618720+0000","last_became_peered":"2023-09-12T16:07:04.618720+0000","last_unstale":"2023-09-12T16:07:05.273966+0000","last_undegraded":"2023-09-12T16:07:05.273966+0000","last_fullsized":"2023-09-12T16:07:05.273966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:45:19.426338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261342+0000","last_change":"2023-09-12T16:06:59.238054+0000","last_active":"2023-09-12T16:07:04.261342+0000","last_peered":"2023-09-12T16:07:04.261342+0000","last_clean":"2023-09-12T16:07:04.261342+0000","last_became_active":"2023-09-12T16:06:59.237786+0000","last_became_peered":"2023-09-12T16:06:59.237786+0000","last_unstale":"2023-09-12T16:07:04.261342+0000","last_undegraded":"2023-09-12T16:07:04.261342+0000","last_fullsized":"2023-09-12T16:07:04.261342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:49:47.563558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.616530+0000","last_change":"2023-09-12T16:07:00.249587+0000","last_active":"2023-09-12T16:07:04.616530+0000","last_peered":"2023-09-12T16:07:04.616530+0000","last_clean":"2023-09-12T16:07:04.616530+0000","last_became_active":"2023-09-12T16:07:00.249288+0000","last_became_peered":"2023-09-12T16:07:00.249288+0000","last_unstale":"2023-09-12T16:07:04.616530+0000","last_undegraded":"2023-09-12T16:07:04.616530+0000","last_fullsized":"2023-09-12T16:07:04.616530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:36:27.893363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.872455+0000","last_change":"2023-09-12T16:07:04.269929+0000","last_active":"2023-09-12T16:07:05.872455+0000","last_peered":"2023-09-12T16:07:05.872455+0000","last_clean":"2023-09-12T16:07:05.872455+0000","last_became_active":"2023-09-12T16:07:04.269553+0000","last_became_peered":"2023-09-12T16:07:04.269553+0000","last_unstale":"2023-09-12T16:07:05.872455+0000","last_undegraded":"2023-09-12T16:07:05.872455+0000","last_fullsized":"2023-09-12T16:07:05.872455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:42:29.239901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.252147+0000","last_change":"2023-09-12T16:06:59.222437+0000","last_active":"2023-09-12T16:07:04.252147+0000","last_peered":"2023-09-12T16:07:04.252147+0000","last_clean":"2023-09-12T16:07:04.252147+0000","last_became_active":"2023-09-12T16:06:59.222099+0000","last_became_peered":"2023-09-12T16:06:59.222099+0000","last_unstale":"2023-09-12T16:07:04.252147+0000","last_undegraded":"2023-09-12T16:07:04.252147+0000","last_fullsized":"2023-09-12T16:07:04.252147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:44:49.750579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262052+0000","last_change":"2023-09-12T16:07:00.246299+0000","last_active":"2023-09-12T16:07:04.262052+0000","last_peered":"2023-09-12T16:07:04.262052+0000","last_clean":"2023-09-12T16:07:04.262052+0000","last_became_active":"2023-09-12T16:07:00.245786+0000","last_became_peered":"2023-09-12T16:07:00.245786+0000","last_unstale":"2023-09-12T16:07:04.262052+0000","last_undegraded":"2023-09-12T16:07:04.262052+0000","last_fullsized":"2023-09-12T16:07:04.262052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:27:58.457682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-12T16:07:05.871863+0000","last_change":"2023-09-12T16:07:04.619216+0000","last_active":"2023-09-12T16:07:05.871863+0000","last_peered":"2023-09-12T16:07:05.871863+0000","last_clean":"2023-09-12T16:07:05.871863+0000","last_became_active":"2023-09-12T16:07:04.618772+0000","last_became_peered":"2023-09-12T16:07:04.618772+0000","last_unstale":"2023-09-12T16:07:05.871863+0000","last_undegraded":"2023-09-12T16:07:05.871863+0000","last_fullsized":"2023-09-12T16:07:05.871863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:07:03.241506+0000","last_clean_scrub_stamp":"2023-09-12T16:07:03.241506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:07:40.671615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262737+0000","last_change":"2023-09-12T16:06:59.237315+0000","last_active":"2023-09-12T16:07:04.262737+0000","last_peered":"2023-09-12T16:07:04.262737+0000","last_clean":"2023-09-12T16:07:04.262737+0000","last_became_active":"2023-09-12T16:06:59.237042+0000","last_became_peered":"2023-09-12T16:06:59.237042+0000","last_unstale":"2023-09-12T16:07:04.262737+0000","last_undegraded":"2023-09-12T16:07:04.262737+0000","last_fullsized":"2023-09-12T16:07:04.262737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:58.195947+0000","last_clean_scrub_stamp":"2023-09-12T16:06:58.195947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:34:01.502780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.617354+0000","last_change":"2023-09-12T16:07:00.252987+0000","last_active":"2023-09-12T16:07:04.617354+0000","last_peered":"2023-09-12T16:07:04.617354+0000","last_clean":"2023-09-12T16:07:04.617354+0000","last_became_active":"2023-09-12T16:07:00.252715+0000","last_became_peered":"2023-09-12T16:07:00.252715+0000","last_unstale":"2023-09-12T16:07:04.617354+0000","last_undegraded":"2023-09-12T16:07:04.617354+0000","last_fullsized":"2023-09-12T16:07:04.617354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:12:18.693711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.264873+0000","last_change":"2023-09-12T16:07:00.239692+0000","last_active":"2023-09-12T16:07:04.264873+0000","last_peered":"2023-09-12T16:07:04.264873+0000","last_clean":"2023-09-12T16:07:04.264873+0000","last_became_active":"2023-09-12T16:07:00.239382+0000","last_became_peered":"2023-09-12T16:07:00.239382+0000","last_unstale":"2023-09-12T16:07:04.264873+0000","last_undegraded":"2023-09-12T16:07:04.264873+0000","last_fullsized":"2023-09-12T16:07:04.264873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:58:37.106438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258921+0000","last_change":"2023-09-12T16:07:00.243624+0000","last_active":"2023-09-12T16:07:04.258921+0000","last_peered":"2023-09-12T16:07:04.258921+0000","last_clean":"2023-09-12T16:07:04.258921+0000","last_became_active":"2023-09-12T16:07:00.243363+0000","last_became_peered":"2023-09-12T16:07:00.243363+0000","last_unstale":"2023-09-12T16:07:04.258921+0000","last_undegraded":"2023-09-12T16:07:04.258921+0000","last_fullsized":"2023-09-12T16:07:04.258921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:06:30.931584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262048+0000","last_change":"2023-09-12T16:07:00.247135+0000","last_active":"2023-09-12T16:07:04.262048+0000","last_peered":"2023-09-12T16:07:04.262048+0000","last_clean":"2023-09-12T16:07:04.262048+0000","last_became_active":"2023-09-12T16:07:00.245531+0000","last_became_peered":"2023-09-12T16:07:00.245531+0000","last_unstale":"2023-09-12T16:07:04.262048+0000","last_undegraded":"2023-09-12T16:07:04.262048+0000","last_fullsized":"2023-09-12T16:07:04.262048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:12:18.693711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258068+0000","last_change":"2023-09-12T16:07:00.235877+0000","last_active":"2023-09-12T16:07:04.258068+0000","last_peered":"2023-09-12T16:07:04.258068+0000","last_clean":"2023-09-12T16:07:04.258068+0000","last_became_active":"2023-09-12T16:07:00.235463+0000","last_became_peered":"2023-09-12T16:07:00.235463+0000","last_unstale":"2023-09-12T16:07:04.258068+0000","last_undegraded":"2023-09-12T16:07:04.258068+0000","last_fullsized":"2023-09-12T16:07:04.258068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:14:21.195478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261764+0000","last_change":"2023-09-12T16:07:00.239178+0000","last_active":"2023-09-12T16:07:04.261764+0000","last_peered":"2023-09-12T16:07:04.261764+0000","last_clean":"2023-09-12T16:07:04.261764+0000","last_became_active":"2023-09-12T16:07:00.237641+0000","last_became_peered":"2023-09-12T16:07:00.237641+0000","last_unstale":"2023-09-12T16:07:04.261764+0000","last_undegraded":"2023-09-12T16:07:04.261764+0000","last_fullsized":"2023-09-12T16:07:04.261764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:08:00.209264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.252078+0000","last_change":"2023-09-12T16:07:00.240120+0000","last_active":"2023-09-12T16:07:04.252078+0000","last_peered":"2023-09-12T16:07:04.252078+0000","last_clean":"2023-09-12T16:07:04.252078+0000","last_became_active":"2023-09-12T16:07:00.239826+0000","last_became_peered":"2023-09-12T16:07:00.239826+0000","last_unstale":"2023-09-12T16:07:04.252078+0000","last_undegraded":"2023-09-12T16:07:04.252078+0000","last_fullsized":"2023-09-12T16:07:04.252078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:58.775088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.266947+0000","last_change":"2023-09-12T16:07:00.242920+0000","last_active":"2023-09-12T16:07:04.266947+0000","last_peered":"2023-09-12T16:07:04.266947+0000","last_clean":"2023-09-12T16:07:04.266947+0000","last_became_active":"2023-09-12T16:07:00.242640+0000","last_became_peered":"2023-09-12T16:07:00.242640+0000","last_unstale":"2023-09-12T16:07:04.266947+0000","last_undegraded":"2023-09-12T16:07:04.266947+0000","last_fullsized":"2023-09-12T16:07:04.266947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:46:52.188371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.261946+0000","last_change":"2023-09-12T16:07:00.236628+0000","last_active":"2023-09-12T16:07:04.261946+0000","last_peered":"2023-09-12T16:07:04.261946+0000","last_clean":"2023-09-12T16:07:04.261946+0000","last_became_active":"2023-09-12T16:07:00.236285+0000","last_became_peered":"2023-09-12T16:07:00.236285+0000","last_unstale":"2023-09-12T16:07:04.261946+0000","last_undegraded":"2023-09-12T16:07:04.261946+0000","last_fullsized":"2023-09-12T16:07:04.261946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:38:37.389648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262483+0000","last_change":"2023-09-12T16:07:00.242101+0000","last_active":"2023-09-12T16:07:04.262483+0000","last_peered":"2023-09-12T16:07:04.262483+0000","last_clean":"2023-09-12T16:07:04.262483+0000","last_became_active":"2023-09-12T16:07:00.241617+0000","last_became_peered":"2023-09-12T16:07:00.241617+0000","last_unstale":"2023-09-12T16:07:04.262483+0000","last_undegraded":"2023-09-12T16:07:04.262483+0000","last_fullsized":"2023-09-12T16:07:04.262483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:13:06.582191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258456+0000","last_change":"2023-09-12T16:07:00.236987+0000","last_active":"2023-09-12T16:07:04.258456+0000","last_peered":"2023-09-12T16:07:04.258456+0000","last_clean":"2023-09-12T16:07:04.258456+0000","last_became_active":"2023-09-12T16:07:00.236642+0000","last_became_peered":"2023-09-12T16:07:00.236642+0000","last_unstale":"2023-09-12T16:07:04.258456+0000","last_undegraded":"2023-09-12T16:07:04.258456+0000","last_fullsized":"2023-09-12T16:07:04.258456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:53:20.853979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.262134+0000","last_change":"2023-09-12T16:07:00.246004+0000","last_active":"2023-09-12T16:07:04.262134+0000","last_peered":"2023-09-12T16:07:04.262134+0000","last_clean":"2023-09-12T16:07:04.262134+0000","last_became_active":"2023-09-12T16:07:00.245625+0000","last_became_peered":"2023-09-12T16:07:00.245625+0000","last_unstale":"2023-09-12T16:07:04.262134+0000","last_undegraded":"2023-09-12T16:07:04.262134+0000","last_fullsized":"2023-09-12T16:07:04.262134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:19:17.260974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.258148+0000","last_change":"2023-09-12T16:07:00.246340+0000","last_active":"2023-09-12T16:07:04.258148+0000","last_peered":"2023-09-12T16:07:04.258148+0000","last_clean":"2023-09-12T16:07:04.258148+0000","last_became_active":"2023-09-12T16:07:00.246060+0000","last_became_peered":"2023-09-12T16:07:00.246060+0000","last_unstale":"2023-09-12T16:07:04.258148+0000","last_undegraded":"2023-09-12T16:07:04.258148+0000","last_fullsized":"2023-09-12T16:07:04.258148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:58:37.106438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-12T16:07:04.266833+0000","last_change":"2023-09-12T16:07:00.238100+0000","last_active":"2023-09-12T16:07:04.266833+0000","last_peered":"2023-09-12T16:07:04.266833+0000","last_clean":"2023-09-12T16:07:04.266833+0000","last_became_active":"2023-09-12T16:07:00.237802+0000","last_became_peered":"2023-09-12T16:07:00.237802+0000","last_unstale":"2023-09-12T16:07:04.266833+0000","last_undegraded":"2023-09-12T16:07:04.266833+0000","last_fullsized":"2023-09-12T16:07:04.266833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:59.202066+0000","last_clean_scrub_stamp":"2023-09-12T16:06:59.202066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:53:20.853979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":689767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-12T16:07:29.349 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-12T16:07:29.350 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-12T16:07:29.350 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-12T16:07:29.350 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-12T16:07:29.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.579+0000 7f427d1ff700 1 -- 172.21.15.112:0/113453141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42780b28f0 msgr2=0x7f42780cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:29.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.579+0000 7f427d1ff700 1 --2- 172.21.15.112:0/113453141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42780b28f0 0x7f42780cd3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4270009f60 tx=0x7f4270009f90 comp rx=0 tx=0).stop 2023-09-12T16:07:29.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.579+0000 7f427d1ff700 1 -- 172.21.15.112:0/113453141 shutdown_connections 2023-09-12T16:07:29.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.579+0000 7f427d1ff700 1 --2- 172.21.15.112:0/113453141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42780b28f0 0x7f42780cd3c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:29.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.579+0000 7f427d1ff700 1 --2- 172.21.15.112:0/113453141 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f427815f480 0x7f42780cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:29.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.579+0000 7f427d1ff700 1 -- 172.21.15.112:0/113453141 >> 172.21.15.112:0/113453141 conn(0x7f42780d1930 msgr2=0x7f42780d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:29.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.579+0000 7f427d1ff700 1 -- 172.21.15.112:0/113453141 shutdown_connections 2023-09-12T16:07:29.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.579+0000 7f427d1ff700 1 -- 172.21.15.112:0/113453141 wait complete. 2023-09-12T16:07:29.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.581+0000 7f427d1ff700 1 Processor -- start 2023-09-12T16:07:29.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.581+0000 7f427d1ff700 1 -- start start 2023-09-12T16:07:29.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.582+0000 7f427d1ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42780b28f0 0x7f42781570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:29.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.582+0000 7f427d1ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42780cdfb0 0x7f427809b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:29.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.582+0000 7f427d1ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f427815f480 0x7f42780c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:29.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.582+0000 7f427d1ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427815ac10 con 0x7f42780b28f0 2023-09-12T16:07:29.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.582+0000 7f427d1ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42780c9640 con 0x7f42780cdfb0 2023-09-12T16:07:29.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.582+0000 7f427d1ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42780c9920 con 0x7f427815f480 2023-09-12T16:07:29.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.582+0000 7f4276d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42780b28f0 0x7f42781570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:29.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.582+0000 7f4276d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42780b28f0 0x7f42781570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52412/0 (socket says 172.21.15.112:52412) 2023-09-12T16:07:29.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.582+0000 7f4276d9d700 1 -- 172.21.15.112:0/867021215 learned_addr learned my addr 172.21.15.112:0/867021215 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:29.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.583+0000 7f426ffff700 1 --2- 172.21.15.112:0/867021215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42780cdfb0 0x7f427809b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:29.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.583+0000 7f427759e700 1 --2- 172.21.15.112:0/867021215 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f427815f480 0x7f42780c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:29.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.583+0000 7f4276d9d700 1 -- 172.21.15.112:0/867021215 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f427815f480 msgr2=0x7f42780c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:29.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.583+0000 7f4276d9d700 1 --2- 172.21.15.112:0/867021215 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f427815f480 0x7f42780c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:29.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.583+0000 7f4276d9d700 1 -- 172.21.15.112:0/867021215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42780cdfb0 msgr2=0x7f427809b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:29.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.583+0000 7f4276d9d700 1 --2- 172.21.15.112:0/867021215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42780cdfb0 0x7f427809b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:29.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.583+0000 7f4276d9d700 1 -- 172.21.15.112:0/867021215 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4270009c40 con 0x7f42780b28f0 2023-09-12T16:07:29.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.583+0000 7f427759e700 1 --2- 172.21.15.112:0/867021215 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f427815f480 0x7f42780c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:29.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.583+0000 7f4276d9d700 1 --2- 172.21.15.112:0/867021215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42780b28f0 0x7f42781570b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f426800d950 tx=0x7f426800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:29.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.583+0000 7f426f7fe700 1 -- 172.21.15.112:0/867021215 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268009930 con 0x7f42780b28f0 2023-09-12T16:07:29.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.583+0000 7f426f7fe700 1 -- 172.21.15.112:0/867021215 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4268009b80 con 0x7f42780b28f0 2023-09-12T16:07:29.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.583+0000 7f426f7fe700 1 -- 172.21.15.112:0/867021215 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268010460 con 0x7f42780b28f0 2023-09-12T16:07:29.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.583+0000 7f427d1ff700 1 -- 172.21.15.112:0/867021215 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42780c9c00 con 0x7f42780b28f0 2023-09-12T16:07:29.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.584+0000 7f427d1ff700 1 -- 172.21.15.112:0/867021215 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42781575f0 con 0x7f42780b28f0 2023-09-12T16:07:29.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.585+0000 7f427d1ff700 1 -- 172.21.15.112:0/867021215 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427804e300 con 0x7f42780b28f0 2023-09-12T16:07:29.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.585+0000 7f426f7fe700 1 -- 172.21.15.112:0/867021215 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f42680105c0 con 0x7f42780b28f0 2023-09-12T16:07:29.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.587+0000 7f426f7fe700 1 --2- 172.21.15.112:0/867021215 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f425806a580 0x7f425806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:29.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.587+0000 7f426f7fe700 1 -- 172.21.15.112:0/867021215 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4268089070 con 0x7f42780b28f0 2023-09-12T16:07:29.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.587+0000 7f426ffff700 1 --2- 172.21.15.112:0/867021215 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f425806a580 0x7f425806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:29.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.588+0000 7f426ffff700 1 --2- 172.21.15.112:0/867021215 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f425806a580 0x7f425806ca40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f427815c3b0 tx=0x7f4260009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:29.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.591+0000 7f426f7fe700 1 -- 172.21.15.112:0/867021215 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f42680bb9b0 con 0x7f42780b28f0 2023-09-12T16:07:29.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.828+0000 7f427d1ff700 1 -- 172.21.15.112:0/867021215 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f42780b4300 con 0x7f42780b28f0 2023-09-12T16:07:29.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.829+0000 7f426f7fe700 1 -- 172.21.15.112:0/867021215 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4268021040 con 0x7f42780b28f0 2023-09-12T16:07:29.829 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:29.829 INFO:teuthology.orchestra.run.smithi112.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-12T16:07:29.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.831+0000 7f427d1ff700 1 -- 172.21.15.112:0/867021215 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f425806a580 msgr2=0x7f425806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:29.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.831+0000 7f427d1ff700 1 --2- 172.21.15.112:0/867021215 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f425806a580 0x7f425806ca40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f427815c3b0 tx=0x7f4260009040 comp rx=0 tx=0).stop 2023-09-12T16:07:29.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.831+0000 7f427d1ff700 1 -- 172.21.15.112:0/867021215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42780b28f0 msgr2=0x7f42781570b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:29.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.831+0000 7f427d1ff700 1 --2- 172.21.15.112:0/867021215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42780b28f0 0x7f42781570b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f426800d950 tx=0x7f426800dc60 comp rx=0 tx=0).stop 2023-09-12T16:07:29.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.831+0000 7f427d1ff700 1 -- 172.21.15.112:0/867021215 shutdown_connections 2023-09-12T16:07:29.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.831+0000 7f427d1ff700 1 --2- 172.21.15.112:0/867021215 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f425806a580 0x7f425806ca40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:29.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.831+0000 7f427d1ff700 1 --2- 172.21.15.112:0/867021215 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f427815f480 0x7f42780c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:29.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.831+0000 7f427d1ff700 1 --2- 172.21.15.112:0/867021215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42780b28f0 0x7f42781570b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:29.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.831+0000 7f427d1ff700 1 --2- 172.21.15.112:0/867021215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42780cdfb0 0x7f427809b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:29.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.831+0000 7f427d1ff700 1 -- 172.21.15.112:0/867021215 >> 172.21.15.112:0/867021215 conn(0x7f42780d1930 msgr2=0x7f42780c57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:29.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.831+0000 7f427d1ff700 1 -- 172.21.15.112:0/867021215 shutdown_connections 2023-09-12T16:07:29.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:29.831+0000 7f427d1ff700 1 -- 172.21.15.112:0/867021215 wait complete. 2023-09-12T16:07:29.849 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-12T16:07:29.850 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:07:30.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.050+0000 7fd4947ff700 1 -- 172.21.15.112:0/1778703190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c15b920 msgr2=0x7fd48c0d0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:30.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.050+0000 7fd4947ff700 1 --2- 172.21.15.112:0/1778703190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c15b920 0x7fd48c0d0410 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd488009970 tx=0x7fd488009c80 comp rx=0 tx=0).stop 2023-09-12T16:07:30.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.050+0000 7fd4947ff700 1 -- 172.21.15.112:0/1778703190 shutdown_connections 2023-09-12T16:07:30.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.050+0000 7fd4947ff700 1 --2- 172.21.15.112:0/1778703190 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd48c0ce7a0 0x7fd48c0b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:30.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.050+0000 7fd4947ff700 1 --2- 172.21.15.112:0/1778703190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c15b920 0x7fd48c0d0410 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:30.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.050+0000 7fd4947ff700 1 -- 172.21.15.112:0/1778703190 >> 172.21.15.112:0/1778703190 conn(0x7fd48c09abe0 msgr2=0x7fd48c0d1830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:30.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.050+0000 7fd4947ff700 1 -- 172.21.15.112:0/1778703190 shutdown_connections 2023-09-12T16:07:30.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.050+0000 7fd4947ff700 1 -- 172.21.15.112:0/1778703190 wait complete. 2023-09-12T16:07:30.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.052+0000 7fd4947ff700 1 Processor -- start 2023-09-12T16:07:30.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.052+0000 7fd4947ff700 1 -- start start 2023-09-12T16:07:30.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.053+0000 7fd4947ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c0cceb0 0x7fd48c149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:30.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.053+0000 7fd4947ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd48c0ce7a0 0x7fd48c0c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:30.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.053+0000 7fd4947ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd48c15b920 0x7fd48c0b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:30.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.053+0000 7fd4947ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c14a220 con 0x7fd48c0cceb0 2023-09-12T16:07:30.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.053+0000 7fd4947ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0ca250 con 0x7fd48c0ce7a0 2023-09-12T16:07:30.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.053+0000 7fd4947ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0ca530 con 0x7fd48c15b920 2023-09-12T16:07:30.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.053+0000 7fd49259b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c0cceb0 0x7fd48c149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:30.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.053+0000 7fd49259b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c0cceb0 0x7fd48c149ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52416/0 (socket says 172.21.15.112:52416) 2023-09-12T16:07:30.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.053+0000 7fd49259b700 1 -- 172.21.15.112:0/1412238638 learned_addr learned my addr 172.21.15.112:0/1412238638 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:30.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.053+0000 7fd492d9c700 1 --2- 172.21.15.112:0/1412238638 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd48c15b920 0x7fd48c0b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:30.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.053+0000 7fd491d9a700 1 --2- 172.21.15.112:0/1412238638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd48c0ce7a0 0x7fd48c0c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:30.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.054+0000 7fd49259b700 1 -- 172.21.15.112:0/1412238638 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd48c15b920 msgr2=0x7fd48c0b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:30.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.054+0000 7fd49259b700 1 --2- 172.21.15.112:0/1412238638 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd48c15b920 0x7fd48c0b5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:30.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.054+0000 7fd49259b700 1 -- 172.21.15.112:0/1412238638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd48c0ce7a0 msgr2=0x7fd48c0c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:30.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.054+0000 7fd49259b700 1 --2- 172.21.15.112:0/1412238638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd48c0ce7a0 0x7fd48c0c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:30.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.054+0000 7fd49259b700 1 -- 172.21.15.112:0/1412238638 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd488009580 con 0x7fd48c0cceb0 2023-09-12T16:07:30.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.054+0000 7fd491d9a700 1 --2- 172.21.15.112:0/1412238638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd48c0ce7a0 0x7fd48c0c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:07:30.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.054+0000 7fd49259b700 1 --2- 172.21.15.112:0/1412238638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c0cceb0 0x7fd48c149ce0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd48c08aa70 tx=0x7fd488005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:30.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.054+0000 7fd482ffd700 1 -- 172.21.15.112:0/1412238638 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48801e070 con 0x7fd48c0cceb0 2023-09-12T16:07:30.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.054+0000 7fd482ffd700 1 -- 172.21.15.112:0/1412238638 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd48800b7f0 con 0x7fd48c0cceb0 2023-09-12T16:07:30.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.054+0000 7fd4947ff700 1 -- 172.21.15.112:0/1412238638 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd48c0ca810 con 0x7fd48c0cceb0 2023-09-12T16:07:30.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.054+0000 7fd482ffd700 1 -- 172.21.15.112:0/1412238638 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48800bc00 con 0x7fd48c0cceb0 2023-09-12T16:07:30.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.054+0000 7fd4947ff700 1 -- 172.21.15.112:0/1412238638 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48c15c3b0 con 0x7fd48c0cceb0 2023-09-12T16:07:30.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.055+0000 7fd4947ff700 1 -- 172.21.15.112:0/1412238638 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48c15c540 con 0x7fd48c0cceb0 2023-09-12T16:07:30.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.056+0000 7fd482ffd700 1 -- 172.21.15.112:0/1412238638 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fd48800bd60 con 0x7fd48c0cceb0 2023-09-12T16:07:30.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.058+0000 7fd482ffd700 1 --2- 172.21.15.112:0/1412238638 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd47006a580 0x7fd47006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:30.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.058+0000 7fd482ffd700 1 -- 172.21.15.112:0/1412238638 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd48808a190 con 0x7fd48c0cceb0 2023-09-12T16:07:30.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.058+0000 7fd491d9a700 1 --2- 172.21.15.112:0/1412238638 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd47006a580 0x7fd47006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:30.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.058+0000 7fd491d9a700 1 --2- 172.21.15.112:0/1412238638 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd47006a580 0x7fd47006ca40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0b6980 tx=0x7fd47c009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:30.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.062+0000 7fd482ffd700 1 -- 172.21.15.112:0/1412238638 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd488055530 con 0x7fd48c0cceb0 2023-09-12T16:07:30.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.258+0000 7fd4947ff700 1 -- 172.21.15.112:0/1412238638 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd48c0d2170 con 0x7fd48c0cceb0 2023-09-12T16:07:30.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.259+0000 7fd482ffd700 1 -- 172.21.15.112:0/1412238638 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fd488058b50 con 0x7fd48c0cceb0 2023-09-12T16:07:30.260 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:30.260 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:04.748402+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:07:30.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.261+0000 7fd4947ff700 1 -- 172.21.15.112:0/1412238638 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd47006a580 msgr2=0x7fd47006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:30.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.261+0000 7fd4947ff700 1 --2- 172.21.15.112:0/1412238638 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd47006a580 0x7fd47006ca40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0b6980 tx=0x7fd47c009040 comp rx=0 tx=0).stop 2023-09-12T16:07:30.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.261+0000 7fd4947ff700 1 -- 172.21.15.112:0/1412238638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c0cceb0 msgr2=0x7fd48c149ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:30.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.261+0000 7fd4947ff700 1 --2- 172.21.15.112:0/1412238638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c0cceb0 0x7fd48c149ce0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd48c08aa70 tx=0x7fd488005040 comp rx=0 tx=0).stop 2023-09-12T16:07:30.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.262+0000 7fd4947ff700 1 -- 172.21.15.112:0/1412238638 shutdown_connections 2023-09-12T16:07:30.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.262+0000 7fd4947ff700 1 --2- 172.21.15.112:0/1412238638 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd47006a580 0x7fd47006ca40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:30.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.262+0000 7fd4947ff700 1 --2- 172.21.15.112:0/1412238638 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd48c15b920 0x7fd48c0b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:30.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.262+0000 7fd4947ff700 1 --2- 172.21.15.112:0/1412238638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c0cceb0 0x7fd48c149ce0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:30.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.262+0000 7fd4947ff700 1 --2- 172.21.15.112:0/1412238638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd48c0ce7a0 0x7fd48c0c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:30.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.262+0000 7fd4947ff700 1 -- 172.21.15.112:0/1412238638 >> 172.21.15.112:0/1412238638 conn(0x7fd48c09abe0 msgr2=0x7fd48c15ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:30.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.262+0000 7fd4947ff700 1 -- 172.21.15.112:0/1412238638 shutdown_connections 2023-09-12T16:07:30.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.262+0000 7fd4947ff700 1 -- 172.21.15.112:0/1412238638 wait complete. 2023-09-12T16:07:30.280 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-12T16:06:48.871680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-12T16:06:58.137223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-12T16:06:58.684034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-12T16:07:02.283459+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-12T16:07:30.281 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-12T16:07:30.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.482+0000 7f05505ff700 1 -- 172.21.15.112:0/2527412410 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f054815bca0 msgr2=0x7f054815cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:30.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.482+0000 7f05505ff700 1 --2- 172.21.15.112:0/2527412410 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f054815bca0 0x7f054815cb90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0544005fd0 tx=0x7f0544009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:30.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.482+0000 7f05505ff700 1 -- 172.21.15.112:0/2527412410 shutdown_connections 2023-09-12T16:07:30.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.482+0000 7f05505ff700 1 --2- 172.21.15.112:0/2527412410 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f054815bca0 0x7f054815cb90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:30.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.482+0000 7f05505ff700 1 --2- 172.21.15.112:0/2527412410 >> v2:172.21.15.144:3300/0 conn(0x7f05480cf5b0 0x7f05480cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:30.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.482+0000 7f05505ff700 1 -- 172.21.15.112:0/2527412410 >> 172.21.15.112:0/2527412410 conn(0x7f05480d17d0 msgr2=0x7f05480d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:30.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.482+0000 7f05505ff700 1 -- 172.21.15.112:0/2527412410 shutdown_connections 2023-09-12T16:07:30.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.482+0000 7f05505ff700 1 -- 172.21.15.112:0/2527412410 wait complete. 2023-09-12T16:07:30.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.484+0000 7f05505ff700 1 Processor -- start 2023-09-12T16:07:30.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.484+0000 7f05505ff700 1 -- start start 2023-09-12T16:07:30.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.485+0000 7f05505ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05480cfdb0 0x7f05480c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:30.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.485+0000 7f05505ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f054815bca0 0x7f05480c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:30.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.485+0000 7f05505ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05481f4720 0x7f054806bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:30.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.485+0000 7f05505ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05480c81e0 con 0x7f05480cfdb0 2023-09-12T16:07:30.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.485+0000 7f05505ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05480c7660 con 0x7f05481f4720 2023-09-12T16:07:30.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.485+0000 7f05505ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05480c7940 con 0x7f054815bca0 2023-09-12T16:07:30.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.485+0000 7f054e39b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05480cfdb0 0x7f05480c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:30.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.485+0000 7f054e39b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05480cfdb0 0x7f05480c6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52422/0 (socket says 172.21.15.112:52422) 2023-09-12T16:07:30.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.485+0000 7f054e39b700 1 -- 172.21.15.112:0/93835570 learned_addr learned my addr 172.21.15.112:0/93835570 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:30.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.485+0000 7f054db9a700 1 --2- 172.21.15.112:0/93835570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f054815bca0 0x7f05480c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:30.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.485+0000 7f054eb9c700 1 --2- 172.21.15.112:0/93835570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05481f4720 0x7f054806bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:30.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.486+0000 7f054e39b700 1 -- 172.21.15.112:0/93835570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f054815bca0 msgr2=0x7f05480c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:30.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.486+0000 7f054e39b700 1 --2- 172.21.15.112:0/93835570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f054815bca0 0x7f05480c5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:30.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.486+0000 7f054e39b700 1 -- 172.21.15.112:0/93835570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05481f4720 msgr2=0x7f054806bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:30.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.486+0000 7f054e39b700 1 --2- 172.21.15.112:0/93835570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05481f4720 0x7f054806bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:30.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.486+0000 7f054e39b700 1 -- 172.21.15.112:0/93835570 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0538009520 con 0x7f05480cfdb0 2023-09-12T16:07:30.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.486+0000 7f054eb9c700 1 --2- 172.21.15.112:0/93835570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05481f4720 0x7f054806bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:07:30.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.486+0000 7f054e39b700 1 --2- 172.21.15.112:0/93835570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05480cfdb0 0x7f05480c6f80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f05440098e0 tx=0x7f0544003ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:30.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.486+0000 7f053effd700 1 -- 172.21.15.112:0/93835570 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054401c070 con 0x7f05480cfdb0 2023-09-12T16:07:30.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.486+0000 7f053effd700 1 -- 172.21.15.112:0/93835570 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f054400b820 con 0x7f05480cfdb0 2023-09-12T16:07:30.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.486+0000 7f05505ff700 1 -- 172.21.15.112:0/93835570 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05440095f0 con 0x7f05480cfdb0 2023-09-12T16:07:30.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.486+0000 7f053effd700 1 -- 172.21.15.112:0/93835570 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054400bc30 con 0x7f05480cfdb0 2023-09-12T16:07:30.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.486+0000 7f05505ff700 1 -- 172.21.15.112:0/93835570 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05480c7f00 con 0x7f05480cfdb0 2023-09-12T16:07:30.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.487+0000 7f05505ff700 1 -- 172.21.15.112:0/93835570 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0548073ea0 con 0x7f05480cfdb0 2023-09-12T16:07:30.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.488+0000 7f053effd700 1 -- 172.21.15.112:0/93835570 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f054400bd90 con 0x7f05480cfdb0 2023-09-12T16:07:30.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.489+0000 7f053effd700 1 --2- 172.21.15.112:0/93835570 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f052c06a5b0 0x7f052c06ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:30.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.489+0000 7f053effd700 1 -- 172.21.15.112:0/93835570 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f054408a1b0 con 0x7f05480cfdb0 2023-09-12T16:07:30.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.489+0000 7f054db9a700 1 --2- 172.21.15.112:0/93835570 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f052c06a5b0 0x7f052c06ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:30.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.490+0000 7f054db9a700 1 --2- 172.21.15.112:0/93835570 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f052c06a5b0 0x7f052c06ca70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f05480cd240 tx=0x7f0538009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:30.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.493+0000 7f053effd700 1 -- 172.21.15.112:0/93835570 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f0544055320 con 0x7f05480cfdb0 2023-09-12T16:07:30.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.687+0000 7f05505ff700 1 -- 172.21.15.112:0/93835570 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f054808b860 con 0x7f05480cfdb0 2023-09-12T16:07:30.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.688+0000 7f053effd700 1 -- 172.21.15.112:0/93835570 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0544005c00 con 0x7f05480cfdb0 2023-09-12T16:07:30.688 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-09-12T16:07:30.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.690+0000 7f05505ff700 1 -- 172.21.15.112:0/93835570 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f052c06a5b0 msgr2=0x7f052c06ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:30.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.690+0000 7f05505ff700 1 --2- 172.21.15.112:0/93835570 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f052c06a5b0 0x7f052c06ca70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f05480cd240 tx=0x7f0538009260 comp rx=0 tx=0).stop 2023-09-12T16:07:30.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.690+0000 7f05505ff700 1 -- 172.21.15.112:0/93835570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05480cfdb0 msgr2=0x7f05480c6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:30.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.690+0000 7f05505ff700 1 --2- 172.21.15.112:0/93835570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05480cfdb0 0x7f05480c6f80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f05440098e0 tx=0x7f0544003ca0 comp rx=0 tx=0).stop 2023-09-12T16:07:30.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.690+0000 7f05505ff700 1 -- 172.21.15.112:0/93835570 shutdown_connections 2023-09-12T16:07:30.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.690+0000 7f05505ff700 1 --2- 172.21.15.112:0/93835570 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f052c06a5b0 0x7f052c06ca70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:30.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.690+0000 7f05505ff700 1 --2- 172.21.15.112:0/93835570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05481f4720 0x7f054806bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:30.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.690+0000 7f05505ff700 1 --2- 172.21.15.112:0/93835570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05480cfdb0 0x7f05480c6f80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:30.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.690+0000 7f05505ff700 1 --2- 172.21.15.112:0/93835570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f054815bca0 0x7f05480c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:30.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.690+0000 7f05505ff700 1 -- 172.21.15.112:0/93835570 >> 172.21.15.112:0/93835570 conn(0x7f05480d17d0 msgr2=0x7f05480cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:30.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.690+0000 7f05505ff700 1 -- 172.21.15.112:0/93835570 shutdown_connections 2023-09-12T16:07:30.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.690+0000 7f05505ff700 1 -- 172.21.15.112:0/93835570 wait complete. 2023-09-12T16:07:30.708 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-12T16:07:30.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.911+0000 7fddf37ff700 1 -- 172.21.15.112:0/1268925681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddd8003bc0 msgr2=0x7fddd8003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:30.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.911+0000 7fddf37ff700 1 --2- 172.21.15.112:0/1268925681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddd8003bc0 0x7fddd8003fc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdde80018b0 tx=0x7fddd8005880 comp rx=0 tx=0).stop 2023-09-12T16:07:30.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.911+0000 7fddf1d9c700 1 -- 172.21.15.112:0/1268925681 reap_dead start 2023-09-12T16:07:30.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.912+0000 7fddf37ff700 1 -- 172.21.15.112:0/1268925681 shutdown_connections 2023-09-12T16:07:30.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.912+0000 7fddf37ff700 1 -- 172.21.15.112:0/1268925681 >> 172.21.15.112:0/1268925681 conn(0x7fddec09aa90 msgr2=0x7fddec0d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:30.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.912+0000 7fddf37ff700 1 -- 172.21.15.112:0/1268925681 shutdown_connections 2023-09-12T16:07:30.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.912+0000 7fddf37ff700 1 -- 172.21.15.112:0/1268925681 wait complete. 2023-09-12T16:07:30.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.913+0000 7fddf37ff700 1 Processor -- start 2023-09-12T16:07:30.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.913+0000 7fddf37ff700 1 -- start start 2023-09-12T16:07:30.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.914+0000 7fddf37ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddd8003bc0 0x7fddec1507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:30.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.914+0000 7fddf37ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddec0c7730 0x7fddec15d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:30.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.914+0000 7fddf37ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddec1e63a0 0x7fddec1e6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:30.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.914+0000 7fddf37ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec1e6d90 con 0x7fddd8003bc0 2023-09-12T16:07:30.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.914+0000 7fddf37ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec150d20 con 0x7fddec1e63a0 2023-09-12T16:07:30.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.914+0000 7fddf37ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0c72a0 con 0x7fddec0c7730 2023-09-12T16:07:30.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.914+0000 7fddf159b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddd8003bc0 0x7fddec1507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:30.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.915+0000 7fddf159b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddd8003bc0 0x7fddec1507e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52426/0 (socket says 172.21.15.112:52426) 2023-09-12T16:07:30.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.915+0000 7fddf159b700 1 -- 172.21.15.112:0/977282117 learned_addr learned my addr 172.21.15.112:0/977282117 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:30.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.915+0000 7fddf0d9a700 1 --2- 172.21.15.112:0/977282117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddec0c7730 0x7fddec15d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:30.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.915+0000 7fddf1d9c700 1 --2- 172.21.15.112:0/977282117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddec1e63a0 0x7fddec1e6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:30.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.915+0000 7fddf159b700 1 -- 172.21.15.112:0/977282117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddec0c7730 msgr2=0x7fddec15d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:30.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.915+0000 7fddf159b700 1 --2- 172.21.15.112:0/977282117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddec0c7730 0x7fddec15d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:30.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.915+0000 7fddf159b700 1 -- 172.21.15.112:0/977282117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddec1e63a0 msgr2=0x7fddec1e6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:30.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.915+0000 7fddf159b700 1 --2- 172.21.15.112:0/977282117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddec1e63a0 0x7fddec1e6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:30.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.915+0000 7fddf159b700 1 -- 172.21.15.112:0/977282117 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec0cfe40 con 0x7fddd8003bc0 2023-09-12T16:07:30.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.915+0000 7fddf159b700 1 --2- 172.21.15.112:0/977282117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddd8003bc0 0x7fddec1507e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdde8003930 tx=0x7fdde8003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:30.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.915+0000 7fdde1ffb700 1 -- 172.21.15.112:0/977282117 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8015040 con 0x7fddd8003bc0 2023-09-12T16:07:30.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.915+0000 7fdde1ffb700 1 -- 172.21.15.112:0/977282117 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdde800c900 con 0x7fddd8003bc0 2023-09-12T16:07:30.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.915+0000 7fddf37ff700 1 -- 172.21.15.112:0/977282117 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddec15ebc0 con 0x7fddd8003bc0 2023-09-12T16:07:30.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.915+0000 7fdde1ffb700 1 -- 172.21.15.112:0/977282117 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8001110 con 0x7fddd8003bc0 2023-09-12T16:07:30.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.916+0000 7fddf37ff700 1 -- 172.21.15.112:0/977282117 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddec0c6970 con 0x7fddd8003bc0 2023-09-12T16:07:30.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.917+0000 7fddf37ff700 1 -- 172.21.15.112:0/977282117 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddec0c7580 con 0x7fddd8003bc0 2023-09-12T16:07:30.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.917+0000 7fdde1ffb700 1 -- 172.21.15.112:0/977282117 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fdde800cd10 con 0x7fddd8003bc0 2023-09-12T16:07:30.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.918+0000 7fdde1ffb700 1 --2- 172.21.15.112:0/977282117 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fddd006a5b0 0x7fddd006ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:30.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.918+0000 7fdde1ffb700 1 -- 172.21.15.112:0/977282117 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdde808a1f0 con 0x7fddd8003bc0 2023-09-12T16:07:30.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.919+0000 7fddf0d9a700 1 --2- 172.21.15.112:0/977282117 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fddd006a5b0 0x7fddd006ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:30.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.919+0000 7fddf0d9a700 1 --2- 172.21.15.112:0/977282117 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fddd006a5b0 0x7fddd006ca70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fddec0c7b50 tx=0x7fdddc009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:30.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:30.923+0000 7fdde1ffb700 1 -- 172.21.15.112:0/977282117 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fdde8055510 con 0x7fddd8003bc0 2023-09-12T16:07:31.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.122+0000 7fddf37ff700 1 -- 172.21.15.112:0/977282117 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fddec072940 con 0x7fddd8003bc0 2023-09-12T16:07:31.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.122+0000 7fdde1ffb700 1 -- 172.21.15.112:0/977282117 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdde8058b30 con 0x7fddd8003bc0 2023-09-12T16:07:31.123 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:07:31.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.125+0000 7fddf37ff700 1 -- 172.21.15.112:0/977282117 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fddd006a5b0 msgr2=0x7fddd006ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:31.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.125+0000 7fddf37ff700 1 --2- 172.21.15.112:0/977282117 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fddd006a5b0 0x7fddd006ca70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fddec0c7b50 tx=0x7fdddc009260 comp rx=0 tx=0).stop 2023-09-12T16:07:31.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.125+0000 7fddf37ff700 1 -- 172.21.15.112:0/977282117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddd8003bc0 msgr2=0x7fddec1507e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:31.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.125+0000 7fddf37ff700 1 --2- 172.21.15.112:0/977282117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddd8003bc0 0x7fddec1507e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdde8003930 tx=0x7fdde8003960 comp rx=0 tx=0).stop 2023-09-12T16:07:31.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.125+0000 7fddf37ff700 1 -- 172.21.15.112:0/977282117 shutdown_connections 2023-09-12T16:07:31.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.125+0000 7fddf37ff700 1 --2- 172.21.15.112:0/977282117 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fddd006a5b0 0x7fddd006ca70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.125+0000 7fddf37ff700 1 --2- 172.21.15.112:0/977282117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddec1e63a0 0x7fddec1e6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.125+0000 7fddf37ff700 1 --2- 172.21.15.112:0/977282117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddd8003bc0 0x7fddec1507e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.125+0000 7fddf37ff700 1 --2- 172.21.15.112:0/977282117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddec0c7730 0x7fddec15d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.125+0000 7fddf37ff700 1 -- 172.21.15.112:0/977282117 >> 172.21.15.112:0/977282117 conn(0x7fddec09aa90 msgr2=0x7fddec0b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:31.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.125+0000 7fddf37ff700 1 -- 172.21.15.112:0/977282117 shutdown_connections 2023-09-12T16:07:31.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.125+0000 7fddf37ff700 1 -- 172.21.15.112:0/977282117 wait complete. 2023-09-12T16:07:31.143 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-12T16:07:31.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.347+0000 7fd9bedff700 1 -- 172.21.15.112:0/1591379447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9b815bca0 msgr2=0x7fd9b815cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:31.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.347+0000 7fd9bedff700 1 --2- 172.21.15.112:0/1591379447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9b815bca0 0x7fd9b815cb90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd9b80cbed0 tx=0x7fd9ac009ba0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.348+0000 7fd9bedff700 1 -- 172.21.15.112:0/1591379447 shutdown_connections 2023-09-12T16:07:31.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.348+0000 7fd9bedff700 1 --2- 172.21.15.112:0/1591379447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9b815bca0 0x7fd9b815cb90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.348+0000 7fd9bedff700 1 --2- 172.21.15.112:0/1591379447 >> v2:172.21.15.144:3300/0 conn(0x7fd9b80cf5b0 0x7fd9b80cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.348+0000 7fd9bedff700 1 -- 172.21.15.112:0/1591379447 >> 172.21.15.112:0/1591379447 conn(0x7fd9b80d17d0 msgr2=0x7fd9b80d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:31.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.348+0000 7fd9bedff700 1 -- 172.21.15.112:0/1591379447 shutdown_connections 2023-09-12T16:07:31.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.348+0000 7fd9bedff700 1 -- 172.21.15.112:0/1591379447 wait complete. 2023-09-12T16:07:31.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.349+0000 7fd9bedff700 1 Processor -- start 2023-09-12T16:07:31.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.349+0000 7fd9bedff700 1 -- start start 2023-09-12T16:07:31.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.350+0000 7fd9bedff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9b80cfdb0 0x7fd9b814ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:31.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.350+0000 7fd9bedff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9b815bca0 0x7fd9b806c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:31.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.350+0000 7fd9bedff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9b814b320 0x7fd9b806c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:31.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.350+0000 7fd9bedff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b80c5300 con 0x7fd9b80cfdb0 2023-09-12T16:07:31.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.350+0000 7fd9bedff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b80c5ba0 con 0x7fd9b815bca0 2023-09-12T16:07:31.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.350+0000 7fd9bedff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b80c98b0 con 0x7fd9b814b320 2023-09-12T16:07:31.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.351+0000 7fd9bcb9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9b80cfdb0 0x7fd9b814ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:31.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.351+0000 7fd9bcb9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9b80cfdb0 0x7fd9b814ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52438/0 (socket says 172.21.15.112:52438) 2023-09-12T16:07:31.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.351+0000 7fd9bcb9b700 1 -- 172.21.15.112:0/3115803294 learned_addr learned my addr 172.21.15.112:0/3115803294 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:31.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.351+0000 7fd9b7fff700 1 --2- 172.21.15.112:0/3115803294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9b815bca0 0x7fd9b806c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:31.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.351+0000 7fd9bd39c700 1 --2- 172.21.15.112:0/3115803294 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9b814b320 0x7fd9b806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:31.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.351+0000 7fd9bcb9b700 1 -- 172.21.15.112:0/3115803294 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9b814b320 msgr2=0x7fd9b806c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:31.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.351+0000 7fd9bcb9b700 1 --2- 172.21.15.112:0/3115803294 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9b814b320 0x7fd9b806c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.351+0000 7fd9bcb9b700 1 -- 172.21.15.112:0/3115803294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9b815bca0 msgr2=0x7fd9b806c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:31.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.351+0000 7fd9bcb9b700 1 --2- 172.21.15.112:0/3115803294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9b815bca0 0x7fd9b806c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.351+0000 7fd9bcb9b700 1 -- 172.21.15.112:0/3115803294 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac009520 con 0x7fd9b80cfdb0 2023-09-12T16:07:31.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.351+0000 7fd9b7fff700 1 --2- 172.21.15.112:0/3115803294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9b815bca0 0x7fd9b806c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:07:31.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.351+0000 7fd9bcb9b700 1 --2- 172.21.15.112:0/3115803294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9b80cfdb0 0x7fd9b814ade0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac000c00 tx=0x7fd9ac00f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:31.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.352+0000 7fd9b57fa700 1 -- 172.21.15.112:0/3115803294 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac01b070 con 0x7fd9b80cfdb0 2023-09-12T16:07:31.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.352+0000 7fd9b57fa700 1 -- 172.21.15.112:0/3115803294 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd9ac00fa60 con 0x7fd9b80cfdb0 2023-09-12T16:07:31.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.352+0000 7fd9bedff700 1 -- 172.21.15.112:0/3115803294 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b80c5550 con 0x7fd9b80cfdb0 2023-09-12T16:07:31.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.352+0000 7fd9b57fa700 1 -- 172.21.15.112:0/3115803294 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac00fe70 con 0x7fd9b80cfdb0 2023-09-12T16:07:31.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.352+0000 7fd9bedff700 1 -- 172.21.15.112:0/3115803294 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b80c8b40 con 0x7fd9b80cfdb0 2023-09-12T16:07:31.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.353+0000 7fd9bedff700 1 -- 172.21.15.112:0/3115803294 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b8073ea0 con 0x7fd9b80cfdb0 2023-09-12T16:07:31.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.354+0000 7fd9b57fa700 1 -- 172.21.15.112:0/3115803294 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fd9ac02a400 con 0x7fd9b80cfdb0 2023-09-12T16:07:31.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.355+0000 7fd9b57fa700 1 --2- 172.21.15.112:0/3115803294 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd99c06a580 0x7fd99c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:31.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.355+0000 7fd9b57fa700 1 -- 172.21.15.112:0/3115803294 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd9ac08a9b0 con 0x7fd9b80cfdb0 2023-09-12T16:07:31.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.355+0000 7fd9b7fff700 1 --2- 172.21.15.112:0/3115803294 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd99c06a580 0x7fd99c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:31.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.355+0000 7fd9b7fff700 1 --2- 172.21.15.112:0/3115803294 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd99c06a580 0x7fd99c06ca40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4005950 tx=0x7fd9a40058e0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:31.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.359+0000 7fd9b57fa700 1 -- 172.21.15.112:0/3115803294 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd9ac055c40 con 0x7fd9b80cfdb0 2023-09-12T16:07:31.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.558+0000 7fd9bedff700 1 -- 172.21.15.112:0/3115803294 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd9b808b860 con 0x7fd9b80cfdb0 2023-09-12T16:07:31.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.559+0000 7fd9b57fa700 1 -- 172.21.15.112:0/3115803294 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd9ac059260 con 0x7fd9b80cfdb0 2023-09-12T16:07:31.559 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-09-12T16:07:31.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.561+0000 7fd9bedff700 1 -- 172.21.15.112:0/3115803294 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd99c06a580 msgr2=0x7fd99c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:31.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.561+0000 7fd9bedff700 1 --2- 172.21.15.112:0/3115803294 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd99c06a580 0x7fd99c06ca40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4005950 tx=0x7fd9a40058e0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.561+0000 7fd9bedff700 1 -- 172.21.15.112:0/3115803294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9b80cfdb0 msgr2=0x7fd9b814ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:31.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.561+0000 7fd9bedff700 1 --2- 172.21.15.112:0/3115803294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9b80cfdb0 0x7fd9b814ade0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac000c00 tx=0x7fd9ac00f7c0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.561+0000 7fd9bedff700 1 -- 172.21.15.112:0/3115803294 shutdown_connections 2023-09-12T16:07:31.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.561+0000 7fd9bedff700 1 --2- 172.21.15.112:0/3115803294 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd99c06a580 0x7fd99c06ca40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.561+0000 7fd9bedff700 1 --2- 172.21.15.112:0/3115803294 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9b814b320 0x7fd9b806c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.561+0000 7fd9bedff700 1 --2- 172.21.15.112:0/3115803294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9b80cfdb0 0x7fd9b814ade0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.561+0000 7fd9bedff700 1 --2- 172.21.15.112:0/3115803294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9b815bca0 0x7fd9b806c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.561+0000 7fd9bedff700 1 -- 172.21.15.112:0/3115803294 >> 172.21.15.112:0/3115803294 conn(0x7fd9b80d17d0 msgr2=0x7fd9b815afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:31.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.561+0000 7fd9bedff700 1 -- 172.21.15.112:0/3115803294 shutdown_connections 2023-09-12T16:07:31.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.561+0000 7fd9bedff700 1 -- 172.21.15.112:0/3115803294 wait complete. 2023-09-12T16:07:31.579 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-12T16:07:31.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.781+0000 7f9ddbbff700 1 -- 172.21.15.112:0/2980908150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd415bca0 msgr2=0x7f9dd415cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:31.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.781+0000 7f9ddbbff700 1 --2- 172.21.15.112:0/2980908150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd415bca0 0x7f9dd415cb90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40cbdb0 tx=0x7f9dd0009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:31.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.782+0000 7f9ddbbff700 1 -- 172.21.15.112:0/2980908150 shutdown_connections 2023-09-12T16:07:31.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.782+0000 7f9ddbbff700 1 --2- 172.21.15.112:0/2980908150 >> v2:172.21.15.144:3300/0 conn(0x7f9dd40cfdb0 0x7f9dd40d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.782+0000 7f9ddbbff700 1 --2- 172.21.15.112:0/2980908150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd415bca0 0x7f9dd415cb90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.782+0000 7f9ddbbff700 1 -- 172.21.15.112:0/2980908150 >> 172.21.15.112:0/2980908150 conn(0x7f9dd40d17d0 msgr2=0x7f9dd40d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:31.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.782+0000 7f9ddbbff700 1 -- 172.21.15.112:0/2980908150 shutdown_connections 2023-09-12T16:07:31.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.782+0000 7f9ddbbff700 1 -- 172.21.15.112:0/2980908150 wait complete. 2023-09-12T16:07:31.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.783+0000 7f9ddbbff700 1 Processor -- start 2023-09-12T16:07:31.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.784+0000 7f9ddbbff700 1 -- start start 2023-09-12T16:07:31.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.784+0000 7f9ddbbff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd40cfdb0 0x7f9dd40c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:31.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.785+0000 7f9ddbbff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9dd415bca0 0x7f9dd41f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:31.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.785+0000 7f9ddbbff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dd40c5300 0x7f9dd40c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:31.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.785+0000 7f9ddbbff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd40c5cd0 con 0x7f9dd40cfdb0 2023-09-12T16:07:31.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.785+0000 7f9ddbbff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd40ca9c0 con 0x7f9dd40c5300 2023-09-12T16:07:31.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.785+0000 7f9ddbbff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd41f2480 con 0x7f9dd415bca0 2023-09-12T16:07:31.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.785+0000 7f9dd999b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd40cfdb0 0x7f9dd40c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:31.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.785+0000 7f9dd999b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd40cfdb0 0x7f9dd40c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52464/0 (socket says 172.21.15.112:52464) 2023-09-12T16:07:31.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.785+0000 7f9dd999b700 1 -- 172.21.15.112:0/1724197218 learned_addr learned my addr 172.21.15.112:0/1724197218 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:31.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.785+0000 7f9dd919a700 1 --2- 172.21.15.112:0/1724197218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9dd415bca0 0x7f9dd41f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:31.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.785+0000 7f9dda19c700 1 --2- 172.21.15.112:0/1724197218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dd40c5300 0x7f9dd40c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:31.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.785+0000 7f9dd999b700 1 -- 172.21.15.112:0/1724197218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9dd415bca0 msgr2=0x7f9dd41f1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:31.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.785+0000 7f9dd999b700 1 --2- 172.21.15.112:0/1724197218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9dd415bca0 0x7f9dd41f1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.785+0000 7f9dd999b700 1 -- 172.21.15.112:0/1724197218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dd40c5300 msgr2=0x7f9dd40c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:31.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.785+0000 7f9dd999b700 1 --2- 172.21.15.112:0/1724197218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dd40c5300 0x7f9dd40c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.785+0000 7f9dd999b700 1 -- 172.21.15.112:0/1724197218 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd00095f0 con 0x7f9dd40cfdb0 2023-09-12T16:07:31.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.785+0000 7f9dda19c700 1 --2- 172.21.15.112:0/1724197218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dd40c5300 0x7f9dd40c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:31.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.785+0000 7f9dd999b700 1 --2- 172.21.15.112:0/1724197218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd40cfdb0 0x7f9dd40c7e40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9dd408a940 tx=0x7f9dd000beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:31.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.786+0000 7f9dca7fc700 1 -- 172.21.15.112:0/1724197218 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd001c070 con 0x7f9dd40cfdb0 2023-09-12T16:07:31.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.786+0000 7f9dca7fc700 1 -- 172.21.15.112:0/1724197218 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9dd0003890 con 0x7f9dd40cfdb0 2023-09-12T16:07:31.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.786+0000 7f9dca7fc700 1 -- 172.21.15.112:0/1724197218 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0003c40 con 0x7f9dd40cfdb0 2023-09-12T16:07:31.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.786+0000 7f9ddbbff700 1 -- 172.21.15.112:0/1724197218 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd40c9db0 con 0x7f9dd40cfdb0 2023-09-12T16:07:31.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.786+0000 7f9ddbbff700 1 -- 172.21.15.112:0/1724197218 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd40ca370 con 0x7f9dd40cfdb0 2023-09-12T16:07:31.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.787+0000 7f9ddbbff700 1 -- 172.21.15.112:0/1724197218 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd40b05a0 con 0x7f9dd40cfdb0 2023-09-12T16:07:31.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.788+0000 7f9dca7fc700 1 -- 172.21.15.112:0/1724197218 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f9dd000f460 con 0x7f9dd40cfdb0 2023-09-12T16:07:31.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.788+0000 7f9dca7fc700 1 --2- 172.21.15.112:0/1724197218 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9db806a580 0x7f9db806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:31.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.789+0000 7f9dca7fc700 1 -- 172.21.15.112:0/1724197218 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9dd008a1e0 con 0x7f9dd40cfdb0 2023-09-12T16:07:31.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.789+0000 7f9dd919a700 1 --2- 172.21.15.112:0/1724197218 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9db806a580 0x7f9db806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:31.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.789+0000 7f9dd919a700 1 --2- 172.21.15.112:0/1724197218 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9db806a580 0x7f9db806ca40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9dd41f6cb0 tx=0x7f9dc4009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:31.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.793+0000 7f9dca7fc700 1 -- 172.21.15.112:0/1724197218 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f9dd0055460 con 0x7f9dd40cfdb0 2023-09-12T16:07:31.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.990+0000 7f9ddbbff700 1 -- 172.21.15.112:0/1724197218 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9dd4073ea0 con 0x7f9dd40cfdb0 2023-09-12T16:07:31.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.990+0000 7f9dca7fc700 1 -- 172.21.15.112:0/1724197218 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9dd0025020 con 0x7f9dd40cfdb0 2023-09-12T16:07:31.991 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:07:31.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.993+0000 7f9ddbbff700 1 -- 172.21.15.112:0/1724197218 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9db806a580 msgr2=0x7f9db806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:31.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.993+0000 7f9ddbbff700 1 --2- 172.21.15.112:0/1724197218 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9db806a580 0x7f9db806ca40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9dd41f6cb0 tx=0x7f9dc4009040 comp rx=0 tx=0).stop 2023-09-12T16:07:31.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.993+0000 7f9ddbbff700 1 -- 172.21.15.112:0/1724197218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd40cfdb0 msgr2=0x7f9dd40c7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:31.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.993+0000 7f9ddbbff700 1 --2- 172.21.15.112:0/1724197218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd40cfdb0 0x7f9dd40c7e40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9dd408a940 tx=0x7f9dd000beb0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.993+0000 7f9ddbbff700 1 -- 172.21.15.112:0/1724197218 shutdown_connections 2023-09-12T16:07:31.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.993+0000 7f9ddbbff700 1 --2- 172.21.15.112:0/1724197218 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f9db806a580 0x7f9db806ca40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.993+0000 7f9ddbbff700 1 --2- 172.21.15.112:0/1724197218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dd40c5300 0x7f9dd40c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.993+0000 7f9ddbbff700 1 --2- 172.21.15.112:0/1724197218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd40cfdb0 0x7f9dd40c7e40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.993+0000 7f9ddbbff700 1 --2- 172.21.15.112:0/1724197218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9dd415bca0 0x7f9dd41f1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:31.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.993+0000 7f9ddbbff700 1 -- 172.21.15.112:0/1724197218 >> 172.21.15.112:0/1724197218 conn(0x7f9dd40d17d0 msgr2=0x7f9dd415aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:31.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.993+0000 7f9ddbbff700 1 -- 172.21.15.112:0/1724197218 shutdown_connections 2023-09-12T16:07:31.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:31.993+0000 7f9ddbbff700 1 -- 172.21.15.112:0/1724197218 wait complete. 2023-09-12T16:07:32.011 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-12T16:07:32.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.210+0000 7f88375ff700 1 -- 172.21.15.112:0/1273631534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f883015f480 msgr2=0x7f88300cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:32.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.210+0000 7f88375ff700 1 --2- 172.21.15.112:0/1273631534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f883015f480 0x7f88300cfe80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f882c0098b0 tx=0x7f882c009bc0 comp rx=0 tx=0).stop 2023-09-12T16:07:32.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.210+0000 7f88375ff700 1 -- 172.21.15.112:0/1273631534 shutdown_connections 2023-09-12T16:07:32.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.210+0000 7f88375ff700 1 --2- 172.21.15.112:0/1273631534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f883015f480 0x7f88300cfe80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:32.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.210+0000 7f88375ff700 1 -- 172.21.15.112:0/1273631534 >> 172.21.15.112:0/1273631534 conn(0x7f88300d1930 msgr2=0x7f88300d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:32.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.210+0000 7f88375ff700 1 -- 172.21.15.112:0/1273631534 shutdown_connections 2023-09-12T16:07:32.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.210+0000 7f88375ff700 1 -- 172.21.15.112:0/1273631534 wait complete. 2023-09-12T16:07:32.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.213+0000 7f88375ff700 1 Processor -- start 2023-09-12T16:07:32.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.213+0000 7f88375ff700 1 -- start start 2023-09-12T16:07:32.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.214+0000 7f88375ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88300b28f0 0x7f88300b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:32.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.214+0000 7f88375ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88300cdfb0 0x7f88300c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:32.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.214+0000 7f88375ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f883015f480 0x7f8830148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:32.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.214+0000 7f88375ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88300c9f30 con 0x7f88300b28f0 2023-09-12T16:07:32.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.214+0000 7f88375ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88300b4fd0 con 0x7f88300cdfb0 2023-09-12T16:07:32.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.214+0000 7f88375ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88300b52b0 con 0x7f883015f480 2023-09-12T16:07:32.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.214+0000 7f883539b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88300b28f0 0x7f88300b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:32.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.214+0000 7f883539b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88300b28f0 0x7f88300b5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52472/0 (socket says 172.21.15.112:52472) 2023-09-12T16:07:32.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.214+0000 7f883539b700 1 -- 172.21.15.112:0/3828867203 learned_addr learned my addr 172.21.15.112:0/3828867203 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:32.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.214+0000 7f8835b9c700 1 --2- 172.21.15.112:0/3828867203 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f883015f480 0x7f8830148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:32.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.214+0000 7f8834b9a700 1 --2- 172.21.15.112:0/3828867203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88300cdfb0 0x7f88300c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:32.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.215+0000 7f883539b700 1 -- 172.21.15.112:0/3828867203 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f883015f480 msgr2=0x7f8830148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:32.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.215+0000 7f883539b700 1 --2- 172.21.15.112:0/3828867203 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f883015f480 0x7f8830148cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:32.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.215+0000 7f883539b700 1 -- 172.21.15.112:0/3828867203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88300cdfb0 msgr2=0x7f88300c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:32.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.215+0000 7f883539b700 1 --2- 172.21.15.112:0/3828867203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88300cdfb0 0x7f88300c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:32.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.215+0000 7f883539b700 1 -- 172.21.15.112:0/3828867203 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c0094c0 con 0x7f88300b28f0 2023-09-12T16:07:32.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.215+0000 7f883539b700 1 --2- 172.21.15.112:0/3828867203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88300b28f0 0x7f88300b5d90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f882c000c00 tx=0x7f882c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:32.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.215+0000 7f8825ffb700 1 -- 172.21.15.112:0/3828867203 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c01c070 con 0x7f88300b28f0 2023-09-12T16:07:32.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.215+0000 7f8825ffb700 1 -- 172.21.15.112:0/3828867203 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f882c003e10 con 0x7f88300b28f0 2023-09-12T16:07:32.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.215+0000 7f88375ff700 1 -- 172.21.15.112:0/3828867203 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88300b5590 con 0x7f88300b28f0 2023-09-12T16:07:32.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.215+0000 7f8825ffb700 1 -- 172.21.15.112:0/3828867203 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c00f8d0 con 0x7f88300b28f0 2023-09-12T16:07:32.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.216+0000 7f88375ff700 1 -- 172.21.15.112:0/3828867203 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8830149210 con 0x7f88300b28f0 2023-09-12T16:07:32.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.217+0000 7f88375ff700 1 -- 172.21.15.112:0/3828867203 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8830066f00 con 0x7f88300b28f0 2023-09-12T16:07:32.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.217+0000 7f8825ffb700 1 -- 172.21.15.112:0/3828867203 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f882c00fa30 con 0x7f88300b28f0 2023-09-12T16:07:32.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.219+0000 7f8825ffb700 1 --2- 172.21.15.112:0/3828867203 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f881406a580 0x7f881406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:32.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.219+0000 7f8825ffb700 1 -- 172.21.15.112:0/3828867203 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f882c089d90 con 0x7f88300b28f0 2023-09-12T16:07:32.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.219+0000 7f8834b9a700 1 --2- 172.21.15.112:0/3828867203 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f881406a580 0x7f881406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:32.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.220+0000 7f8834b9a700 1 --2- 172.21.15.112:0/3828867203 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f881406a580 0x7f881406ca40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f88300b64d0 tx=0x7f8820009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:32.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.223+0000 7f8825ffb700 1 -- 172.21.15.112:0/3828867203 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f882c055170 con 0x7f88300b28f0 2023-09-12T16:07:32.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.464+0000 7f88375ff700 1 -- 172.21.15.112:0/3828867203 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88300b5ab0 con 0x7f88300b28f0 2023-09-12T16:07:32.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.465+0000 7f8825ffb700 1 -- 172.21.15.112:0/3828867203 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f882c058790 con 0x7f88300b28f0 2023-09-12T16:07:32.465 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:32.466 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3995117138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3995117138},{"type":"v1","addr":"172.21.15.112:6836","nonce":3995117138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3233826602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3233826602},{"type":"v1","addr":"172.21.15.112:6837","nonce":3233826602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1854265710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1854265710},{"type":"v1","addr":"172.21.15.144:6834","nonce":1854265710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-12T16:06:59.697334+0000","modified":"2023-09-12T16:07:20.393475+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4396":{"gid":4396,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/2785398652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2785398652},{"type":"v1","addr":"172.21.15.144:6835","nonce":2785398652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-12T16:07:32.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.467+0000 7f88375ff700 1 -- 172.21.15.112:0/3828867203 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f881406a580 msgr2=0x7f881406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:32.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.467+0000 7f88375ff700 1 --2- 172.21.15.112:0/3828867203 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f881406a580 0x7f881406ca40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f88300b64d0 tx=0x7f8820009040 comp rx=0 tx=0).stop 2023-09-12T16:07:32.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.467+0000 7f88375ff700 1 -- 172.21.15.112:0/3828867203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88300b28f0 msgr2=0x7f88300b5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:32.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.467+0000 7f88375ff700 1 --2- 172.21.15.112:0/3828867203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88300b28f0 0x7f88300b5d90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f882c000c00 tx=0x7f882c003c20 comp rx=0 tx=0).stop 2023-09-12T16:07:32.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.467+0000 7f88375ff700 1 -- 172.21.15.112:0/3828867203 shutdown_connections 2023-09-12T16:07:32.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.467+0000 7f88375ff700 1 --2- 172.21.15.112:0/3828867203 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f881406a580 0x7f881406ca40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:32.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.467+0000 7f88375ff700 1 --2- 172.21.15.112:0/3828867203 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f883015f480 0x7f8830148cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:32.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.467+0000 7f88375ff700 1 --2- 172.21.15.112:0/3828867203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88300b28f0 0x7f88300b5d90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:32.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.467+0000 7f88375ff700 1 --2- 172.21.15.112:0/3828867203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88300cdfb0 0x7f88300c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:32.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.467+0000 7f88375ff700 1 -- 172.21.15.112:0/3828867203 >> 172.21.15.112:0/3828867203 conn(0x7f88300d1930 msgr2=0x7f88300ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:32.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.468+0000 7f88375ff700 1 -- 172.21.15.112:0/3828867203 shutdown_connections 2023-09-12T16:07:32.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.468+0000 7f88375ff700 1 -- 172.21.15.112:0/3828867203 wait complete. 2023-09-12T16:07:32.470 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 9 2023-09-12T16:07:32.486 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:07:32.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.685+0000 7f6c52dff700 1 -- 172.21.15.112:0/863328197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c3c004850 msgr2=0x7f6c3c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:32.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.685+0000 7f6c52dff700 1 --2- 172.21.15.112:0/863328197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c3c004850 0x7f6c3c004cd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800c290 tx=0x7f6c3c005880 comp rx=0 tx=0).stop 2023-09-12T16:07:32.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.686+0000 7f6c52dff700 1 -- 172.21.15.112:0/863328197 shutdown_connections 2023-09-12T16:07:32.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.686+0000 7f6c52dff700 1 --2- 172.21.15.112:0/863328197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c3c004850 0x7f6c3c004cd0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:32.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.686+0000 7f6c52dff700 1 -- 172.21.15.112:0/863328197 >> 172.21.15.112:0/863328197 conn(0x7f6c4c06a650 msgr2=0x7f6c4c06c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:32.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.686+0000 7f6c52dff700 1 -- 172.21.15.112:0/863328197 shutdown_connections 2023-09-12T16:07:32.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.686+0000 7f6c52dff700 1 -- 172.21.15.112:0/863328197 wait complete. 2023-09-12T16:07:32.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.688+0000 7f6c52dff700 1 Processor -- start 2023-09-12T16:07:32.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.688+0000 7f6c52dff700 1 -- start start 2023-09-12T16:07:32.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.689+0000 7f6c52dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c3c004850 0x7f6c4c0c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:32.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.689+0000 7f6c52dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c4c0aaaf0 0x7f6c4c0aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:32.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.689+0000 7f6c52dff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c4c0ab4b0 0x7f6c4c0cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:32.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.689+0000 7f6c52dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c0ab940 con 0x7f6c4c0aaaf0 2023-09-12T16:07:32.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.689+0000 7f6c52dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c1e4b90 con 0x7f6c3c004850 2023-09-12T16:07:32.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.690+0000 7f6c52dff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c1e4010 con 0x7f6c4c0ab4b0 2023-09-12T16:07:32.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.690+0000 7f6c4bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c4c0aaaf0 0x7f6c4c0aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:32.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.690+0000 7f6c4bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c4c0aaaf0 0x7f6c4c0aaf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52490/0 (socket says 172.21.15.112:52490) 2023-09-12T16:07:32.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.690+0000 7f6c4bfff700 1 -- 172.21.15.112:0/2025144684 learned_addr learned my addr 172.21.15.112:0/2025144684 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:32.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.690+0000 7f6c5139c700 1 --2- 172.21.15.112:0/2025144684 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c4c0ab4b0 0x7f6c4c0cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:32.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.690+0000 7f6c50b9b700 1 --2- 172.21.15.112:0/2025144684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c3c004850 0x7f6c4c0c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:32.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.690+0000 7f6c4bfff700 1 -- 172.21.15.112:0/2025144684 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c4c0ab4b0 msgr2=0x7f6c4c0cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:32.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.690+0000 7f6c4bfff700 1 --2- 172.21.15.112:0/2025144684 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c4c0ab4b0 0x7f6c4c0cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:32.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.690+0000 7f6c4bfff700 1 -- 172.21.15.112:0/2025144684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c3c004850 msgr2=0x7f6c4c0c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:32.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.690+0000 7f6c4bfff700 1 --2- 172.21.15.112:0/2025144684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c3c004850 0x7f6c4c0c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:32.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.690+0000 7f6c4bfff700 1 -- 172.21.15.112:0/2025144684 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c1e42f0 con 0x7f6c4c0aaaf0 2023-09-12T16:07:32.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.690+0000 7f6c4bfff700 1 --2- 172.21.15.112:0/2025144684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c4c0aaaf0 0x7f6c4c0aaf70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c00c060 tx=0x7f6c3800cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:32.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.691+0000 7f6c497fa700 1 -- 172.21.15.112:0/2025144684 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c380064e0 con 0x7f6c4c0aaaf0 2023-09-12T16:07:32.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.691+0000 7f6c497fa700 1 -- 172.21.15.112:0/2025144684 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6c38003680 con 0x7f6c4c0aaaf0 2023-09-12T16:07:32.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.691+0000 7f6c497fa700 1 -- 172.21.15.112:0/2025144684 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c38003a90 con 0x7f6c4c0aaaf0 2023-09-12T16:07:32.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.691+0000 7f6c52dff700 1 -- 172.21.15.112:0/2025144684 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4c1e45d0 con 0x7f6c4c0aaaf0 2023-09-12T16:07:32.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.691+0000 7f6c52dff700 1 -- 172.21.15.112:0/2025144684 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4c1e3c70 con 0x7f6c4c0aaaf0 2023-09-12T16:07:32.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.692+0000 7f6c52dff700 1 -- 172.21.15.112:0/2025144684 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4c0c4e00 con 0x7f6c4c0aaaf0 2023-09-12T16:07:32.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.693+0000 7f6c497fa700 1 -- 172.21.15.112:0/2025144684 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f6c38021070 con 0x7f6c4c0aaaf0 2023-09-12T16:07:32.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.694+0000 7f6c497fa700 1 --2- 172.21.15.112:0/2025144684 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6c3006a580 0x7f6c3006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:32.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.694+0000 7f6c497fa700 1 -- 172.21.15.112:0/2025144684 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6c3808a9b0 con 0x7f6c4c0aaaf0 2023-09-12T16:07:32.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.694+0000 7f6c50b9b700 1 --2- 172.21.15.112:0/2025144684 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6c3006a580 0x7f6c3006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:32.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.695+0000 7f6c50b9b700 1 --2- 172.21.15.112:0/2025144684 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6c3006a580 0x7f6c3006ca40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c1e4e80 tx=0x7f6c40006060 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:32.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.698+0000 7f6c497fa700 1 -- 172.21.15.112:0/2025144684 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6c38055d50 con 0x7f6c4c0aaaf0 2023-09-12T16:07:32.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.897+0000 7f6c52dff700 1 -- 172.21.15.112:0/2025144684 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c4c04e300 con 0x7f6c4c0aaaf0 2023-09-12T16:07:32.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.898+0000 7f6c497fa700 1 -- 172.21.15.112:0/2025144684 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f6c38029090 con 0x7f6c4c0aaaf0 2023-09-12T16:07:32.899 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:32.899 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:04.748402+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:07:32.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.901+0000 7f6c52dff700 1 -- 172.21.15.112:0/2025144684 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6c3006a580 msgr2=0x7f6c3006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:32.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.901+0000 7f6c52dff700 1 --2- 172.21.15.112:0/2025144684 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6c3006a580 0x7f6c3006ca40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c1e4e80 tx=0x7f6c40006060 comp rx=0 tx=0).stop 2023-09-12T16:07:32.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.901+0000 7f6c52dff700 1 -- 172.21.15.112:0/2025144684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c4c0aaaf0 msgr2=0x7f6c4c0aaf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:32.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.901+0000 7f6c52dff700 1 --2- 172.21.15.112:0/2025144684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c4c0aaaf0 0x7f6c4c0aaf70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c00c060 tx=0x7f6c3800cfd0 comp rx=0 tx=0).stop 2023-09-12T16:07:32.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.901+0000 7f6c52dff700 1 -- 172.21.15.112:0/2025144684 shutdown_connections 2023-09-12T16:07:32.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.901+0000 7f6c52dff700 1 --2- 172.21.15.112:0/2025144684 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6c3006a580 0x7f6c3006ca40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:32.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.901+0000 7f6c52dff700 1 --2- 172.21.15.112:0/2025144684 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c4c0ab4b0 0x7f6c4c0cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:32.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.901+0000 7f6c52dff700 1 --2- 172.21.15.112:0/2025144684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c3c004850 0x7f6c4c0c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:32.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.901+0000 7f6c52dff700 1 --2- 172.21.15.112:0/2025144684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c4c0aaaf0 0x7f6c4c0aaf70 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:32.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.901+0000 7f6c52dff700 1 -- 172.21.15.112:0/2025144684 >> 172.21.15.112:0/2025144684 conn(0x7f6c4c06a650 msgr2=0x7f6c4c0c3920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:32.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.901+0000 7f6c52dff700 1 -- 172.21.15.112:0/2025144684 shutdown_connections 2023-09-12T16:07:32.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:32.901+0000 7f6c52dff700 1 -- 172.21.15.112:0/2025144684 wait complete. 2023-09-12T16:07:32.919 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-12T16:06:48.871680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-12T16:06:58.137223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-12T16:06:58.684034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-12T16:07:02.283459+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-12T16:07:32.920 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-12T16:07:33.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.122+0000 7f78e51ff700 1 -- 172.21.15.112:0/2338954522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78c8004850 msgr2=0x7f78c8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:33.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.122+0000 7f78e51ff700 1 --2- 172.21.15.112:0/2338954522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78c8004850 0x7f78c8004cd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f78e0160690 tx=0x7f78c8005880 comp rx=0 tx=0).stop 2023-09-12T16:07:33.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.122+0000 7f78df59e700 1 -- 172.21.15.112:0/2338954522 reap_dead start 2023-09-12T16:07:33.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.122+0000 7f78e51ff700 1 -- 172.21.15.112:0/2338954522 shutdown_connections 2023-09-12T16:07:33.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.122+0000 7f78e51ff700 1 -- 172.21.15.112:0/2338954522 >> 172.21.15.112:0/2338954522 conn(0x7f78e00d17d0 msgr2=0x7f78e00d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:33.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.122+0000 7f78e51ff700 1 -- 172.21.15.112:0/2338954522 shutdown_connections 2023-09-12T16:07:33.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.122+0000 7f78e51ff700 1 -- 172.21.15.112:0/2338954522 wait complete. 2023-09-12T16:07:33.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.125+0000 7f78e51ff700 1 Processor -- start 2023-09-12T16:07:33.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.125+0000 7f78e51ff700 1 -- start start 2023-09-12T16:07:33.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.126+0000 7f78e51ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78c8004850 0x7f78e00cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:33.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.126+0000 7f78e51ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78e015d1d0 0x7f78e00aed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:33.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.126+0000 7f78e51ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78e00b0b50 0x7f78e00b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:33.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.126+0000 7f78e51ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e00b1540 con 0x7f78e015d1d0 2023-09-12T16:07:33.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.126+0000 7f78e51ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e015d720 con 0x7f78c8004850 2023-09-12T16:07:33.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.126+0000 7f78e51ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e00af690 con 0x7f78e00b0b50 2023-09-12T16:07:33.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.126+0000 7f78de59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78e015d1d0 0x7f78e00aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:33.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.126+0000 7f78de59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78e015d1d0 0x7f78e00aed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52520/0 (socket says 172.21.15.112:52520) 2023-09-12T16:07:33.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.127+0000 7f78de59c700 1 -- 172.21.15.112:0/3568490758 learned_addr learned my addr 172.21.15.112:0/3568490758 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:33.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.127+0000 7f78ded9d700 1 --2- 172.21.15.112:0/3568490758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78c8004850 0x7f78e00cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:33.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.127+0000 7f78df59e700 1 --2- 172.21.15.112:0/3568490758 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78e00b0b50 0x7f78e00b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:33.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.127+0000 7f78de59c700 1 -- 172.21.15.112:0/3568490758 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78e00b0b50 msgr2=0x7f78e00b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:33.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.127+0000 7f78de59c700 1 --2- 172.21.15.112:0/3568490758 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78e00b0b50 0x7f78e00b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:33.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.127+0000 7f78de59c700 1 -- 172.21.15.112:0/3568490758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78c8004850 msgr2=0x7f78e00cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:33.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.127+0000 7f78de59c700 1 --2- 172.21.15.112:0/3568490758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78c8004850 0x7f78e00cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:33.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.127+0000 7f78de59c700 1 -- 172.21.15.112:0/3568490758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e00af970 con 0x7f78e015d1d0 2023-09-12T16:07:33.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.127+0000 7f78de59c700 1 --2- 172.21.15.112:0/3568490758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78e015d1d0 0x7f78e00aed70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f78d4009230 tx=0x7f78d4005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:33.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.127+0000 7f78c77fe700 1 -- 172.21.15.112:0/3568490758 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d4004020 con 0x7f78e015d1d0 2023-09-12T16:07:33.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.127+0000 7f78c77fe700 1 -- 172.21.15.112:0/3568490758 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f78d4004270 con 0x7f78e015d1d0 2023-09-12T16:07:33.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.127+0000 7f78c77fe700 1 -- 172.21.15.112:0/3568490758 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d4005040 con 0x7f78e015d1d0 2023-09-12T16:07:33.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.127+0000 7f78e51ff700 1 -- 172.21.15.112:0/3568490758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e015d990 con 0x7f78e015d1d0 2023-09-12T16:07:33.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.128+0000 7f78e51ff700 1 -- 172.21.15.112:0/3568490758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e00afc50 con 0x7f78e015d1d0 2023-09-12T16:07:33.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.129+0000 7f78e51ff700 1 -- 172.21.15.112:0/3568490758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e0073ea0 con 0x7f78e015d1d0 2023-09-12T16:07:33.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.129+0000 7f78c77fe700 1 -- 172.21.15.112:0/3568490758 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f78d40051c0 con 0x7f78e015d1d0 2023-09-12T16:07:33.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.130+0000 7f78c77fe700 1 --2- 172.21.15.112:0/3568490758 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f78cc06a580 0x7f78cc06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:33.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.130+0000 7f78c77fe700 1 -- 172.21.15.112:0/3568490758 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f78d4000e40 con 0x7f78e015d1d0 2023-09-12T16:07:33.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.131+0000 7f78ded9d700 1 --2- 172.21.15.112:0/3568490758 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f78cc06a580 0x7f78cc06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:33.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.131+0000 7f78ded9d700 1 --2- 172.21.15.112:0/3568490758 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f78cc06a580 0x7f78cc06ca40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f78d0001050 tx=0x7f78d0001e70 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:33.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.135+0000 7f78c77fe700 1 -- 172.21.15.112:0/3568490758 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f78d4056150 con 0x7f78e015d1d0 2023-09-12T16:07:33.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.330+0000 7f78e51ff700 1 -- 172.21.15.112:0/3568490758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f78e008b860 con 0x7f78e015d1d0 2023-09-12T16:07:33.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.330+0000 7f78c77fe700 1 -- 172.21.15.112:0/3568490758 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f78d4026070 con 0x7f78e015d1d0 2023-09-12T16:07:33.331 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-09-12T16:07:33.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.332+0000 7f78e51ff700 1 -- 172.21.15.112:0/3568490758 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f78cc06a580 msgr2=0x7f78cc06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:33.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.332+0000 7f78e51ff700 1 --2- 172.21.15.112:0/3568490758 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f78cc06a580 0x7f78cc06ca40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f78d0001050 tx=0x7f78d0001e70 comp rx=0 tx=0).stop 2023-09-12T16:07:33.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.332+0000 7f78e51ff700 1 -- 172.21.15.112:0/3568490758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78e015d1d0 msgr2=0x7f78e00aed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:33.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.332+0000 7f78e51ff700 1 --2- 172.21.15.112:0/3568490758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78e015d1d0 0x7f78e00aed70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f78d4009230 tx=0x7f78d4005ce0 comp rx=0 tx=0).stop 2023-09-12T16:07:33.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.333+0000 7f78e51ff700 1 -- 172.21.15.112:0/3568490758 shutdown_connections 2023-09-12T16:07:33.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.333+0000 7f78e51ff700 1 --2- 172.21.15.112:0/3568490758 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f78cc06a580 0x7f78cc06ca40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:33.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.333+0000 7f78e51ff700 1 --2- 172.21.15.112:0/3568490758 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78e00b0b50 0x7f78e00b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:33.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.333+0000 7f78e51ff700 1 --2- 172.21.15.112:0/3568490758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78c8004850 0x7f78e00cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:33.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.333+0000 7f78e51ff700 1 --2- 172.21.15.112:0/3568490758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78e015d1d0 0x7f78e00aed70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:33.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.333+0000 7f78e51ff700 1 -- 172.21.15.112:0/3568490758 >> 172.21.15.112:0/3568490758 conn(0x7f78e00d17d0 msgr2=0x7f78e0159be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:33.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.333+0000 7f78e51ff700 1 -- 172.21.15.112:0/3568490758 shutdown_connections 2023-09-12T16:07:33.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.333+0000 7f78e51ff700 1 -- 172.21.15.112:0/3568490758 wait complete. 2023-09-12T16:07:33.351 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-12T16:07:33.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.555+0000 7f046d9ff700 1 -- 172.21.15.112:0/1401966161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046815cdf0 msgr2=0x7f04680ce000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:33.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.555+0000 7f046d9ff700 1 --2- 172.21.15.112:0/1401966161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046815cdf0 0x7f04680ce000 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0458005fd0 tx=0x7f0458009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:33.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.555+0000 7f046d9ff700 1 -- 172.21.15.112:0/1401966161 shutdown_connections 2023-09-12T16:07:33.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.555+0000 7f046d9ff700 1 --2- 172.21.15.112:0/1401966161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046815cdf0 0x7f04680ce000 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:33.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.555+0000 7f046d9ff700 1 --2- 172.21.15.112:0/1401966161 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f046815d1d0 0x7f04680aebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:33.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.555+0000 7f046d9ff700 1 -- 172.21.15.112:0/1401966161 >> 172.21.15.112:0/1401966161 conn(0x7f04680cf660 msgr2=0x7f04680cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:33.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.555+0000 7f046d9ff700 1 -- 172.21.15.112:0/1401966161 shutdown_connections 2023-09-12T16:07:33.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.555+0000 7f046d9ff700 1 -- 172.21.15.112:0/1401966161 wait complete. 2023-09-12T16:07:33.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.557+0000 7f046d9ff700 1 Processor -- start 2023-09-12T16:07:33.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.557+0000 7f046d9ff700 1 -- start start 2023-09-12T16:07:33.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.558+0000 7f046d9ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04680b0400 0x7f04681559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:33.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.558+0000 7f046d9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f046815cdf0 0x7f046815b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:33.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.558+0000 7f046d9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046815d1d0 0x7f046815b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:33.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.558+0000 7f046d9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04680c79f0 con 0x7f046815d1d0 2023-09-12T16:07:33.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.558+0000 7f046d9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04680c7cd0 con 0x7f046815cdf0 2023-09-12T16:07:33.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.558+0000 7f046d9ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04680c7fb0 con 0x7f04680b0400 2023-09-12T16:07:33.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.558+0000 7f04677fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046815d1d0 0x7f046815b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:33.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.558+0000 7f04677fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046815d1d0 0x7f046815b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52536/0 (socket says 172.21.15.112:52536) 2023-09-12T16:07:33.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.558+0000 7f04677fe700 1 -- 172.21.15.112:0/3768229049 learned_addr learned my addr 172.21.15.112:0/3768229049 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:33.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.558+0000 7f0466ffd700 1 --2- 172.21.15.112:0/3768229049 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04680b0400 0x7f04681559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:33.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.558+0000 7f04667fc700 1 --2- 172.21.15.112:0/3768229049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f046815cdf0 0x7f046815b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:33.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.558+0000 7f04677fe700 1 -- 172.21.15.112:0/3768229049 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04680b0400 msgr2=0x7f04681559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:33.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.559+0000 7f04677fe700 1 --2- 172.21.15.112:0/3768229049 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04680b0400 0x7f04681559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:33.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.559+0000 7f04677fe700 1 -- 172.21.15.112:0/3768229049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f046815cdf0 msgr2=0x7f046815b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:33.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.559+0000 7f04677fe700 1 --2- 172.21.15.112:0/3768229049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f046815cdf0 0x7f046815b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:33.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.559+0000 7f04677fe700 1 -- 172.21.15.112:0/3768229049 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04580095f0 con 0x7f046815d1d0 2023-09-12T16:07:33.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.559+0000 7f0466ffd700 1 --2- 172.21.15.112:0/3768229049 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04680b0400 0x7f04681559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:07:33.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.559+0000 7f04677fe700 1 --2- 172.21.15.112:0/3768229049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046815d1d0 0x7f046815b920 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f046000cc10 tx=0x7f046000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:33.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.559+0000 7f044ffff700 1 -- 172.21.15.112:0/3768229049 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046000abb0 con 0x7f046815d1d0 2023-09-12T16:07:33.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.559+0000 7f044ffff700 1 -- 172.21.15.112:0/3768229049 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f046000ae00 con 0x7f046815d1d0 2023-09-12T16:07:33.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.559+0000 7f046d9ff700 1 -- 172.21.15.112:0/3768229049 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04680c8290 con 0x7f046815d1d0 2023-09-12T16:07:33.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.559+0000 7f044ffff700 1 -- 172.21.15.112:0/3768229049 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0460012680 con 0x7f046815d1d0 2023-09-12T16:07:33.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.559+0000 7f046d9ff700 1 -- 172.21.15.112:0/3768229049 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04680c8a90 con 0x7f046815d1d0 2023-09-12T16:07:33.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.560+0000 7f046d9ff700 1 -- 172.21.15.112:0/3768229049 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04680c87b0 con 0x7f046815d1d0 2023-09-12T16:07:33.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.561+0000 7f044ffff700 1 -- 172.21.15.112:0/3768229049 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f046001b400 con 0x7f046815d1d0 2023-09-12T16:07:33.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.562+0000 7f044ffff700 1 --2- 172.21.15.112:0/3768229049 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f045406a580 0x7f045406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:33.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.562+0000 7f044ffff700 1 -- 172.21.15.112:0/3768229049 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0460089810 con 0x7f046815d1d0 2023-09-12T16:07:33.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.562+0000 7f0466ffd700 1 --2- 172.21.15.112:0/3768229049 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f045406a580 0x7f045406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:33.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.563+0000 7f0466ffd700 1 --2- 172.21.15.112:0/3768229049 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f045406a580 0x7f045406ca40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0458000c00 tx=0x7f04580047c0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:33.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.566+0000 7f044ffff700 1 -- 172.21.15.112:0/3768229049 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f04680c87b0 con 0x7f046815d1d0 2023-09-12T16:07:33.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.763+0000 7f046d9ff700 1 -- 172.21.15.112:0/3768229049 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f04680c87b0 con 0x7f046815d1d0 2023-09-12T16:07:33.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.764+0000 7f044ffff700 1 -- 172.21.15.112:0/3768229049 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f04680c87b0 con 0x7f046815d1d0 2023-09-12T16:07:33.764 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:07:33.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.766+0000 7f046d9ff700 1 -- 172.21.15.112:0/3768229049 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f045406a580 msgr2=0x7f045406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:33.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.766+0000 7f046d9ff700 1 --2- 172.21.15.112:0/3768229049 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f045406a580 0x7f045406ca40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0458000c00 tx=0x7f04580047c0 comp rx=0 tx=0).stop 2023-09-12T16:07:33.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.766+0000 7f046d9ff700 1 -- 172.21.15.112:0/3768229049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046815d1d0 msgr2=0x7f046815b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:33.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.766+0000 7f046d9ff700 1 --2- 172.21.15.112:0/3768229049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046815d1d0 0x7f046815b920 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f046000cc10 tx=0x7f046000a060 comp rx=0 tx=0).stop 2023-09-12T16:07:33.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.766+0000 7f046d9ff700 1 -- 172.21.15.112:0/3768229049 shutdown_connections 2023-09-12T16:07:33.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.766+0000 7f046d9ff700 1 --2- 172.21.15.112:0/3768229049 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f045406a580 0x7f045406ca40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:33.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.766+0000 7f046d9ff700 1 --2- 172.21.15.112:0/3768229049 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04680b0400 0x7f04681559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:33.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.766+0000 7f046d9ff700 1 --2- 172.21.15.112:0/3768229049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046815d1d0 0x7f046815b920 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:33.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.766+0000 7f046d9ff700 1 --2- 172.21.15.112:0/3768229049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f046815cdf0 0x7f046815b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:33.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.766+0000 7f046d9ff700 1 -- 172.21.15.112:0/3768229049 >> 172.21.15.112:0/3768229049 conn(0x7f04680cf660 msgr2=0x7f046806f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:33.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.766+0000 7f046d9ff700 1 -- 172.21.15.112:0/3768229049 shutdown_connections 2023-09-12T16:07:33.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.766+0000 7f046d9ff700 1 -- 172.21.15.112:0/3768229049 wait complete. 2023-09-12T16:07:33.784 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-12T16:07:33.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.988+0000 7f563ddff700 1 -- 172.21.15.112:0/1181016424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56380cfdb0 msgr2=0x7f56380d0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:33.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.988+0000 7f563ddff700 1 --2- 172.21.15.112:0/1181016424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56380cfdb0 0x7f56380d0200 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5630009fd0 tx=0x7f563000b380 comp rx=0 tx=0).stop 2023-09-12T16:07:33.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.988+0000 7f563ddff700 1 -- 172.21.15.112:0/1181016424 shutdown_connections 2023-09-12T16:07:33.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.988+0000 7f563ddff700 1 --2- 172.21.15.112:0/1181016424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56380cfdb0 0x7f56380d0200 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:33.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.988+0000 7f563ddff700 1 --2- 172.21.15.112:0/1181016424 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f563815bca0 0x7f563815cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:33.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.988+0000 7f563ddff700 1 -- 172.21.15.112:0/1181016424 >> 172.21.15.112:0/1181016424 conn(0x7f56380d17d0 msgr2=0x7f56380d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:33.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.988+0000 7f563ddff700 1 -- 172.21.15.112:0/1181016424 shutdown_connections 2023-09-12T16:07:33.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.988+0000 7f563ddff700 1 -- 172.21.15.112:0/1181016424 wait complete. 2023-09-12T16:07:33.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.990+0000 7f563ddff700 1 Processor -- start 2023-09-12T16:07:33.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.990+0000 7f563ddff700 1 -- start start 2023-09-12T16:07:33.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.991+0000 7f563ddff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56380cfdb0 0x7f5638158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:33.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.991+0000 7f563ddff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f563815bca0 0x7f5638159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:33.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.991+0000 7f563ddff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56381f61e0 0x7f56380c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:33.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.991+0000 7f563ddff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563815a1a0 con 0x7f563815bca0 2023-09-12T16:07:33.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.991+0000 7f563ddff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56380c8a10 con 0x7f56381f61e0 2023-09-12T16:07:33.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.991+0000 7f563ddff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56380c8cf0 con 0x7f56380cfdb0 2023-09-12T16:07:33.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.991+0000 7f5636ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f563815bca0 0x7f5638159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:33.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.991+0000 7f5636ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f563815bca0 0x7f5638159830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52554/0 (socket says 172.21.15.112:52554) 2023-09-12T16:07:33.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.991+0000 7f5636ffd700 1 -- 172.21.15.112:0/1768470929 learned_addr learned my addr 172.21.15.112:0/1768470929 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:33.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.991+0000 7f5637fff700 1 --2- 172.21.15.112:0/1768470929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56381f61e0 0x7f56380c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:33.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.991+0000 7f56377fe700 1 --2- 172.21.15.112:0/1768470929 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56380cfdb0 0x7f5638158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:33.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.991+0000 7f5636ffd700 1 -- 172.21.15.112:0/1768470929 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56380cfdb0 msgr2=0x7f5638158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:33.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.991+0000 7f5636ffd700 1 --2- 172.21.15.112:0/1768470929 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56380cfdb0 0x7f5638158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:33.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.991+0000 7f5636ffd700 1 -- 172.21.15.112:0/1768470929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56381f61e0 msgr2=0x7f56380c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:33.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.991+0000 7f5636ffd700 1 --2- 172.21.15.112:0/1768470929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56381f61e0 0x7f56380c6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:33.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.991+0000 7f5636ffd700 1 -- 172.21.15.112:0/1768470929 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5630009d00 con 0x7f563815bca0 2023-09-12T16:07:33.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.992+0000 7f5636ffd700 1 --2- 172.21.15.112:0/1768470929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f563815bca0 0x7f5638159830 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f562c00c4d0 tx=0x7f562c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:33.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.992+0000 7f561ffff700 1 -- 172.21.15.112:0/1768470929 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c011790 con 0x7f563815bca0 2023-09-12T16:07:33.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.992+0000 7f561ffff700 1 -- 172.21.15.112:0/1768470929 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f562c0119e0 con 0x7f563815bca0 2023-09-12T16:07:33.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.992+0000 7f561ffff700 1 -- 172.21.15.112:0/1768470929 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c011df0 con 0x7f563815bca0 2023-09-12T16:07:33.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.992+0000 7f563ddff700 1 -- 172.21.15.112:0/1768470929 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56380c8fd0 con 0x7f563815bca0 2023-09-12T16:07:33.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.992+0000 7f563ddff700 1 -- 172.21.15.112:0/1768470929 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5638158ba0 con 0x7f563815bca0 2023-09-12T16:07:33.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.993+0000 7f563ddff700 1 -- 172.21.15.112:0/1768470929 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5638073ea0 con 0x7f563815bca0 2023-09-12T16:07:33.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.994+0000 7f561ffff700 1 -- 172.21.15.112:0/1768470929 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f562c01c460 con 0x7f563815bca0 2023-09-12T16:07:33.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.995+0000 7f561ffff700 1 --2- 172.21.15.112:0/1768470929 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f562406a580 0x7f562406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:33.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.995+0000 7f561ffff700 1 -- 172.21.15.112:0/1768470929 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f562c088e40 con 0x7f563815bca0 2023-09-12T16:07:33.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.995+0000 7f56377fe700 1 --2- 172.21.15.112:0/1768470929 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f562406a580 0x7f562406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:33.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:33.996+0000 7f56377fe700 1 --2- 172.21.15.112:0/1768470929 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f562406a580 0x7f562406ca40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5628005950 tx=0x7f56280058e0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:33.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.000+0000 7f561ffff700 1 -- 172.21.15.112:0/1768470929 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f562c0540c0 con 0x7f563815bca0 2023-09-12T16:07:34.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.193+0000 7f563ddff700 1 -- 172.21.15.112:0/1768470929 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f563808b860 con 0x7f563815bca0 2023-09-12T16:07:34.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.193+0000 7f561ffff700 1 -- 172.21.15.112:0/1768470929 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f562c0576e0 con 0x7f563815bca0 2023-09-12T16:07:34.194 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-09-12T16:07:34.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.195+0000 7f563ddff700 1 -- 172.21.15.112:0/1768470929 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f562406a580 msgr2=0x7f562406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:34.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.195+0000 7f563ddff700 1 --2- 172.21.15.112:0/1768470929 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f562406a580 0x7f562406ca40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5628005950 tx=0x7f56280058e0 comp rx=0 tx=0).stop 2023-09-12T16:07:34.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.195+0000 7f563ddff700 1 -- 172.21.15.112:0/1768470929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f563815bca0 msgr2=0x7f5638159830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:34.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.195+0000 7f563ddff700 1 --2- 172.21.15.112:0/1768470929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f563815bca0 0x7f5638159830 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f562c00c4d0 tx=0x7f562c00c890 comp rx=0 tx=0).stop 2023-09-12T16:07:34.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.196+0000 7f563ddff700 1 -- 172.21.15.112:0/1768470929 shutdown_connections 2023-09-12T16:07:34.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.196+0000 7f563ddff700 1 --2- 172.21.15.112:0/1768470929 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f562406a580 0x7f562406ca40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:34.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.196+0000 7f563ddff700 1 --2- 172.21.15.112:0/1768470929 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56380cfdb0 0x7f5638158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:34.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.196+0000 7f563ddff700 1 --2- 172.21.15.112:0/1768470929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56381f61e0 0x7f56380c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:34.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.196+0000 7f563ddff700 1 --2- 172.21.15.112:0/1768470929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f563815bca0 0x7f5638159830 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:34.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.196+0000 7f563ddff700 1 -- 172.21.15.112:0/1768470929 >> 172.21.15.112:0/1768470929 conn(0x7f56380d17d0 msgr2=0x7f563815aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:34.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.196+0000 7f563ddff700 1 -- 172.21.15.112:0/1768470929 shutdown_connections 2023-09-12T16:07:34.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.196+0000 7f563ddff700 1 -- 172.21.15.112:0/1768470929 wait complete. 2023-09-12T16:07:34.214 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-12T16:07:34.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.417+0000 7f067a3ff700 1 -- 172.21.15.112:0/2090286572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f067415bca0 msgr2=0x7f067415cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:34.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.417+0000 7f067a3ff700 1 --2- 172.21.15.112:0/2090286572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f067415bca0 0x7f067415cb90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f067408abe0 tx=0x7f0664009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:34.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.417+0000 7f067a3ff700 1 -- 172.21.15.112:0/2090286572 shutdown_connections 2023-09-12T16:07:34.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.417+0000 7f067a3ff700 1 --2- 172.21.15.112:0/2090286572 >> v2:172.21.15.144:3300/0 conn(0x7f06740cfdb0 0x7f06740d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:34.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.417+0000 7f067a3ff700 1 --2- 172.21.15.112:0/2090286572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f067415bca0 0x7f067415cb90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:34.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.417+0000 7f067a3ff700 1 --2- 172.21.15.112:0/2090286572 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06740cf5b0 0x7f06740cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:34.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.417+0000 7f067a3ff700 1 -- 172.21.15.112:0/2090286572 >> 172.21.15.112:0/2090286572 conn(0x7f06740d17d0 msgr2=0x7f06740d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:34.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.417+0000 7f067a3ff700 1 -- 172.21.15.112:0/2090286572 shutdown_connections 2023-09-12T16:07:34.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.417+0000 7f067a3ff700 1 -- 172.21.15.112:0/2090286572 wait complete. 2023-09-12T16:07:34.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.419+0000 7f067a3ff700 1 Processor -- start 2023-09-12T16:07:34.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.419+0000 7f067a3ff700 1 -- start start 2023-09-12T16:07:34.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.420+0000 7f067a3ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06740cfdb0 0x7f067414cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:34.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.420+0000 7f067a3ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067415bca0 0x7f06741f2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:34.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.420+0000 7f067a3ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06740c5300 0x7f06740c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:34.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.420+0000 7f067a3ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067414d040 con 0x7f06740cfdb0 2023-09-12T16:07:34.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.420+0000 7f067a3ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06740c7800 con 0x7f067415bca0 2023-09-12T16:07:34.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.420+0000 7f067a3ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f067414d530 con 0x7f06740c5300 2023-09-12T16:07:34.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.420+0000 7f0673fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06740cfdb0 0x7f067414cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:34.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.420+0000 7f0673fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06740cfdb0 0x7f067414cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52568/0 (socket says 172.21.15.112:52568) 2023-09-12T16:07:34.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.420+0000 7f0673fff700 1 -- 172.21.15.112:0/1830439002 learned_addr learned my addr 172.21.15.112:0/1830439002 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:34.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.420+0000 7f06737fe700 1 --2- 172.21.15.112:0/1830439002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067415bca0 0x7f06741f2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:34.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.420+0000 7f067899c700 1 --2- 172.21.15.112:0/1830439002 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06740c5300 0x7f06740c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:34.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.421+0000 7f0673fff700 1 -- 172.21.15.112:0/1830439002 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06740c5300 msgr2=0x7f06740c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:34.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.421+0000 7f0673fff700 1 --2- 172.21.15.112:0/1830439002 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06740c5300 0x7f06740c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:34.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.421+0000 7f0673fff700 1 -- 172.21.15.112:0/1830439002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067415bca0 msgr2=0x7f06741f2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:34.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.421+0000 7f0673fff700 1 --2- 172.21.15.112:0/1830439002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067415bca0 0x7f06741f2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:34.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.421+0000 7f0673fff700 1 -- 172.21.15.112:0/1830439002 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06640095f0 con 0x7f06740cfdb0 2023-09-12T16:07:34.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.421+0000 7f0673fff700 1 --2- 172.21.15.112:0/1830439002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06740cfdb0 0x7f067414cb00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0664005fd0 tx=0x7f0664004240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:34.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.421+0000 7f0670ff9700 1 -- 172.21.15.112:0/1830439002 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066401c070 con 0x7f06740cfdb0 2023-09-12T16:07:34.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.421+0000 7f0670ff9700 1 -- 172.21.15.112:0/1830439002 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0664003890 con 0x7f06740cfdb0 2023-09-12T16:07:34.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.421+0000 7f067a3ff700 1 -- 172.21.15.112:0/1830439002 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06741f2ed0 con 0x7f06740cfdb0 2023-09-12T16:07:34.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.421+0000 7f0670ff9700 1 -- 172.21.15.112:0/1830439002 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06640045f0 con 0x7f06740cfdb0 2023-09-12T16:07:34.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.421+0000 7f067a3ff700 1 -- 172.21.15.112:0/1830439002 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06740c71b0 con 0x7f06740cfdb0 2023-09-12T16:07:34.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.422+0000 7f067a3ff700 1 -- 172.21.15.112:0/1830439002 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0674073ea0 con 0x7f06740cfdb0 2023-09-12T16:07:34.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.423+0000 7f0670ff9700 1 -- 172.21.15.112:0/1830439002 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f0664003c80 con 0x7f06740cfdb0 2023-09-12T16:07:34.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.424+0000 7f0670ff9700 1 --2- 172.21.15.112:0/1830439002 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f066006a580 0x7f066006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:34.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.424+0000 7f0670ff9700 1 -- 172.21.15.112:0/1830439002 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f066408a120 con 0x7f06740cfdb0 2023-09-12T16:07:34.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.424+0000 7f06737fe700 1 --2- 172.21.15.112:0/1830439002 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f066006a580 0x7f066006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:34.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.425+0000 7f06737fe700 1 --2- 172.21.15.112:0/1830439002 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f066006a580 0x7f066006ca40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f06740cb710 tx=0x7f066800b390 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:34.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.428+0000 7f0670ff9700 1 -- 172.21.15.112:0/1830439002 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f06640554d0 con 0x7f06740cfdb0 2023-09-12T16:07:34.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.625+0000 7f067a3ff700 1 -- 172.21.15.112:0/1830439002 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f067408b860 con 0x7f06740cfdb0 2023-09-12T16:07:34.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.626+0000 7f0670ff9700 1 -- 172.21.15.112:0/1830439002 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0664025020 con 0x7f06740cfdb0 2023-09-12T16:07:34.626 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:07:34.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.628+0000 7f067a3ff700 1 -- 172.21.15.112:0/1830439002 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f066006a580 msgr2=0x7f066006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:34.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.628+0000 7f067a3ff700 1 --2- 172.21.15.112:0/1830439002 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f066006a580 0x7f066006ca40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f06740cb710 tx=0x7f066800b390 comp rx=0 tx=0).stop 2023-09-12T16:07:34.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.628+0000 7f067a3ff700 1 -- 172.21.15.112:0/1830439002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06740cfdb0 msgr2=0x7f067414cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:34.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.628+0000 7f067a3ff700 1 --2- 172.21.15.112:0/1830439002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06740cfdb0 0x7f067414cb00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0664005fd0 tx=0x7f0664004240 comp rx=0 tx=0).stop 2023-09-12T16:07:34.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.628+0000 7f067a3ff700 1 -- 172.21.15.112:0/1830439002 shutdown_connections 2023-09-12T16:07:34.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.628+0000 7f067a3ff700 1 --2- 172.21.15.112:0/1830439002 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f066006a580 0x7f066006ca40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:34.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.628+0000 7f067a3ff700 1 --2- 172.21.15.112:0/1830439002 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06740c5300 0x7f06740c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:34.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.628+0000 7f067a3ff700 1 --2- 172.21.15.112:0/1830439002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06740cfdb0 0x7f067414cb00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:34.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.628+0000 7f067a3ff700 1 --2- 172.21.15.112:0/1830439002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067415bca0 0x7f06741f2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:34.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.628+0000 7f067a3ff700 1 -- 172.21.15.112:0/1830439002 >> 172.21.15.112:0/1830439002 conn(0x7f06740d17d0 msgr2=0x7f067415ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:34.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.628+0000 7f067a3ff700 1 -- 172.21.15.112:0/1830439002 shutdown_connections 2023-09-12T16:07:34.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.628+0000 7f067a3ff700 1 -- 172.21.15.112:0/1830439002 wait complete. 2023-09-12T16:07:34.647 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-12T16:07:34.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.847+0000 7f14d43ff700 1 -- 172.21.15.112:0/4084554649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14cc0c9ac0 msgr2=0x7f14cc0cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:34.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.847+0000 7f14d43ff700 1 --2- 172.21.15.112:0/4084554649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14cc0c9ac0 0x7f14cc0cd980 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f14cc0cd360 tx=0x7f14bc009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:34.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.847+0000 7f14d43ff700 1 -- 172.21.15.112:0/4084554649 shutdown_connections 2023-09-12T16:07:34.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.847+0000 7f14d43ff700 1 --2- 172.21.15.112:0/4084554649 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14cc070e00 0x7f14cc15d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:34.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.847+0000 7f14d43ff700 1 --2- 172.21.15.112:0/4084554649 >> v2:172.21.15.144:3300/0 conn(0x7f14cc159af0 0x7f14cc0cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:34.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.847+0000 7f14d43ff700 1 --2- 172.21.15.112:0/4084554649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14cc0c9ac0 0x7f14cc0cd980 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:34.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.847+0000 7f14d43ff700 1 -- 172.21.15.112:0/4084554649 >> 172.21.15.112:0/4084554649 conn(0x7f14cc06a650 msgr2=0x7f14cc06c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:34.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.847+0000 7f14d43ff700 1 -- 172.21.15.112:0/4084554649 shutdown_connections 2023-09-12T16:07:34.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.847+0000 7f14d43ff700 1 -- 172.21.15.112:0/4084554649 wait complete. 2023-09-12T16:07:34.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.848+0000 7f14d43ff700 1 Processor -- start 2023-09-12T16:07:34.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.849+0000 7f14d43ff700 1 -- start start 2023-09-12T16:07:34.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.849+0000 7f14d43ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14cc070e00 0x7f14cc0afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:34.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.850+0000 7f14d43ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14cc159af0 0x7f14cc1536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:34.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.850+0000 7f14d43ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14cc0b0660 0x7f14cc0c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:34.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.850+0000 7f14d43ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc153c30 con 0x7f14cc159af0 2023-09-12T16:07:34.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.850+0000 7f14d43ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc0ae9e0 con 0x7f14cc0b0660 2023-09-12T16:07:34.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.850+0000 7f14d43ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc0aecc0 con 0x7f14cc070e00 2023-09-12T16:07:34.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.850+0000 7f14d199a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14cc159af0 0x7f14cc1536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:34.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.850+0000 7f14d199a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14cc159af0 0x7f14cc1536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52584/0 (socket says 172.21.15.112:52584) 2023-09-12T16:07:34.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.850+0000 7f14d199a700 1 -- 172.21.15.112:0/2725601947 learned_addr learned my addr 172.21.15.112:0/2725601947 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:34.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.850+0000 7f14d199a700 1 -- 172.21.15.112:0/2725601947 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14cc070e00 msgr2=0x7f14cc0afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:34.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.850+0000 7f14d199a700 1 --2- 172.21.15.112:0/2725601947 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14cc070e00 0x7f14cc0afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:34.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.850+0000 7f14d199a700 1 -- 172.21.15.112:0/2725601947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14cc0b0660 msgr2=0x7f14cc0c7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:34.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.850+0000 7f14d199a700 1 --2- 172.21.15.112:0/2725601947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14cc0b0660 0x7f14cc0c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:34.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.850+0000 7f14d199a700 1 -- 172.21.15.112:0/2725601947 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc0095f0 con 0x7f14cc159af0 2023-09-12T16:07:34.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.850+0000 7f14d199a700 1 --2- 172.21.15.112:0/2725601947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14cc159af0 0x7f14cc1536f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f14cc06e500 tx=0x7f14bc004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:34.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.851+0000 7f14c2ffd700 1 -- 172.21.15.112:0/2725601947 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc01d070 con 0x7f14cc159af0 2023-09-12T16:07:34.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.851+0000 7f14c2ffd700 1 -- 172.21.15.112:0/2725601947 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f14bc003e50 con 0x7f14cc159af0 2023-09-12T16:07:34.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.851+0000 7f14c2ffd700 1 -- 172.21.15.112:0/2725601947 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc00ba10 con 0x7f14cc159af0 2023-09-12T16:07:34.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.851+0000 7f14d43ff700 1 -- 172.21.15.112:0/2725601947 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14cc0b32f0 con 0x7f14cc159af0 2023-09-12T16:07:34.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.851+0000 7f14d43ff700 1 -- 172.21.15.112:0/2725601947 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14cc0af280 con 0x7f14cc159af0 2023-09-12T16:07:34.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.852+0000 7f14d43ff700 1 -- 172.21.15.112:0/2725601947 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14cc04e300 con 0x7f14cc159af0 2023-09-12T16:07:34.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.853+0000 7f14c2ffd700 1 -- 172.21.15.112:0/2725601947 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f14bc00bb70 con 0x7f14cc159af0 2023-09-12T16:07:34.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.853+0000 7f14c2ffd700 1 --2- 172.21.15.112:0/2725601947 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f14b006a580 0x7f14b006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:34.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.853+0000 7f14c2ffd700 1 -- 172.21.15.112:0/2725601947 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f14bc08a4a0 con 0x7f14cc159af0 2023-09-12T16:07:34.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.854+0000 7f14d219b700 1 --2- 172.21.15.112:0/2725601947 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f14b006a580 0x7f14b006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:34.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.854+0000 7f14d219b700 1 --2- 172.21.15.112:0/2725601947 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f14b006a580 0x7f14b006ca40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f14c8005950 tx=0x7f14c80058e0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:34.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:34.858+0000 7f14c2ffd700 1 -- 172.21.15.112:0/2725601947 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f14bc055720 con 0x7f14cc159af0 2023-09-12T16:07:35.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.096+0000 7f14d43ff700 1 -- 172.21.15.112:0/2725601947 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14cc0ac760 con 0x7f14cc159af0 2023-09-12T16:07:35.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.097+0000 7f14c2ffd700 1 -- 172.21.15.112:0/2725601947 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f14bc058d40 con 0x7f14cc159af0 2023-09-12T16:07:35.097 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:35.098 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3995117138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3995117138},{"type":"v1","addr":"172.21.15.112:6836","nonce":3995117138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3233826602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3233826602},{"type":"v1","addr":"172.21.15.112:6837","nonce":3233826602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1854265710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1854265710},{"type":"v1","addr":"172.21.15.144:6834","nonce":1854265710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-12T16:06:59.697334+0000","modified":"2023-09-12T16:07:20.393475+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4396":{"gid":4396,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/2785398652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2785398652},{"type":"v1","addr":"172.21.15.144:6835","nonce":2785398652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-12T16:07:35.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.099+0000 7f14d43ff700 1 -- 172.21.15.112:0/2725601947 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f14b006a580 msgr2=0x7f14b006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:35.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.099+0000 7f14d43ff700 1 --2- 172.21.15.112:0/2725601947 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f14b006a580 0x7f14b006ca40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f14c8005950 tx=0x7f14c80058e0 comp rx=0 tx=0).stop 2023-09-12T16:07:35.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.099+0000 7f14d43ff700 1 -- 172.21.15.112:0/2725601947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14cc159af0 msgr2=0x7f14cc1536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:35.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.099+0000 7f14d43ff700 1 --2- 172.21.15.112:0/2725601947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14cc159af0 0x7f14cc1536f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f14cc06e500 tx=0x7f14bc004310 comp rx=0 tx=0).stop 2023-09-12T16:07:35.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.099+0000 7f14d43ff700 1 -- 172.21.15.112:0/2725601947 shutdown_connections 2023-09-12T16:07:35.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.099+0000 7f14d43ff700 1 --2- 172.21.15.112:0/2725601947 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f14b006a580 0x7f14b006ca40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:35.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.099+0000 7f14d43ff700 1 --2- 172.21.15.112:0/2725601947 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14cc070e00 0x7f14cc0afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:35.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.099+0000 7f14d43ff700 1 --2- 172.21.15.112:0/2725601947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14cc0b0660 0x7f14cc0c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:35.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.099+0000 7f14d43ff700 1 --2- 172.21.15.112:0/2725601947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14cc159af0 0x7f14cc1536f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:35.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.099+0000 7f14d43ff700 1 -- 172.21.15.112:0/2725601947 >> 172.21.15.112:0/2725601947 conn(0x7f14cc06a650 msgr2=0x7f14cc0c59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:35.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.099+0000 7f14d43ff700 1 -- 172.21.15.112:0/2725601947 shutdown_connections 2023-09-12T16:07:35.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.099+0000 7f14d43ff700 1 -- 172.21.15.112:0/2725601947 wait complete. 2023-09-12T16:07:35.103 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 9 2023-09-12T16:07:35.118 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:07:35.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.318+0000 7fe47dbff700 1 -- 172.21.15.112:0/3773414312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe460004850 msgr2=0x7fe460004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:35.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.318+0000 7fe47dbff700 1 --2- 172.21.15.112:0/3773414312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe460004850 0x7fe460004cd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009be0 tx=0x7fe460005880 comp rx=0 tx=0).stop 2023-09-12T16:07:35.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.318+0000 7fe477fff700 1 -- 172.21.15.112:0/3773414312 reap_dead start 2023-09-12T16:07:35.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.318+0000 7fe47dbff700 1 -- 172.21.15.112:0/3773414312 shutdown_connections 2023-09-12T16:07:35.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.318+0000 7fe47dbff700 1 -- 172.21.15.112:0/3773414312 >> 172.21.15.112:0/3773414312 conn(0x7fe47806a650 msgr2=0x7fe47806c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:35.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.318+0000 7fe47dbff700 1 -- 172.21.15.112:0/3773414312 shutdown_connections 2023-09-12T16:07:35.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.318+0000 7fe47dbff700 1 -- 172.21.15.112:0/3773414312 wait complete. 2023-09-12T16:07:35.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.320+0000 7fe47dbff700 1 Processor -- start 2023-09-12T16:07:35.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.320+0000 7fe47dbff700 1 -- start start 2023-09-12T16:07:35.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.321+0000 7fe47dbff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe460004850 0x7fe4780c1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:35.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.321+0000 7fe47dbff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe47814fcb0 0x7fe47814e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:35.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.321+0000 7fe47dbff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe47814e790 0x7fe47815a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:35.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.321+0000 7fe47dbff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47815ce90 con 0x7fe47814fcb0 2023-09-12T16:07:35.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.321+0000 7fe47dbff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47815cbb0 con 0x7fe460004850 2023-09-12T16:07:35.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.321+0000 7fe47dbff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780c2e10 con 0x7fe47814e790 2023-09-12T16:07:35.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.321+0000 7fe476ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe47814fcb0 0x7fe47814e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:35.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.321+0000 7fe476ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe47814fcb0 0x7fe47814e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52602/0 (socket says 172.21.15.112:52602) 2023-09-12T16:07:35.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.321+0000 7fe476ffd700 1 -- 172.21.15.112:0/940718997 learned_addr learned my addr 172.21.15.112:0/940718997 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:35.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.321+0000 7fe477fff700 1 --2- 172.21.15.112:0/940718997 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe47814e790 0x7fe47815a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:35.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.321+0000 7fe4777fe700 1 --2- 172.21.15.112:0/940718997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe460004850 0x7fe4780c1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:35.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.321+0000 7fe476ffd700 1 -- 172.21.15.112:0/940718997 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe47814e790 msgr2=0x7fe47815a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:35.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.321+0000 7fe476ffd700 1 --2- 172.21.15.112:0/940718997 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe47814e790 0x7fe47815a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:35.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.321+0000 7fe476ffd700 1 -- 172.21.15.112:0/940718997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe460004850 msgr2=0x7fe4780c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:35.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.321+0000 7fe476ffd700 1 --2- 172.21.15.112:0/940718997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe460004850 0x7fe4780c1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:35.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.321+0000 7fe476ffd700 1 -- 172.21.15.112:0/940718997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4780c30f0 con 0x7fe47814fcb0 2023-09-12T16:07:35.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.321+0000 7fe4777fe700 1 --2- 172.21.15.112:0/940718997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe460004850 0x7fe4780c1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:07:35.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.321+0000 7fe476ffd700 1 --2- 172.21.15.112:0/940718997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe47814fcb0 0x7fe47814e250 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009b00 tx=0x7fe46c00efa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:35.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.322+0000 7fe45ffff700 1 -- 172.21.15.112:0/940718997 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c003680 con 0x7fe47814fcb0 2023-09-12T16:07:35.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.322+0000 7fe45ffff700 1 -- 172.21.15.112:0/940718997 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe46c003800 con 0x7fe47814fcb0 2023-09-12T16:07:35.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.322+0000 7fe45ffff700 1 -- 172.21.15.112:0/940718997 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c003c10 con 0x7fe47814fcb0 2023-09-12T16:07:35.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.322+0000 7fe47dbff700 1 -- 172.21.15.112:0/940718997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4780c33d0 con 0x7fe47814fcb0 2023-09-12T16:07:35.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.322+0000 7fe47dbff700 1 -- 172.21.15.112:0/940718997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47815c8d0 con 0x7fe47814fcb0 2023-09-12T16:07:35.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.323+0000 7fe47dbff700 1 -- 172.21.15.112:0/940718997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47804e300 con 0x7fe47814fcb0 2023-09-12T16:07:35.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.324+0000 7fe45ffff700 1 -- 172.21.15.112:0/940718997 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe46c010430 con 0x7fe47814fcb0 2023-09-12T16:07:35.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.325+0000 7fe45ffff700 1 --2- 172.21.15.112:0/940718997 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe46406a580 0x7fe46406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:35.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.325+0000 7fe45ffff700 1 -- 172.21.15.112:0/940718997 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe46c014070 con 0x7fe47814fcb0 2023-09-12T16:07:35.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.325+0000 7fe4777fe700 1 --2- 172.21.15.112:0/940718997 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe46406a580 0x7fe46406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:35.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.325+0000 7fe4777fe700 1 --2- 172.21.15.112:0/940718997 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe46406a580 0x7fe46406ca40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe4680017a0 tx=0x7fe468001e30 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:35.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.329+0000 7fe45ffff700 1 -- 172.21.15.112:0/940718997 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe46c055c60 con 0x7fe47814fcb0 2023-09-12T16:07:35.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.532+0000 7fe47dbff700 1 -- 172.21.15.112:0/940718997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe47806d0d0 con 0x7fe47814fcb0 2023-09-12T16:07:35.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.533+0000 7fe45ffff700 1 -- 172.21.15.112:0/940718997 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fe46c059280 con 0x7fe47814fcb0 2023-09-12T16:07:35.534 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:35.534 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:04.748402+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:07:35.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.535+0000 7fe47dbff700 1 -- 172.21.15.112:0/940718997 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe46406a580 msgr2=0x7fe46406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:35.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.536+0000 7fe47dbff700 1 --2- 172.21.15.112:0/940718997 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe46406a580 0x7fe46406ca40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe4680017a0 tx=0x7fe468001e30 comp rx=0 tx=0).stop 2023-09-12T16:07:35.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.536+0000 7fe47dbff700 1 -- 172.21.15.112:0/940718997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe47814fcb0 msgr2=0x7fe47814e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:35.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.536+0000 7fe47dbff700 1 --2- 172.21.15.112:0/940718997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe47814fcb0 0x7fe47814e250 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009b00 tx=0x7fe46c00efa0 comp rx=0 tx=0).stop 2023-09-12T16:07:35.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.536+0000 7fe47dbff700 1 -- 172.21.15.112:0/940718997 shutdown_connections 2023-09-12T16:07:35.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.536+0000 7fe47dbff700 1 --2- 172.21.15.112:0/940718997 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe46406a580 0x7fe46406ca40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:35.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.536+0000 7fe47dbff700 1 --2- 172.21.15.112:0/940718997 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe47814e790 0x7fe47815a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:35.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.536+0000 7fe47dbff700 1 --2- 172.21.15.112:0/940718997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe460004850 0x7fe4780c1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:35.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.536+0000 7fe47dbff700 1 --2- 172.21.15.112:0/940718997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe47814fcb0 0x7fe47814e250 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:35.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.536+0000 7fe47dbff700 1 -- 172.21.15.112:0/940718997 >> 172.21.15.112:0/940718997 conn(0x7fe47806a650 msgr2=0x7fe4781519b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:35.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.536+0000 7fe47dbff700 1 -- 172.21.15.112:0/940718997 shutdown_connections 2023-09-12T16:07:35.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.536+0000 7fe47dbff700 1 -- 172.21.15.112:0/940718997 wait complete. 2023-09-12T16:07:35.554 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-12T16:07:35.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.754+0000 7fea6a5ff700 1 -- 172.21.15.112:0/2580713180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea50003a00 msgr2=0x7fea50003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:35.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.754+0000 7fea6a5ff700 1 --2- 172.21.15.112:0/2580713180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea50003a00 0x7fea50003e20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fea5400c2e0 tx=0x7fea50005880 comp rx=0 tx=0).stop 2023-09-12T16:07:35.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.754+0000 7fea6a5ff700 1 -- 172.21.15.112:0/2580713180 shutdown_connections 2023-09-12T16:07:35.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.754+0000 7fea6a5ff700 1 --2- 172.21.15.112:0/2580713180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea50003a00 0x7fea50003e20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:35.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.754+0000 7fea6a5ff700 1 -- 172.21.15.112:0/2580713180 >> 172.21.15.112:0/2580713180 conn(0x7fea6409ab60 msgr2=0x7fea640d1890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:35.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.754+0000 7fea6a5ff700 1 -- 172.21.15.112:0/2580713180 shutdown_connections 2023-09-12T16:07:35.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.755+0000 7fea6a5ff700 1 -- 172.21.15.112:0/2580713180 wait complete. 2023-09-12T16:07:35.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.756+0000 7fea6a5ff700 1 Processor -- start 2023-09-12T16:07:35.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.756+0000 7fea6a5ff700 1 -- start start 2023-09-12T16:07:35.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.757+0000 7fea6a5ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea50003a00 0x7fea641e4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:35.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.757+0000 7fea6a5ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea64158950 0x7fea640cb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:35.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.757+0000 7fea6a5ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fea64158dd0 0x7fea640b2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:35.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.757+0000 7fea6a5ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea641f1f20 con 0x7fea50003a00 2023-09-12T16:07:35.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.757+0000 7fea6a5ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea641594b0 con 0x7fea64158950 2023-09-12T16:07:35.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.757+0000 7fea6a5ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea641f21e0 con 0x7fea64158dd0 2023-09-12T16:07:35.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.757+0000 7fea63fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea50003a00 0x7fea641e4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:35.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.758+0000 7fea63fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea50003a00 0x7fea641e4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52608/0 (socket says 172.21.15.112:52608) 2023-09-12T16:07:35.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.758+0000 7fea63fff700 1 -- 172.21.15.112:0/2911253687 learned_addr learned my addr 172.21.15.112:0/2911253687 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:35.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.758+0000 7fea63fff700 1 -- 172.21.15.112:0/2911253687 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fea64158dd0 msgr2=0x7fea640b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:35.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.758+0000 7fea63fff700 1 --2- 172.21.15.112:0/2911253687 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fea64158dd0 0x7fea640b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:35.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.758+0000 7fea63fff700 1 -- 172.21.15.112:0/2911253687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea64158950 msgr2=0x7fea640cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:35.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.758+0000 7fea63fff700 1 --2- 172.21.15.112:0/2911253687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea64158950 0x7fea640cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:35.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.758+0000 7fea63fff700 1 -- 172.21.15.112:0/2911253687 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea641f24c0 con 0x7fea50003a00 2023-09-12T16:07:35.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.758+0000 7fea63fff700 1 --2- 172.21.15.112:0/2911253687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea50003a00 0x7fea641e4380 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fea54007010 tx=0x7fea54000f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:35.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.758+0000 7fea617fa700 1 -- 172.21.15.112:0/2911253687 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54006650 con 0x7fea50003a00 2023-09-12T16:07:35.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.758+0000 7fea617fa700 1 -- 172.21.15.112:0/2911253687 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fea54003680 con 0x7fea50003a00 2023-09-12T16:07:35.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.758+0000 7fea617fa700 1 -- 172.21.15.112:0/2911253687 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54003ab0 con 0x7fea50003a00 2023-09-12T16:07:35.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.758+0000 7fea6a5ff700 1 -- 172.21.15.112:0/2911253687 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea641f27a0 con 0x7fea50003a00 2023-09-12T16:07:35.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.758+0000 7fea6a5ff700 1 -- 172.21.15.112:0/2911253687 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea641f2df0 con 0x7fea50003a00 2023-09-12T16:07:35.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.759+0000 7fea6a5ff700 1 -- 172.21.15.112:0/2911253687 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6404e300 con 0x7fea50003a00 2023-09-12T16:07:35.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.760+0000 7fea617fa700 1 -- 172.21.15.112:0/2911253687 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fea54021020 con 0x7fea50003a00 2023-09-12T16:07:35.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.761+0000 7fea617fa700 1 --2- 172.21.15.112:0/2911253687 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fea4406a580 0x7fea4406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:35.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.761+0000 7fea617fa700 1 -- 172.21.15.112:0/2911253687 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fea5408a5c0 con 0x7fea50003a00 2023-09-12T16:07:35.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.761+0000 7fea5bfff700 1 --2- 172.21.15.112:0/2911253687 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fea4406a580 0x7fea4406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:35.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.762+0000 7fea5bfff700 1 --2- 172.21.15.112:0/2911253687 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fea4406a580 0x7fea4406ca40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fea4c006fd0 tx=0x7fea4c006de0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:35.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:35.766+0000 7fea617fa700 1 -- 172.21.15.112:0/2911253687 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fea54055840 con 0x7fea50003a00 2023-09-12T16:07:36.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.002+0000 7fea6a5ff700 1 -- 172.21.15.112:0/2911253687 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea640d1fa0 con 0x7fea50003a00 2023-09-12T16:07:36.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.003+0000 7fea617fa700 1 -- 172.21.15.112:0/2911253687 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7fea54029090 con 0x7fea50003a00 2023-09-12T16:07:36.003 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:36.003 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3995117138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3995117138},{"type":"v1","addr":"172.21.15.112:6836","nonce":3995117138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3233826602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3233826602},{"type":"v1","addr":"172.21.15.112:6837","nonce":3233826602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1854265710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1854265710},{"type":"v1","addr":"172.21.15.144:6834","nonce":1854265710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-12T16:06:59.697334+0000","modified":"2023-09-12T16:07:20.393475+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4396":{"gid":4396,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/2785398652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2785398652},{"type":"v1","addr":"172.21.15.144:6835","nonce":2785398652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-12T16:07:36.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.005+0000 7fea6a5ff700 1 -- 172.21.15.112:0/2911253687 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fea4406a580 msgr2=0x7fea4406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:36.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.005+0000 7fea6a5ff700 1 --2- 172.21.15.112:0/2911253687 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fea4406a580 0x7fea4406ca40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fea4c006fd0 tx=0x7fea4c006de0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.005+0000 7fea6a5ff700 1 -- 172.21.15.112:0/2911253687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea50003a00 msgr2=0x7fea641e4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:36.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.005+0000 7fea6a5ff700 1 --2- 172.21.15.112:0/2911253687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea50003a00 0x7fea641e4380 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fea54007010 tx=0x7fea54000f80 comp rx=0 tx=0).stop 2023-09-12T16:07:36.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.005+0000 7fea6a5ff700 1 -- 172.21.15.112:0/2911253687 shutdown_connections 2023-09-12T16:07:36.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.005+0000 7fea6a5ff700 1 --2- 172.21.15.112:0/2911253687 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fea4406a580 0x7fea4406ca40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.005+0000 7fea6a5ff700 1 --2- 172.21.15.112:0/2911253687 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fea64158dd0 0x7fea640b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.005+0000 7fea6a5ff700 1 --2- 172.21.15.112:0/2911253687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea50003a00 0x7fea641e4380 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.005+0000 7fea6a5ff700 1 --2- 172.21.15.112:0/2911253687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea64158950 0x7fea640cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.005+0000 7fea6a5ff700 1 -- 172.21.15.112:0/2911253687 >> 172.21.15.112:0/2911253687 conn(0x7fea6409ab60 msgr2=0x7fea6415eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:36.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.005+0000 7fea6a5ff700 1 -- 172.21.15.112:0/2911253687 shutdown_connections 2023-09-12T16:07:36.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.005+0000 7fea6a5ff700 1 -- 172.21.15.112:0/2911253687 wait complete. 2023-09-12T16:07:36.009 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 9 2023-09-12T16:07:36.426 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-12T16:06:59.697334+0000', 'modified': '2023-09-12T16:07:20.393475+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4396}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4396': {'gid': 4396, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6835/2785398652', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6833', 'nonce': 2785398652}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 2785398652}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-12T16:07:36.426 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-12T16:07:36.427 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-09-12T16:07:36.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.631+0000 7f7ac51ff700 1 -- 172.21.15.112:0/912161534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ac00d0590 msgr2=0x7f7ac00cc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:36.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.631+0000 7f7ac51ff700 1 --2- 172.21.15.112:0/912161534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ac00d0590 0x7f7ac00cc8f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0089340 tx=0x7f7ab800b380 comp rx=0 tx=0).stop 2023-09-12T16:07:36.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.631+0000 7f7ac51ff700 1 -- 172.21.15.112:0/912161534 shutdown_connections 2023-09-12T16:07:36.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.631+0000 7f7ac51ff700 1 --2- 172.21.15.112:0/912161534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ac00d0590 0x7f7ac00cc8f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.631+0000 7f7ac51ff700 1 --2- 172.21.15.112:0/912161534 >> v2:172.21.15.144:3300/0 conn(0x7f7ac00cdfb0 0x7f7ac00cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.631+0000 7f7ac51ff700 1 -- 172.21.15.112:0/912161534 >> 172.21.15.112:0/912161534 conn(0x7f7ac00d1930 msgr2=0x7f7ac00d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:36.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.631+0000 7f7ac51ff700 1 -- 172.21.15.112:0/912161534 shutdown_connections 2023-09-12T16:07:36.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.631+0000 7f7ac51ff700 1 -- 172.21.15.112:0/912161534 wait complete. 2023-09-12T16:07:36.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.633+0000 7f7ac51ff700 1 Processor -- start 2023-09-12T16:07:36.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.633+0000 7f7ac51ff700 1 -- start start 2023-09-12T16:07:36.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.634+0000 7f7ac51ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ac00cdfb0 0x7f7ac014e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:36.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.634+0000 7f7ac51ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ac00d0590 0x7f7ac01f1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:36.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.634+0000 7f7ac51ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ac015f480 0x7f7ac00caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:36.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.634+0000 7f7ac51ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac014f290 con 0x7f7ac015f480 2023-09-12T16:07:36.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.634+0000 7f7ac51ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac00cafc0 con 0x7f7ac00cdfb0 2023-09-12T16:07:36.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.634+0000 7f7ac51ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac009ecd0 con 0x7f7ac00d0590 2023-09-12T16:07:36.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.634+0000 7f7abf59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ac015f480 0x7f7ac00caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:36.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.634+0000 7f7abf59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ac015f480 0x7f7ac00caa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52050/0 (socket says 172.21.15.112:52050) 2023-09-12T16:07:36.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.634+0000 7f7abf59e700 1 -- 172.21.15.112:0/493959692 learned_addr learned my addr 172.21.15.112:0/493959692 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:36.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.634+0000 7f7abed9d700 1 --2- 172.21.15.112:0/493959692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ac00cdfb0 0x7f7ac014e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:36.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.634+0000 7f7abe59c700 1 --2- 172.21.15.112:0/493959692 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ac00d0590 0x7f7ac01f1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:36.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.634+0000 7f7abf59e700 1 -- 172.21.15.112:0/493959692 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ac00d0590 msgr2=0x7f7ac01f1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:36.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.634+0000 7f7abf59e700 1 --2- 172.21.15.112:0/493959692 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ac00d0590 0x7f7ac01f1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.634+0000 7f7abf59e700 1 -- 172.21.15.112:0/493959692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ac00cdfb0 msgr2=0x7f7ac014e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:36.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.634+0000 7f7abf59e700 1 --2- 172.21.15.112:0/493959692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ac00cdfb0 0x7f7ac014e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.634+0000 7f7abf59e700 1 -- 172.21.15.112:0/493959692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab8009d00 con 0x7f7ac015f480 2023-09-12T16:07:36.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.634+0000 7f7abe59c700 1 --2- 172.21.15.112:0/493959692 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ac00d0590 0x7f7ac01f1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:36.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.634+0000 7f7abed9d700 1 --2- 172.21.15.112:0/493959692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ac00cdfb0 0x7f7ac014e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:36.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.635+0000 7f7abf59e700 1 --2- 172.21.15.112:0/493959692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ac015f480 0x7f7ac00caa80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7ac008b1f0 tx=0x7f7ab8009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:36.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.635+0000 7f7aa77fe700 1 -- 172.21.15.112:0/493959692 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab800e040 con 0x7f7ac015f480 2023-09-12T16:07:36.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.635+0000 7f7aa77fe700 1 -- 172.21.15.112:0/493959692 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7ab8007b00 con 0x7f7ac015f480 2023-09-12T16:07:36.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.635+0000 7f7ac51ff700 1 -- 172.21.15.112:0/493959692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac009f530 con 0x7f7ac015f480 2023-09-12T16:07:36.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.635+0000 7f7aa77fe700 1 -- 172.21.15.112:0/493959692 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8004030 con 0x7f7ac015f480 2023-09-12T16:07:36.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.635+0000 7f7ac51ff700 1 -- 172.21.15.112:0/493959692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac009f250 con 0x7f7ac015f480 2023-09-12T16:07:36.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.637+0000 7f7aa77fe700 1 -- 172.21.15.112:0/493959692 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f7ab8004190 con 0x7f7ac015f480 2023-09-12T16:07:36.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.639+0000 7f7aa77fe700 1 --2- 172.21.15.112:0/493959692 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7aac06a580 0x7f7aac06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:36.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.639+0000 7f7aa77fe700 1 -- 172.21.15.112:0/493959692 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7ab808a4c0 con 0x7f7ac015f480 2023-09-12T16:07:36.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.639+0000 7f7abed9d700 1 --2- 172.21.15.112:0/493959692 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7aac06a580 0x7f7aac06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:36.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.639+0000 7f7abed9d700 1 --2- 172.21.15.112:0/493959692 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7aac06a580 0x7f7aac06ca40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000a8b0 tx=0x7f7ab0008040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:36.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.640+0000 7f7ad8bacb80 1 Processor -- start 2023-09-12T16:07:36.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.641+0000 7f7ad8bacb80 1 -- start start 2023-09-12T16:07:36.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.641+0000 7f7ad8bacb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2303275e0 0x55e2303279c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:36.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.641+0000 7f7ad8bacb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e2302fa990 0x55e2302fd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:36.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.641+0000 7f7ad8bacb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e2302f8a80 0x55e2303247d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:36.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.641+0000 7f7ad8bacb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e230265ca0 con 0x55e2303275e0 2023-09-12T16:07:36.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.641+0000 7f7ad8bacb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e230255670 con 0x55e2302fa990 2023-09-12T16:07:36.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.641+0000 7f7ad8bacb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e230252dd0 con 0x55e2302f8a80 2023-09-12T16:07:36.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.642+0000 7f7abed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2303275e0 0x55e2303279c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:36.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.642+0000 7f7abed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2303275e0 0x55e2303279c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52066/0 (socket says 172.21.15.112:52066) 2023-09-12T16:07:36.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.642+0000 7f7abed9d700 1 -- 172.21.15.112:0/1640969377 learned_addr learned my addr 172.21.15.112:0/1640969377 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:36.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.642+0000 7f7abf59e700 1 --2- 172.21.15.112:0/1640969377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e2302f8a80 0x55e2303247d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:36.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.642+0000 7f7abe59c700 1 --2- 172.21.15.112:0/1640969377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e2302fa990 0x55e2302fd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:36.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.642+0000 7f7abed9d700 1 -- 172.21.15.112:0/1640969377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e2302f8a80 msgr2=0x55e2303247d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-12T16:07:36.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.642+0000 7f7abed9d700 1 --2- 172.21.15.112:0/1640969377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e2302f8a80 0x55e2303247d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.642+0000 7f7abed9d700 1 -- 172.21.15.112:0/1640969377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e2302fa990 msgr2=0x55e2302fd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-12T16:07:36.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.642+0000 7f7abed9d700 1 --2- 172.21.15.112:0/1640969377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e2302fa990 0x55e2302fd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.642+0000 7f7abed9d700 1 -- 172.21.15.112:0/1640969377 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e230040790 con 0x55e2303275e0 2023-09-12T16:07:36.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.642+0000 7f7abed9d700 1 --2- 172.21.15.112:0/1640969377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2303275e0 0x55e2303279c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0013930 tx=0x7f7ab000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b211d82d9aca897f server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:36.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.643+0000 7f7aa4ff9700 1 -- 172.21.15.112:0/1640969377 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0004230 con 0x55e2303275e0 2023-09-12T16:07:36.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.643+0000 7f7aa4ff9700 1 -- 172.21.15.112:0/1640969377 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7ab0004390 con 0x55e2303275e0 2023-09-12T16:07:36.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.643+0000 7f7aa4ff9700 1 -- 172.21.15.112:0/1640969377 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00116e0 con 0x55e2303275e0 2023-09-12T16:07:36.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.643+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/1640969377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2303275e0 msgr2=0x55e2303279c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:36.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.643+0000 7f7ad8bacb80 1 --2- 172.21.15.112:0/1640969377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2303275e0 0x55e2303279c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0013930 tx=0x7f7ab000f000 comp rx=0 tx=0).stop 2023-09-12T16:07:36.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.643+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/1640969377 shutdown_connections 2023-09-12T16:07:36.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.643+0000 7f7ad8bacb80 1 --2- 172.21.15.112:0/1640969377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e2302f8a80 0x55e2303247d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.643+0000 7f7ad8bacb80 1 --2- 172.21.15.112:0/1640969377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2303275e0 0x55e2303279c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.643+0000 7f7ad8bacb80 1 --2- 172.21.15.112:0/1640969377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e2302fa990 0x55e2302fd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.643+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/1640969377 >> 172.21.15.112:0/1640969377 conn(0x55e23022a530 msgr2=0x55e2303423f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:36.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.643+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/1640969377 shutdown_connections 2023-09-12T16:07:36.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.643+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/1640969377 wait complete. 2023-09-12T16:07:36.655 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.644+0000 7f7ad8bacb80 1 -- start start 2023-09-12T16:07:36.655 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.644+0000 7f7ad8bacb80 1 Processor -- start 2023-09-12T16:07:36.655 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.645+0000 7f7ad8bacb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e2302f8a80 0x55e23032a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:36.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.645+0000 7f7ad8bacb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e2302fa990 0x55e23032af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:36.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.645+0000 7f7ad8bacb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2303275e0 0x55e2303255c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:36.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.645+0000 7f7ad8bacb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e23024e6c0 con 0x55e2303275e0 2023-09-12T16:07:36.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.645+0000 7f7ad8bacb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e23020a790 con 0x55e2302f8a80 2023-09-12T16:07:36.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.645+0000 7f7ad8bacb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e2301f0af0 con 0x55e2302fa990 2023-09-12T16:07:36.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.646+0000 7f7ad8bacb80 10 client.0 _ll_register_callbacks cb 0x55e2300545a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-12T16:07:36.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.646+0000 7f7abf59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2303275e0 0x55e2303255c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:36.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.646+0000 7f7abf59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2303275e0 0x55e2303255c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52076/0 (socket says 172.21.15.112:52076) 2023-09-12T16:07:36.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.646+0000 7f7abf59e700 1 -- 172.21.15.112:0/2763029811 learned_addr learned my addr 172.21.15.112:0/2763029811 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:36.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.646+0000 7f7abf59e700 1 -- 172.21.15.112:0/2763029811 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e2302fa990 msgr2=0x55e23032af00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-12T16:07:36.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.646+0000 7f7abf59e700 1 --2- 172.21.15.112:0/2763029811 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e2302fa990 0x55e23032af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.646+0000 7f7abf59e700 1 -- 172.21.15.112:0/2763029811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e2302f8a80 msgr2=0x55e23032a9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-12T16:07:36.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.646+0000 7f7abf59e700 1 --2- 172.21.15.112:0/2763029811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e2302f8a80 0x55e23032a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.646+0000 7f7abf59e700 1 -- 172.21.15.112:0/2763029811 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab00136a0 con 0x55e2303275e0 2023-09-12T16:07:36.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.646+0000 7f7abf59e700 1 --2- 172.21.15.112:0/2763029811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2303275e0 0x55e2303255c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8055900 tx=0x7f7ab800b380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13db2fa9e6c01b29 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:36.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.646+0000 7f7a9dffb700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-09-12T16:07:36.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.647+0000 7f7a9dffb700 1 -- 172.21.15.112:0/2763029811 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8025570 con 0x55e2303275e0 2023-09-12T16:07:36.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.647+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/2763029811 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e2302ef980 con 0x55e2303275e0 2023-09-12T16:07:36.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.647+0000 7f7a9dffb700 1 -- 172.21.15.112:0/2763029811 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7ab805d230 con 0x55e2303275e0 2023-09-12T16:07:36.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.647+0000 7f7a9dffb700 1 -- 172.21.15.112:0/2763029811 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ab80613e0 con 0x55e2303275e0 2023-09-12T16:07:36.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.647+0000 7f7ad8bacb80 10 client.4860 fetch_fsmap learned FSMap version 9 2023-09-12T16:07:36.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.647+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/2763029811 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55e23012d0a0 con 0x55e2303275e0 2023-09-12T16:07:36.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.647+0000 7f7a9dffb700 1 -- 172.21.15.112:0/2763029811 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x55e2302ef980 con 0x55e2303275e0 2023-09-12T16:07:36.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.647+0000 7f7a9dffb700 1 -- 172.21.15.112:0/2763029811 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f7ab8059750 con 0x55e2303275e0 2023-09-12T16:07:36.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.647+0000 7f7ad8bacb80 10 client.4860 fetch_fsmap finished waiting for FSMap version 9 2023-09-12T16:07:36.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.647+0000 7f7ad8bacb80 10 client.4860 resolve_mds: resolved name 'd' to daemon mds.d 2023-09-12T16:07:36.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.647+0000 7f7ad8bacb80 20 client.4860 populate_metadata read hostname 'smithi112' 2023-09-12T16:07:36.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.647+0000 7f7ad8bacb80 1 --2- 172.21.15.112:0/2763029811 >> [v2:172.21.15.144:6833/2785398652,v1:172.21.15.144:6835/2785398652] conn(0x55e2303557a0 0x55e230355b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:36.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.647+0000 7f7ad8bacb80 4 client.4860 mds_command: new command op to 4396 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-12T16:07:36.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.647+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/2763029811 --> [v2:172.21.15.144:6833/2785398652,v1:172.21.15.144:6835/2785398652] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e2302cbe90 con 0x55e2303557a0 2023-09-12T16:07:36.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.647+0000 7f7abed9d700 1 --2- 172.21.15.112:0/2763029811 >> [v2:172.21.15.144:6833/2785398652,v1:172.21.15.144:6835/2785398652] conn(0x55e2303557a0 0x55e230355b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:36.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.648+0000 7f7abed9d700 1 --2- 172.21.15.112:0/2763029811 >> [v2:172.21.15.144:6833/2785398652,v1:172.21.15.144:6835/2785398652] conn(0x55e2303557a0 0x55e230355b80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5050ec122032cc2f server_cookie=a94745c0e74ea79e in_seq=0 out_seq=0 2023-09-12T16:07:36.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.648+0000 7f7a9dffb700 10 client.4860 ms_handle_connect on v2:172.21.15.144:6833/2785398652 2023-09-12T16:07:36.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.649+0000 7f7a9dffb700 1 -- 172.21.15.112:0/2763029811 <== mds.0 v2:172.21.15.144:6833/2785398652 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e2302cbe90 con 0x55e2303557a0 2023-09-12T16:07:36.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.649+0000 7f7a9dffb700 10 client.4860 handle_command_reply: tid=0 2023-09-12T16:07:36.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.649+0000 7f7ad8bacb80 1 client.4860 shutdown 2023-09-12T16:07:36.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.649+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/2763029811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2303275e0 msgr2=0x55e2303255c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:36.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.649+0000 7f7ad8bacb80 1 --2- 172.21.15.112:0/2763029811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2303275e0 0x55e2303255c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8055900 tx=0x7f7ab800b380 comp rx=0 tx=0).stop 2023-09-12T16:07:36.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.649+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/2763029811 shutdown_connections 2023-09-12T16:07:36.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.649+0000 7f7ad8bacb80 1 --2- 172.21.15.112:0/2763029811 >> [v2:172.21.15.144:6833/2785398652,v1:172.21.15.144:6835/2785398652] conn(0x55e2303557a0 0x55e230355b80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.649+0000 7f7ad8bacb80 1 --2- 172.21.15.112:0/2763029811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2303275e0 0x55e2303255c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.649+0000 7f7ad8bacb80 1 --2- 172.21.15.112:0/2763029811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e2302f8a80 0x55e23032a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.649+0000 7f7a9dffb700 0 client.4860 ms_handle_reset on v2:172.21.15.144:6833/2785398652 2023-09-12T16:07:36.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.649+0000 7f7ad8bacb80 1 --2- 172.21.15.112:0/2763029811 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e2302fa990 0x55e23032af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.649+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/2763029811 >> 172.21.15.112:0/2763029811 conn(0x55e23022a530 msgr2=0x55e2302fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:36.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.649+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/2763029811 shutdown_connections 2023-09-12T16:07:36.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.649+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/2763029811 wait complete. 2023-09-12T16:07:36.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.650+0000 7f7ad8bacb80 20 client.4860 trim_cache size 0 max 16384 2023-09-12T16:07:36.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.668+0000 7f7ad8bacb80 1 Processor -- start 2023-09-12T16:07:36.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.668+0000 7f7ad8bacb80 1 -- start start 2023-09-12T16:07:36.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.669+0000 7f7ad8bacb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e2302f8a80 0x55e2302fe110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:36.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.669+0000 7f7ad8bacb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2302fa990 0x55e2302f7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:36.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.669+0000 7f7ad8bacb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e2303275e0 0x55e2302f7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:36.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.669+0000 7f7ad8bacb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e230041390 con 0x55e2302fa990 2023-09-12T16:07:36.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.669+0000 7f7ad8bacb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e23034f3c0 con 0x55e2303275e0 2023-09-12T16:07:36.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.669+0000 7f7ad8bacb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e230250640 con 0x55e2302f8a80 2023-09-12T16:07:36.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.669+0000 7f7abe59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2302fa990 0x55e2302f7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:36.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.669+0000 7f7abe59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2302fa990 0x55e2302f7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52090/0 (socket says 172.21.15.112:52090) 2023-09-12T16:07:36.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.669+0000 7f7abe59c700 1 -- 172.21.15.112:0/930930818 learned_addr learned my addr 172.21.15.112:0/930930818 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:36.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.669+0000 7f7abed9d700 1 --2- 172.21.15.112:0/930930818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e2302f8a80 0x55e2302fe110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:36.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.669+0000 7f7abf59e700 1 --2- 172.21.15.112:0/930930818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e2303275e0 0x55e2302f7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:36.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.669+0000 7f7abe59c700 1 -- 172.21.15.112:0/930930818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e2302f8a80 msgr2=0x55e2302fe110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-12T16:07:36.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.669+0000 7f7abe59c700 1 --2- 172.21.15.112:0/930930818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e2302f8a80 0x55e2302fe110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.669+0000 7f7abe59c700 1 -- 172.21.15.112:0/930930818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e2303275e0 msgr2=0x55e2302f7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-12T16:07:36.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.669+0000 7f7abe59c700 1 --2- 172.21.15.112:0/930930818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e2303275e0 0x55e2302f7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.669+0000 7f7abe59c700 1 -- 172.21.15.112:0/930930818 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e230212b90 con 0x55e2302fa990 2023-09-12T16:07:36.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.670+0000 7f7abe59c700 1 --2- 172.21.15.112:0/930930818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2302fa990 0x55e2302f7680 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00b3690 tx=0x7f7ab4009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e3ac2702e85d4f server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:36.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.670+0000 7f7aa57fa700 1 -- 172.21.15.112:0/930930818 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4004220 con 0x55e2302fa990 2023-09-12T16:07:36.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.670+0000 7f7aa57fa700 1 -- 172.21.15.112:0/930930818 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7ab4004490 con 0x55e2302fa990 2023-09-12T16:07:36.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.670+0000 7f7aa57fa700 1 -- 172.21.15.112:0/930930818 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4004a90 con 0x55e2302fa990 2023-09-12T16:07:36.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.670+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/930930818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2302fa990 msgr2=0x55e2302f7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:36.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.670+0000 7f7ad8bacb80 1 --2- 172.21.15.112:0/930930818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2302fa990 0x55e2302f7680 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00b3690 tx=0x7f7ab4009e00 comp rx=0 tx=0).stop 2023-09-12T16:07:36.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.670+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/930930818 shutdown_connections 2023-09-12T16:07:36.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.670+0000 7f7ad8bacb80 1 --2- 172.21.15.112:0/930930818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e2302f8a80 0x55e2302fe110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.670+0000 7f7ad8bacb80 1 --2- 172.21.15.112:0/930930818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e2303275e0 0x55e2302f7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.670+0000 7f7ad8bacb80 1 --2- 172.21.15.112:0/930930818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2302fa990 0x55e2302f7680 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.670+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/930930818 >> 172.21.15.112:0/930930818 conn(0x55e23022a530 msgr2=0x55e230327f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:36.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.670+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/930930818 shutdown_connections 2023-09-12T16:07:36.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.670+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/930930818 wait complete. 2023-09-12T16:07:36.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.671+0000 7f7ad8bacb80 1 -- start start 2023-09-12T16:07:36.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.671+0000 7f7ad8bacb80 1 Processor -- start 2023-09-12T16:07:36.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.672+0000 7f7ad8bacb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e2302f8a80 0x55e2303ac580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:36.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.672+0000 7f7ad8bacb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e2302fa990 0x55e2303acac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:36.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.672+0000 7f7ad8bacb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2303275e0 0x55e2302f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:36.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.672+0000 7f7ad8bacb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2302fe430 con 0x55e2303275e0 2023-09-12T16:07:36.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.672+0000 7f7ad8bacb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e230343b30 con 0x55e2302fa990 2023-09-12T16:07:36.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.672+0000 7f7ad8bacb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e2302fe1e0 con 0x55e2302f8a80 2023-09-12T16:07:36.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.672+0000 7f7ad8bacb80 10 client.0 _ll_register_callbacks cb 0x7f7ab8058f60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-12T16:07:36.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.673+0000 7f7abf59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2303275e0 0x55e2302f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:36.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.673+0000 7f7abf59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2303275e0 0x55e2302f6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52094/0 (socket says 172.21.15.112:52094) 2023-09-12T16:07:36.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.673+0000 7f7abf59e700 1 -- 172.21.15.112:0/1880611441 learned_addr learned my addr 172.21.15.112:0/1880611441 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:36.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.673+0000 7f7abed9d700 1 --2- 172.21.15.112:0/1880611441 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e2302f8a80 0x55e2303ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:36.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.673+0000 7f7abf59e700 1 -- 172.21.15.112:0/1880611441 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e2302f8a80 msgr2=0x55e2303ac580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-12T16:07:36.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.673+0000 7f7abf59e700 1 --2- 172.21.15.112:0/1880611441 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e2302f8a80 0x55e2303ac580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.673+0000 7f7abf59e700 1 -- 172.21.15.112:0/1880611441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e2302fa990 msgr2=0x55e2303acac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-12T16:07:36.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.673+0000 7f7abe59c700 1 --2- 172.21.15.112:0/1880611441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e2302fa990 0x55e2303acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:36.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.673+0000 7f7abf59e700 1 --2- 172.21.15.112:0/1880611441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e2302fa990 0x55e2303acac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.673+0000 7f7abf59e700 1 -- 172.21.15.112:0/1880611441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab4009780 con 0x55e2303275e0 2023-09-12T16:07:36.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.673+0000 7f7abed9d700 1 --2- 172.21.15.112:0/1880611441 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e2302f8a80 0x55e2303ac580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:36.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.673+0000 7f7abe59c700 1 --2- 172.21.15.112:0/1880611441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e2302fa990 0x55e2303acac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:36.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.673+0000 7f7abf59e700 1 --2- 172.21.15.112:0/1880611441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2303275e0 0x55e2302f6a00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800bfd0 tx=0x7f7ab805d230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20259560864e33ab server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:36.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.673+0000 7f7a9dffb700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-09-12T16:07:36.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.673+0000 7f7a9dffb700 1 -- 172.21.15.112:0/1880611441 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8061150 con 0x55e2303275e0 2023-09-12T16:07:36.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.673+0000 7f7a9dffb700 1 -- 172.21.15.112:0/1880611441 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7ab8025580 con 0x55e2303275e0 2023-09-12T16:07:36.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.673+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/1880611441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7ab0004390 con 0x55e2303275e0 2023-09-12T16:07:36.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.674+0000 7f7a9dffb700 1 -- 172.21.15.112:0/1880611441 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ab80613e0 con 0x55e2303275e0 2023-09-12T16:07:36.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.674+0000 7f7ad8bacb80 10 client.4866 fetch_fsmap learned FSMap version 9 2023-09-12T16:07:36.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.674+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/1880611441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55e2300a11d0 con 0x55e2303275e0 2023-09-12T16:07:36.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.674+0000 7f7a9dffb700 1 -- 172.21.15.112:0/1880611441 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7ab0004390 con 0x55e2303275e0 2023-09-12T16:07:36.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.674+0000 7f7a9dffb700 1 -- 172.21.15.112:0/1880611441 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f7ab805f1a0 con 0x55e2303275e0 2023-09-12T16:07:36.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.674+0000 7f7ad8bacb80 10 client.4866 fetch_fsmap finished waiting for FSMap version 9 2023-09-12T16:07:36.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.674+0000 7f7ad8bacb80 10 client.4866 resolve_mds: resolved name 'd' to daemon mds.d 2023-09-12T16:07:36.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.674+0000 7f7ad8bacb80 20 client.4866 populate_metadata read hostname 'smithi112' 2023-09-12T16:07:36.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.674+0000 7f7ad8bacb80 1 --2- 172.21.15.112:0/1880611441 >> [v2:172.21.15.144:6833/2785398652,v1:172.21.15.144:6835/2785398652] conn(0x55e23034ab10 0x55e23034aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:36.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.674+0000 7f7ad8bacb80 4 client.4866 mds_command: new command op to 4396 tid=0[{"prefix": "status"}] 2023-09-12T16:07:36.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.674+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/1880611441 --> [v2:172.21.15.144:6833/2785398652,v1:172.21.15.144:6835/2785398652] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e230247800 con 0x55e23034ab10 2023-09-12T16:07:36.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.674+0000 7f7abed9d700 1 --2- 172.21.15.112:0/1880611441 >> [v2:172.21.15.144:6833/2785398652,v1:172.21.15.144:6835/2785398652] conn(0x55e23034ab10 0x55e23034aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:36.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.675+0000 7f7a9dffb700 10 client.4866 ms_handle_connect on v2:172.21.15.144:6833/2785398652 2023-09-12T16:07:36.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.675+0000 7f7abed9d700 1 --2- 172.21.15.112:0/1880611441 >> [v2:172.21.15.144:6833/2785398652,v1:172.21.15.144:6835/2785398652] conn(0x55e23034ab10 0x55e23034aef0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=324f7855b58d401e server_cookie=b1f5de0e41b65f6d in_seq=0 out_seq=0 2023-09-12T16:07:36.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.675+0000 7f7a9dffb700 1 -- 172.21.15.112:0/1880611441 <== mds.0 v2:172.21.15.144:6833/2785398652 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55e230247800 con 0x55e23034ab10 2023-09-12T16:07:36.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.675+0000 7f7a9dffb700 10 client.4866 handle_command_reply: tid=0 2023-09-12T16:07:36.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.675+0000 7f7ad8bacb80 1 client.4866 shutdown 2023-09-12T16:07:36.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.675+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/1880611441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2303275e0 msgr2=0x55e2302f6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:36.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.675+0000 7f7ad8bacb80 1 --2- 172.21.15.112:0/1880611441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2303275e0 0x55e2302f6a00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800bfd0 tx=0x7f7ab805d230 comp rx=0 tx=0).stop 2023-09-12T16:07:36.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.675+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/1880611441 shutdown_connections 2023-09-12T16:07:36.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.675+0000 7f7ad8bacb80 1 --2- 172.21.15.112:0/1880611441 >> [v2:172.21.15.144:6833/2785398652,v1:172.21.15.144:6835/2785398652] conn(0x55e23034ab10 0x55e23034aef0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.675+0000 7f7ad8bacb80 1 --2- 172.21.15.112:0/1880611441 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e2302f8a80 0x55e2303ac580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.675+0000 7f7ad8bacb80 1 --2- 172.21.15.112:0/1880611441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2303275e0 0x55e2302f6a00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.675+0000 7f7a9dffb700 0 client.4866 ms_handle_reset on v2:172.21.15.144:6833/2785398652 2023-09-12T16:07:36.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.675+0000 7f7ad8bacb80 1 --2- 172.21.15.112:0/1880611441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e2302fa990 0x55e2303acac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.675+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/1880611441 >> 172.21.15.112:0/1880611441 conn(0x55e23022a530 msgr2=0x55e2303546c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:36.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.675+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/1880611441 shutdown_connections 2023-09-12T16:07:36.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.675+0000 7f7ad8bacb80 1 -- 172.21.15.112:0/1880611441 wait complete. 2023-09-12T16:07:36.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.676+0000 7f7ad8bacb80 20 client.4866 trim_cache size 0 max 16384 2023-09-12T16:07:36.690 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-09-12T16:07:36.691 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "81d9ebed-ec6c-4564-a5d4-cdbd74c977f8", 2023-09-12T16:07:36.691 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2023-09-12T16:07:36.691 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 4396, 2023-09-12T16:07:36.691 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2023-09-12T16:07:36.691 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2023-09-12T16:07:36.691 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2023-09-12T16:07:36.692 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 36.465096727000002, 2023-09-12T16:07:36.692 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 9, 2023-09-12T16:07:36.692 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 24, 2023-09-12T16:07:36.692 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 24, 2023-09-12T16:07:36.692 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 41.481331060999999 2023-09-12T16:07:36.693 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-09-12T16:07:36.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.676+0000 7f7ac51ff700 1 -- 172.21.15.112:0/493959692 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7aac06a580 msgr2=0x7f7aac06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:36.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.676+0000 7f7ac51ff700 1 --2- 172.21.15.112:0/493959692 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7aac06a580 0x7f7aac06ca40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000a8b0 tx=0x7f7ab0008040 comp rx=0 tx=0).stop 2023-09-12T16:07:36.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.676+0000 7f7ac51ff700 1 -- 172.21.15.112:0/493959692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ac015f480 msgr2=0x7f7ac00caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:36.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.676+0000 7f7ac51ff700 1 --2- 172.21.15.112:0/493959692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ac015f480 0x7f7ac00caa80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7ac008b1f0 tx=0x7f7ab8009740 comp rx=0 tx=0).stop 2023-09-12T16:07:36.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.676+0000 7f7ac51ff700 1 -- 172.21.15.112:0/493959692 shutdown_connections 2023-09-12T16:07:36.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.676+0000 7f7ac51ff700 1 --2- 172.21.15.112:0/493959692 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7aac06a580 0x7f7aac06ca40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.676+0000 7f7ac51ff700 1 --2- 172.21.15.112:0/493959692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ac015f480 0x7f7ac00caa80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.676+0000 7f7ac51ff700 1 --2- 172.21.15.112:0/493959692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ac00cdfb0 0x7f7ac014e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.676+0000 7f7ac51ff700 1 --2- 172.21.15.112:0/493959692 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ac00d0590 0x7f7ac01f1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:36.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.676+0000 7f7ac51ff700 1 -- 172.21.15.112:0/493959692 >> 172.21.15.112:0/493959692 conn(0x7f7ac00d1930 msgr2=0x7f7ac00c7310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:36.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.676+0000 7f7ac51ff700 1 -- 172.21.15.112:0/493959692 shutdown_connections 2023-09-12T16:07:36.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:36.676+0000 7f7ac51ff700 1 -- 172.21.15.112:0/493959692 wait complete. 2023-09-12T16:07:36.697 INFO:teuthology.run_tasks:Running task kclient... 2023-09-12T16:07:36.711 INFO:tasks.kclient:Mounting kernel clients... 2023-09-12T16:07:36.712 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-09-12T16:07:36.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:36.712 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-09-12T16:07:36.759 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-09-12T16:07:36.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:36.761 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-09-12T16:07:36.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:36.833 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2023-09-12T16:07:36.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:36.944 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-09-12T16:07:36.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:36.996 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2023-09-12T16:07:37.069 INFO:teuthology.orchestra.run.smithi112.stderr:Cannot find device "ceph-brx" 2023-09-12T16:07:37.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-12T16:07:37.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:37.073 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-09-12T16:07:37.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:37.125 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2023-09-12T16:07:37.201 INFO:teuthology.orchestra.run.smithi144.stderr:Cannot find device "ceph-brx" 2023-09-12T16:07:37.204 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-12T16:07:37.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:37.205 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-09-12T16:07:37.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:37.253 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2023-09-12T16:07:37.364 INFO:teuthology.orchestra.run.smithi144.stderr:Cannot find device "ceph-brx" 2023-09-12T16:07:37.366 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-12T16:07:37.367 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-09-12T16:07:37.367 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-12T16:07:37.367 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-12T16:07:37.368 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-12T16:07:37.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.569+0000 7f43729ff700 1 -- 172.21.15.112:0/2281412883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f436c0c9ac0 msgr2=0x7f436c0c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:37.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.569+0000 7f43729ff700 1 --2- 172.21.15.112:0/2281412883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f436c0c9ac0 0x7f436c0c8110 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4354005fd0 tx=0x7f4354009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:37.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.569+0000 7f43729ff700 1 -- 172.21.15.112:0/2281412883 shutdown_connections 2023-09-12T16:07:37.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.569+0000 7f43729ff700 1 --2- 172.21.15.112:0/2281412883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f436c0c9ac0 0x7f436c0c8110 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:37.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.569+0000 7f43729ff700 1 -- 172.21.15.112:0/2281412883 >> 172.21.15.112:0/2281412883 conn(0x7f436c06a650 msgr2=0x7f436c06c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:37.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.569+0000 7f43729ff700 1 -- 172.21.15.112:0/2281412883 shutdown_connections 2023-09-12T16:07:37.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.569+0000 7f43729ff700 1 -- 172.21.15.112:0/2281412883 wait complete. 2023-09-12T16:07:37.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.572+0000 7f43729ff700 1 Processor -- start 2023-09-12T16:07:37.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.572+0000 7f43729ff700 1 -- start start 2023-09-12T16:07:37.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.573+0000 7f43729ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f436c0cdb50 0x7f436c1efb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:37.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.573+0000 7f43729ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f436c159af0 0x7f436c0c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:37.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.573+0000 7f43729ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f436c0b1ab0 0x7f436c0b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:37.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.573+0000 7f43729ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c1f00a0 con 0x7f436c159af0 2023-09-12T16:07:37.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.573+0000 7f43729ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c0c5700 con 0x7f436c0b1ab0 2023-09-12T16:07:37.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.573+0000 7f43729ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436c0c5950 con 0x7f436c0cdb50 2023-09-12T16:07:37.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.573+0000 7f4363fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f436c159af0 0x7f436c0c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:37.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.574+0000 7f4363fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f436c159af0 0x7f436c0c69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52114/0 (socket says 172.21.15.112:52114) 2023-09-12T16:07:37.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.574+0000 7f4363fff700 1 -- 172.21.15.112:0/2068158655 learned_addr learned my addr 172.21.15.112:0/2068158655 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:37.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.574+0000 7f436bfff700 1 --2- 172.21.15.112:0/2068158655 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f436c0cdb50 0x7f436c1efb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:37.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.574+0000 7f4370f9c700 1 --2- 172.21.15.112:0/2068158655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f436c0b1ab0 0x7f436c0b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:37.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.574+0000 7f4363fff700 1 -- 172.21.15.112:0/2068158655 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f436c0cdb50 msgr2=0x7f436c1efb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:37.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.574+0000 7f4363fff700 1 --2- 172.21.15.112:0/2068158655 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f436c0cdb50 0x7f436c1efb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:37.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.574+0000 7f4363fff700 1 -- 172.21.15.112:0/2068158655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f436c0b1ab0 msgr2=0x7f436c0b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:37.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.574+0000 7f4363fff700 1 --2- 172.21.15.112:0/2068158655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f436c0b1ab0 0x7f436c0b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:37.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.574+0000 7f4363fff700 1 -- 172.21.15.112:0/2068158655 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43540095f0 con 0x7f436c159af0 2023-09-12T16:07:37.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.574+0000 7f4363fff700 1 --2- 172.21.15.112:0/2068158655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f436c159af0 0x7f436c0c69f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4354000c00 tx=0x7f435400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:37.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.574+0000 7f43697fa700 1 -- 172.21.15.112:0/2068158655 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435401d070 con 0x7f436c159af0 2023-09-12T16:07:37.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.574+0000 7f43697fa700 1 -- 172.21.15.112:0/2068158655 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4354004260 con 0x7f436c159af0 2023-09-12T16:07:37.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.574+0000 7f43697fa700 1 -- 172.21.15.112:0/2068158655 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4354003680 con 0x7f436c159af0 2023-09-12T16:07:37.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.574+0000 7f43729ff700 1 -- 172.21.15.112:0/2068158655 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436c0c5c30 con 0x7f436c159af0 2023-09-12T16:07:37.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.575+0000 7f43729ff700 1 -- 172.21.15.112:0/2068158655 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436c0c61f0 con 0x7f436c159af0 2023-09-12T16:07:37.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.576+0000 7f43627fc700 1 -- 172.21.15.112:0/2068158655 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43440052e0 con 0x7f436c159af0 2023-09-12T16:07:37.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.576+0000 7f43697fa700 1 -- 172.21.15.112:0/2068158655 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f43540037e0 con 0x7f436c159af0 2023-09-12T16:07:37.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.577+0000 7f43697fa700 1 --2- 172.21.15.112:0/2068158655 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f434c06a580 0x7f434c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:37.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.577+0000 7f43697fa700 1 -- 172.21.15.112:0/2068158655 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f435408a2b0 con 0x7f436c159af0 2023-09-12T16:07:37.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.577+0000 7f436bfff700 1 --2- 172.21.15.112:0/2068158655 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f434c06a580 0x7f434c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:37.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.578+0000 7f436bfff700 1 --2- 172.21.15.112:0/2068158655 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f434c06a580 0x7f434c06ca40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f436c142870 tx=0x7f435c009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:37.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.581+0000 7f43697fa700 1 -- 172.21.15.112:0/2068158655 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f4354055530 con 0x7f436c159af0 2023-09-12T16:07:37.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.820+0000 7f43627fc700 1 -- 172.21.15.112:0/2068158655 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4344005da0 con 0x7f436c159af0 2023-09-12T16:07:37.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.820+0000 7f43697fa700 1 -- 172.21.15.112:0/2068158655 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f4354027070 con 0x7f436c159af0 2023-09-12T16:07:37.821 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-12T16:07:37.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.822+0000 7f43627fc700 1 -- 172.21.15.112:0/2068158655 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f434c06a580 msgr2=0x7f434c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:37.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.822+0000 7f43627fc700 1 --2- 172.21.15.112:0/2068158655 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f434c06a580 0x7f434c06ca40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f436c142870 tx=0x7f435c009040 comp rx=0 tx=0).stop 2023-09-12T16:07:37.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.822+0000 7f43627fc700 1 -- 172.21.15.112:0/2068158655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f436c159af0 msgr2=0x7f436c0c69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:37.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.822+0000 7f43627fc700 1 --2- 172.21.15.112:0/2068158655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f436c159af0 0x7f436c0c69f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4354000c00 tx=0x7f435400be10 comp rx=0 tx=0).stop 2023-09-12T16:07:37.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.822+0000 7f43627fc700 1 -- 172.21.15.112:0/2068158655 shutdown_connections 2023-09-12T16:07:37.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.822+0000 7f43627fc700 1 --2- 172.21.15.112:0/2068158655 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f434c06a580 0x7f434c06ca40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:37.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.822+0000 7f43627fc700 1 --2- 172.21.15.112:0/2068158655 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f436c0cdb50 0x7f436c1efb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:37.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.822+0000 7f43627fc700 1 --2- 172.21.15.112:0/2068158655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f436c0b1ab0 0x7f436c0b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:37.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.822+0000 7f43627fc700 1 --2- 172.21.15.112:0/2068158655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f436c159af0 0x7f436c0c69f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:37.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.822+0000 7f43627fc700 1 -- 172.21.15.112:0/2068158655 >> 172.21.15.112:0/2068158655 conn(0x7f436c06a650 msgr2=0x7f436c158a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:37.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.822+0000 7f43627fc700 1 -- 172.21.15.112:0/2068158655 shutdown_connections 2023-09-12T16:07:37.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:37.823+0000 7f43627fc700 1 -- 172.21.15.112:0/2068158655 wait complete. 2023-09-12T16:07:37.840 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-12T16:07:37.840 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-12T16:07:37.840 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-09-12T16:07:37.841 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-12T16:07:37.841 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-12T16:07:37.841 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-12T16:07:37.841 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-12T16:07:37.842 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-12T16:07:37.842 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-12T16:07:37.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:37.843 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-09-12T16:07:37.889 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-12T16:07:37.890 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-12T16:07:37.890 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-09-12T16:07:37.890 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:37.890 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-09-12T16:07:37.891 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:37.891 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-12T16:07:37.891 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-09-12T16:07:37.891 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2023-09-12T16:07:37.891 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-12T16:07:37.892 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-09-12T16:07:37.892 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2023-09-12T16:07:37.892 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-12T16:07:37.892 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-09-12T16:07:37.892 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-12T16:07:37.893 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-09-12T16:07:37.893 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-12T16:07:37.893 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42325sec preferred_lft 42325sec 2023-09-12T16:07:37.893 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2023-09-12T16:07:37.893 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:37.894 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-12T16:07:37.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:37.894 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-09-12T16:07:37.895 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-09-12T16:07:37.895 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add name ceph-brx type bridge 2023-09-12T16:07:37.895 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr flush dev ceph-brx 2023-09-12T16:07:37.896 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set ceph-brx up 2023-09-12T16:07:37.896 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-12T16:07:37.896 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-09-12T16:07:38.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:38.129 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-12T16:07:38.197 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-09-12T16:07:38.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:38.200 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-09-12T16:07:38.250 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-09-12T16:07:38.250 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-12T16:07:38.250 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-12T16:07:38.251 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-12T16:07:38.251 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-12T16:07:38.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:38.252 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-09-12T16:07:38.252 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-09-12T16:07:38.252 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-12T16:07:38.252 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-12T16:07:38.253 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-12T16:07:38.253 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-09-12T16:07:38.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:38.422 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-09-12T16:07:38.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:38.470 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2023-09-12T16:07:38.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:38.517 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-09-12T16:07:38.517 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-09-12T16:07:38.517 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-12T16:07:38.518 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-09-12T16:07:38.518 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-09-12T16:07:38.699 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-09-12T16:07:38.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:38.699 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-09-12T16:07:38.700 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-09-12T16:07:38.700 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-09-12T16:07:38.700 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-12T16:07:38.701 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-09-12T16:07:38.701 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-09-12T16:07:38.701 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-09-12T16:07:38.702 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-09-12T16:07:38.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:38.955 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-09-12T16:07:38.955 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-09-12T16:07:38.955 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2023-09-12T16:07:38.956 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.0 master ceph-brx 2023-09-12T16:07:38.956 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-09-12T16:07:39.126 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-12T16:07:39.127 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-12T16:07:39.173 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-12T16:07:39.173 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-12T16:07:39.174 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-12T16:07:39.259 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-12T16:07:39.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:39.260 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-12T16:07:39.403 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-12T16:07:39.403 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-12T16:07:39.404 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2023-09-12T16:07:39.817 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-12T16:07:39.817 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-12T16:07:39.817 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2023-09-12T16:07:39.817 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-09-12T16:07:39.818 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-12T16:07:39.843 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-12T16:07:39.843 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-12T16:07:39.843 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2023-09-12T16:07:39.844 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-09-12T16:07:39.844 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-12T16:07:39.844 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-09-12T16:07:39.844 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.112:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-09-12T16:07:39.844 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=81d9ebed-ec6c-4564-a5d4-cdbd74c977f8" will pass to kernel 2023-09-12T16:07:39.848 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-12T16:07:39.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:39.848 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-12T16:07:39.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:39.919 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-12T16:07:40.007 INFO:teuthology.orchestra.run.smithi112.stdout:client4673 2023-09-12T16:07:40.008 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:07:40.008 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T16:07:40.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:40.055 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-12T16:07:40.182 INFO:teuthology.orchestra.run.smithi112.stdout:client4673 2023-09-12T16:07:40.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:40.183 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-12T16:07:40.272 INFO:teuthology.orchestra.run.smithi112.stdout:client4673 2023-09-12T16:07:40.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:40.273 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/81d9ebed-ec6c-4564-a5d4-cdbd74c977f8.client4673/status') 2023-09-12T16:07:40.380 INFO:teuthology.orchestra.run.smithi112.stdout:instance: client.4673 (3)172.21.15.112:0/100714662 2023-09-12T16:07:40.381 INFO:teuthology.orchestra.run.smithi112.stdout:blocklisted: false 2023-09-12T16:07:40.381 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2023-09-12T16:07:40.381 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2023-09-12T16:07:40.382 INFO:teuthology.orchestra.run.smithi112.stderr:70 bytes copied, 8.2747e-05 s, 846 kB/s 2023-09-12T16:07:40.383 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-09-12T16:07:40.384 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-12T16:07:40.384 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-09-12T16:07:40.384 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-12T16:07:40.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.583+0000 7f5770fff700 1 -- 172.21.15.112:0/1211898421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f576c0cdfb0 msgr2=0x7f576c0d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:40.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.583+0000 7f5770fff700 1 --2- 172.21.15.112:0/1211898421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f576c0cdfb0 0x7f576c0d03c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f576c0cf400 tx=0x7f5760009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:40.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.583+0000 7f5770fff700 1 -- 172.21.15.112:0/1211898421 shutdown_connections 2023-09-12T16:07:40.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.583+0000 7f5770fff700 1 --2- 172.21.15.112:0/1211898421 >> v2:172.21.15.144:3300/0 conn(0x7f576c15f480 0x7f576c0cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:40.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.583+0000 7f5770fff700 1 --2- 172.21.15.112:0/1211898421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f576c0cdfb0 0x7f576c0d03c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:40.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.583+0000 7f5770fff700 1 -- 172.21.15.112:0/1211898421 >> 172.21.15.112:0/1211898421 conn(0x7f576c0d1930 msgr2=0x7f576c0d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:40.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.583+0000 7f5770fff700 1 -- 172.21.15.112:0/1211898421 shutdown_connections 2023-09-12T16:07:40.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.583+0000 7f5770fff700 1 -- 172.21.15.112:0/1211898421 wait complete. 2023-09-12T16:07:40.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.585+0000 7f5770fff700 1 Processor -- start 2023-09-12T16:07:40.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.585+0000 7f5770fff700 1 -- start start 2023-09-12T16:07:40.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.586+0000 7f5770fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f576c0b28f0 0x7f576c0b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:40.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.586+0000 7f5770fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f576c0cdfb0 0x7f576c158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:40.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.586+0000 7f5770fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f576c15f480 0x7f576c158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:40.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.586+0000 7f5770fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576c0b5c10 con 0x7f576c15f480 2023-09-12T16:07:40.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.586+0000 7f5770fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576c0b74e0 con 0x7f576c0cdfb0 2023-09-12T16:07:40.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.586+0000 7f5770fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576c0b4fd0 con 0x7f576c0b28f0 2023-09-12T16:07:40.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.586+0000 7f576ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f576c15f480 0x7f576c158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:40.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.586+0000 7f576ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f576c15f480 0x7f576c158ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52130/0 (socket says 172.21.15.112:52130) 2023-09-12T16:07:40.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.586+0000 7f576ad9d700 1 -- 172.21.15.112:0/95536901 learned_addr learned my addr 172.21.15.112:0/95536901 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:40.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.586+0000 7f5769d9b700 1 --2- 172.21.15.112:0/95536901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f576c0cdfb0 0x7f576c158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:40.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.586+0000 7f576a59c700 1 --2- 172.21.15.112:0/95536901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f576c0b28f0 0x7f576c0b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:40.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.586+0000 7f576ad9d700 1 -- 172.21.15.112:0/95536901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f576c0b28f0 msgr2=0x7f576c0b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:40.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.586+0000 7f576ad9d700 1 --2- 172.21.15.112:0/95536901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f576c0b28f0 0x7f576c0b6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:40.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.586+0000 7f576ad9d700 1 -- 172.21.15.112:0/95536901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f576c0cdfb0 msgr2=0x7f576c158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:40.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.586+0000 7f576ad9d700 1 --2- 172.21.15.112:0/95536901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f576c0cdfb0 0x7f576c158960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:40.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.586+0000 7f576ad9d700 1 -- 172.21.15.112:0/95536901 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57600095f0 con 0x7f576c15f480 2023-09-12T16:07:40.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.586+0000 7f576a59c700 1 --2- 172.21.15.112:0/95536901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f576c0b28f0 0x7f576c0b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:40.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.587+0000 7f576ad9d700 1 --2- 172.21.15.112:0/95536901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f576c15f480 0x7f576c158ea0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f576400c850 tx=0x7f576400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:40.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.587+0000 7f575affd700 1 -- 172.21.15.112:0/95536901 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5764003e30 con 0x7f576c15f480 2023-09-12T16:07:40.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.587+0000 7f575affd700 1 -- 172.21.15.112:0/95536901 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f576400ce50 con 0x7f576c15f480 2023-09-12T16:07:40.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.587+0000 7f5770fff700 1 -- 172.21.15.112:0/95536901 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f576c0b5270 con 0x7f576c15f480 2023-09-12T16:07:40.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.587+0000 7f575affd700 1 -- 172.21.15.112:0/95536901 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5764005330 con 0x7f576c15f480 2023-09-12T16:07:40.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.587+0000 7f5770fff700 1 -- 172.21.15.112:0/95536901 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576c0b5830 con 0x7f576c15f480 2023-09-12T16:07:40.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.588+0000 7f5770fff700 1 -- 172.21.15.112:0/95536901 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f576c04e300 con 0x7f576c15f480 2023-09-12T16:07:40.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.589+0000 7f575affd700 1 -- 172.21.15.112:0/95536901 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f5764005490 con 0x7f576c15f480 2023-09-12T16:07:40.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.590+0000 7f575affd700 1 --2- 172.21.15.112:0/95536901 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f574c06a580 0x7f574c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:40.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.590+0000 7f575affd700 1 -- 172.21.15.112:0/95536901 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5764088810 con 0x7f576c15f480 2023-09-12T16:07:40.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.590+0000 7f576a59c700 1 --2- 172.21.15.112:0/95536901 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f574c06a580 0x7f574c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:40.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.590+0000 7f576a59c700 1 --2- 172.21.15.112:0/95536901 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f574c06a580 0x7f574c06ca40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f576c0b4f00 tx=0x7f575c0091e0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:40.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.594+0000 7f575affd700 1 -- 172.21.15.112:0/95536901 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5764053a90 con 0x7f576c15f480 2023-09-12T16:07:40.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.834+0000 7f5770fff700 1 -- 172.21.15.112:0/95536901 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f576c0b4300 con 0x7f576c15f480 2023-09-12T16:07:40.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.834+0000 7f575affd700 1 -- 172.21.15.112:0/95536901 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5764017070 con 0x7f576c15f480 2023-09-12T16:07:40.835 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-12T16:07:40.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.837+0000 7f5770fff700 1 -- 172.21.15.112:0/95536901 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f574c06a580 msgr2=0x7f574c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:40.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.837+0000 7f5770fff700 1 --2- 172.21.15.112:0/95536901 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f574c06a580 0x7f574c06ca40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f576c0b4f00 tx=0x7f575c0091e0 comp rx=0 tx=0).stop 2023-09-12T16:07:40.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.837+0000 7f5770fff700 1 -- 172.21.15.112:0/95536901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f576c15f480 msgr2=0x7f576c158ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:40.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.837+0000 7f5770fff700 1 --2- 172.21.15.112:0/95536901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f576c15f480 0x7f576c158ea0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f576400c850 tx=0x7f576400cc10 comp rx=0 tx=0).stop 2023-09-12T16:07:40.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.837+0000 7f5770fff700 1 -- 172.21.15.112:0/95536901 shutdown_connections 2023-09-12T16:07:40.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.837+0000 7f5770fff700 1 --2- 172.21.15.112:0/95536901 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f574c06a580 0x7f574c06ca40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:40.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.837+0000 7f5770fff700 1 --2- 172.21.15.112:0/95536901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f576c0b28f0 0x7f576c0b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:40.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.837+0000 7f5770fff700 1 --2- 172.21.15.112:0/95536901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f576c15f480 0x7f576c158ea0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:40.839 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.837+0000 7f5770fff700 1 --2- 172.21.15.112:0/95536901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f576c0cdfb0 0x7f576c158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:40.839 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.837+0000 7f5770fff700 1 -- 172.21.15.112:0/95536901 >> 172.21.15.112:0/95536901 conn(0x7f576c0d1930 msgr2=0x7f576c0c64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:40.839 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.837+0000 7f5770fff700 1 -- 172.21.15.112:0/95536901 shutdown_connections 2023-09-12T16:07:40.839 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:40.837+0000 7f5770fff700 1 -- 172.21.15.112:0/95536901 wait complete. 2023-09-12T16:07:40.855 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-12T16:07:40.856 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-12T16:07:40.856 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-09-12T16:07:40.856 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-09-12T16:07:40.857 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-09-12T16:07:40.857 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-12T16:07:40.857 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-12T16:07:40.857 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-12T16:07:40.857 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-09-12T16:07:40.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:40.858 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-09-12T16:07:40.905 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-12T16:07:40.905 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-12T16:07:40.906 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-09-12T16:07:40.906 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:40.906 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-09-12T16:07:40.906 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:40.906 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-12T16:07:40.907 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-09-12T16:07:40.907 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2023-09-12T16:07:40.907 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-12T16:07:40.907 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-09-12T16:07:40.907 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2023-09-12T16:07:40.908 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-12T16:07:40.908 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-09-12T16:07:40.908 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-12T16:07:40.908 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-09-12T16:07:40.908 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-12T16:07:40.909 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42322sec preferred_lft 42322sec 2023-09-12T16:07:40.909 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2023-09-12T16:07:40.909 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:40.909 INFO:teuthology.orchestra.run.smithi112.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-12T16:07:40.909 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 26:eb:76:f0:1d:55 brd ff:ff:ff:ff:ff:ff 2023-09-12T16:07:40.910 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-12T16:07:40.910 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:40.910 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::68b2:e9ff:fe06:27c6/64 scope link 2023-09-12T16:07:40.910 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:40.910 INFO:teuthology.orchestra.run.smithi112.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-12T16:07:40.911 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 26:eb:76:f0:1d:55 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-12T16:07:40.911 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::24eb:76ff:fef0:1d55/64 scope link 2023-09-12T16:07:40.911 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:40.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:40.912 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-12T16:07:41.013 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-09-12T16:07:41.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:41.016 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-09-12T16:07:41.065 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-09-12T16:07:41.066 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-12T16:07:41.066 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-12T16:07:41.066 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-12T16:07:41.066 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-12T16:07:41.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:41.067 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-09-12T16:07:41.067 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-09-12T16:07:41.068 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-12T16:07:41.068 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-12T16:07:41.068 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-12T16:07:41.069 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-09-12T16:07:41.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:41.237 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-09-12T16:07:41.285 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-12T16:07:41.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:41.286 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2023-09-12T16:07:41.387 INFO:teuthology.orchestra.run.smithi112.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-09-12T16:07:41.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:41.388 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-09-12T16:07:41.388 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-09-12T16:07:41.389 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-12T16:07:41.389 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-09-12T16:07:41.389 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-09-12T16:07:41.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:41.575 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-09-12T16:07:41.646 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-12T16:07:41.646 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-12T16:07:41.647 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-09-12T16:07:41.647 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:41.647 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-09-12T16:07:41.647 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:41.648 INFO:teuthology.orchestra.run.smithi112.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-12T16:07:41.648 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 6e:6b:bb:27:5c:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-12T16:07:41.648 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-12T16:07:41.648 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:41.648 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::6c6b:bbff:fe27:5c39/64 scope link 2023-09-12T16:07:41.649 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:41.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:41.650 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-09-12T16:07:41.721 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-12T16:07:41.725 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-12T16:07:41.725 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-09-12T16:07:41.726 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:41.726 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-09-12T16:07:41.726 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:41.726 INFO:teuthology.orchestra.run.smithi112.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-12T16:07:41.727 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 6e:6b:bb:27:5c:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-12T16:07:41.727 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-12T16:07:41.728 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:41.728 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::6c6b:bbff:fe27:5c39/64 scope link 2023-09-12T16:07:41.728 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:41.730 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-09-12T16:07:41.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:41.731 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-09-12T16:07:41.731 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-09-12T16:07:41.732 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-09-12T16:07:41.732 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-09-12T16:07:41.732 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-09-12T16:07:41.733 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-09-12T16:07:41.733 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-09-12T16:07:41.734 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-09-12T16:07:41.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:41.981 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-09-12T16:07:41.982 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-09-12T16:07:41.982 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.1 up 2023-09-12T16:07:41.982 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.1 master ceph-brx 2023-09-12T16:07:41.983 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-09-12T16:07:42.156 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-12T16:07:42.157 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-09-12T16:07:42.210 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-09-12T16:07:42.210 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-12T16:07:42.211 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-09-12T16:07:42.297 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-12T16:07:42.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:42.298 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-09-12T16:07:42.446 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-09-12T16:07:42.446 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-09-12T16:07:42.446 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2023-09-12T16:07:42.462 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-09-12T16:07:42.462 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-09-12T16:07:42.462 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2023-09-12T16:07:42.462 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-09-12T16:07:42.463 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-12T16:07:42.486 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-09-12T16:07:42.486 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-09-12T16:07:42.486 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2023-09-12T16:07:42.486 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-09-12T16:07:42.487 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-12T16:07:42.487 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-09-12T16:07:42.487 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.112:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-09-12T16:07:42.487 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=81d9ebed-ec6c-4564-a5d4-cdbd74c977f8" will pass to kernel 2023-09-12T16:07:42.491 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-12T16:07:42.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:42.492 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-09-12T16:07:42.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:42.561 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-12T16:07:42.648 INFO:teuthology.orchestra.run.smithi112.stdout:client4906 2023-09-12T16:07:42.649 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:07:42.649 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T16:07:42.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:42.695 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-12T16:07:42.824 INFO:teuthology.orchestra.run.smithi112.stdout:client4906 2023-09-12T16:07:42.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:42.825 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-12T16:07:42.912 INFO:teuthology.orchestra.run.smithi112.stdout:client4906 2023-09-12T16:07:42.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:42.913 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/81d9ebed-ec6c-4564-a5d4-cdbd74c977f8.client4906/status') 2023-09-12T16:07:43.025 INFO:teuthology.orchestra.run.smithi112.stdout:instance: client.4906 (3)172.21.15.112:0/4023138830 2023-09-12T16:07:43.026 INFO:teuthology.orchestra.run.smithi112.stdout:blocklisted: false 2023-09-12T16:07:43.026 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2023-09-12T16:07:43.026 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2023-09-12T16:07:43.026 INFO:teuthology.orchestra.run.smithi112.stderr:71 bytes copied, 6.6765e-05 s, 1.1 MB/s 2023-09-12T16:07:43.028 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-09-12T16:07:43.028 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-12T16:07:43.029 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-12T16:07:43.029 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-12T16:07:43.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.232+0000 7fd8363ff700 1 -- 172.21.15.112:0/331254263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8300cbd50 msgr2=0x7fd8300c9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:43.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.232+0000 7fd8363ff700 1 --2- 172.21.15.112:0/331254263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8300cbd50 0x7fd8300c9730 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd83006d050 tx=0x7fd82800b380 comp rx=0 tx=0).stop 2023-09-12T16:07:43.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.232+0000 7fd8363ff700 1 -- 172.21.15.112:0/331254263 shutdown_connections 2023-09-12T16:07:43.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.232+0000 7fd8363ff700 1 --2- 172.21.15.112:0/331254263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8300cbd50 0x7fd8300c9730 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:43.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.232+0000 7fd8363ff700 1 --2- 172.21.15.112:0/331254263 >> v2:172.21.15.144:3300/0 conn(0x7fd830158760 0x7fd830071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:43.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.232+0000 7fd8363ff700 1 -- 172.21.15.112:0/331254263 >> 172.21.15.112:0/331254263 conn(0x7fd83006a650 msgr2=0x7fd83006c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:43.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.232+0000 7fd8363ff700 1 -- 172.21.15.112:0/331254263 shutdown_connections 2023-09-12T16:07:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.232+0000 7fd8363ff700 1 -- 172.21.15.112:0/331254263 wait complete. 2023-09-12T16:07:43.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.234+0000 7fd8363ff700 1 Processor -- start 2023-09-12T16:07:43.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.234+0000 7fd8363ff700 1 -- start start 2023-09-12T16:07:43.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.235+0000 7fd8363ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8300b0340 0x7fd830153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:43.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.235+0000 7fd8363ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8300cbd50 0x7fd830158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:43.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.235+0000 7fd8363ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd830158760 0x7fd8301592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:43.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.235+0000 7fd8363ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd830154540 con 0x7fd8300b0340 2023-09-12T16:07:43.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.235+0000 7fd8363ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8300c16f0 con 0x7fd830158760 2023-09-12T16:07:43.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.235+0000 7fd8363ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8300c19d0 con 0x7fd8300cbd50 2023-09-12T16:07:43.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.235+0000 7fd82ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8300b0340 0x7fd830153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:43.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.235+0000 7fd82ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8300b0340 0x7fd830153890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52152/0 (socket says 172.21.15.112:52152) 2023-09-12T16:07:43.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.235+0000 7fd82ffff700 1 -- 172.21.15.112:0/1312934205 learned_addr learned my addr 172.21.15.112:0/1312934205 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:43.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.236+0000 7fd82ffff700 1 -- 172.21.15.112:0/1312934205 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8300cbd50 msgr2=0x7fd830158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:43.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.236+0000 7fd82ffff700 1 --2- 172.21.15.112:0/1312934205 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8300cbd50 0x7fd830158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:43.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.236+0000 7fd82ffff700 1 -- 172.21.15.112:0/1312934205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd830158760 msgr2=0x7fd8301592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:43.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.236+0000 7fd82ffff700 1 --2- 172.21.15.112:0/1312934205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd830158760 0x7fd8301592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:43.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.236+0000 7fd82ffff700 1 -- 172.21.15.112:0/1312934205 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd828009d00 con 0x7fd8300b0340 2023-09-12T16:07:43.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.236+0000 7fd82ffff700 1 --2- 172.21.15.112:0/1312934205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8300b0340 0x7fd830153890 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd82000e9f0 tx=0x7fd82000edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:43.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.236+0000 7fd82cff9700 1 -- 172.21.15.112:0/1312934205 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82000cbd0 con 0x7fd8300b0340 2023-09-12T16:07:43.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.236+0000 7fd82cff9700 1 -- 172.21.15.112:0/1312934205 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd82000ce20 con 0x7fd8300b0340 2023-09-12T16:07:43.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.236+0000 7fd82cff9700 1 -- 172.21.15.112:0/1312934205 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd820010690 con 0x7fd8300b0340 2023-09-12T16:07:43.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.236+0000 7fd8363ff700 1 -- 172.21.15.112:0/1312934205 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8300c1cb0 con 0x7fd8300b0340 2023-09-12T16:07:43.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.236+0000 7fd8363ff700 1 -- 172.21.15.112:0/1312934205 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8300c2270 con 0x7fd8300b0340 2023-09-12T16:07:43.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.237+0000 7fd8363ff700 1 -- 172.21.15.112:0/1312934205 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8300c2430 con 0x7fd8300b0340 2023-09-12T16:07:43.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.238+0000 7fd82cff9700 1 -- 172.21.15.112:0/1312934205 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fd8200107f0 con 0x7fd8300b0340 2023-09-12T16:07:43.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.239+0000 7fd82cff9700 1 --2- 172.21.15.112:0/1312934205 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd81c06a580 0x7fd81c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:43.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.240+0000 7fd82cff9700 1 -- 172.21.15.112:0/1312934205 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd820014070 con 0x7fd8300b0340 2023-09-12T16:07:43.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.240+0000 7fd82f7fe700 1 --2- 172.21.15.112:0/1312934205 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd81c06a580 0x7fd81c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:43.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.240+0000 7fd82f7fe700 1 --2- 172.21.15.112:0/1312934205 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd81c06a580 0x7fd81c06ca40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd824007fd0 tx=0x7fd8240079a0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:43.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.244+0000 7fd82cff9700 1 -- 172.21.15.112:0/1312934205 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd8200519b0 con 0x7fd8300b0340 2023-09-12T16:07:43.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.493+0000 7fd8363ff700 1 -- 172.21.15.112:0/1312934205 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd83004e300 con 0x7fd8300b0340 2023-09-12T16:07:43.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.494+0000 7fd82cff9700 1 -- 172.21.15.112:0/1312934205 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fd820058480 con 0x7fd8300b0340 2023-09-12T16:07:43.494 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-12T16:07:43.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.496+0000 7fd8363ff700 1 -- 172.21.15.112:0/1312934205 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd81c06a580 msgr2=0x7fd81c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:43.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.496+0000 7fd8363ff700 1 --2- 172.21.15.112:0/1312934205 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd81c06a580 0x7fd81c06ca40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd824007fd0 tx=0x7fd8240079a0 comp rx=0 tx=0).stop 2023-09-12T16:07:43.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.496+0000 7fd8363ff700 1 -- 172.21.15.112:0/1312934205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8300b0340 msgr2=0x7fd830153890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:43.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.496+0000 7fd8363ff700 1 --2- 172.21.15.112:0/1312934205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8300b0340 0x7fd830153890 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd82000e9f0 tx=0x7fd82000edb0 comp rx=0 tx=0).stop 2023-09-12T16:07:43.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.496+0000 7fd8363ff700 1 -- 172.21.15.112:0/1312934205 shutdown_connections 2023-09-12T16:07:43.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.496+0000 7fd8363ff700 1 --2- 172.21.15.112:0/1312934205 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd81c06a580 0x7fd81c06ca40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:43.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.496+0000 7fd8363ff700 1 --2- 172.21.15.112:0/1312934205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd830158760 0x7fd8301592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:43.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.496+0000 7fd8363ff700 1 --2- 172.21.15.112:0/1312934205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8300b0340 0x7fd830153890 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:43.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.496+0000 7fd8363ff700 1 --2- 172.21.15.112:0/1312934205 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8300cbd50 0x7fd830158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:43.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.496+0000 7fd8363ff700 1 -- 172.21.15.112:0/1312934205 >> 172.21.15.112:0/1312934205 conn(0x7fd83006a650 msgr2=0x7fd8300cb620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:43.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.496+0000 7fd8363ff700 1 -- 172.21.15.112:0/1312934205 shutdown_connections 2023-09-12T16:07:43.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:43.496+0000 7fd8363ff700 1 -- 172.21.15.112:0/1312934205 wait complete. 2023-09-12T16:07:43.515 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-12T16:07:43.516 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-12T16:07:43.516 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-09-12T16:07:43.516 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-12T16:07:43.517 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-12T16:07:43.517 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-12T16:07:43.517 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-12T16:07:43.517 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-12T16:07:43.518 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-12T16:07:43.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:43.518 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-09-12T16:07:43.569 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-12T16:07:43.570 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-12T16:07:43.570 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-09-12T16:07:43.570 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:43.571 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-09-12T16:07:43.571 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:43.571 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-12T16:07:43.571 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-09-12T16:07:43.571 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-09-12T16:07:43.572 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-12T16:07:43.572 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-09-12T16:07:43.572 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-09-12T16:07:43.572 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-12T16:07:43.572 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-09-12T16:07:43.573 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-12T16:07:43.573 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-09-12T16:07:43.573 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-12T16:07:43.574 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42318sec preferred_lft 42318sec 2023-09-12T16:07:43.574 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2023-09-12T16:07:43.574 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:43.578 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-12T16:07:43.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:43.578 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-09-12T16:07:43.579 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-09-12T16:07:43.579 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add name ceph-brx type bridge 2023-09-12T16:07:43.579 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr flush dev ceph-brx 2023-09-12T16:07:43.580 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set ceph-brx up 2023-09-12T16:07:43.580 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-12T16:07:43.580 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-09-12T16:07:44.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:44.089 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-12T16:07:44.160 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-09-12T16:07:44.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:44.163 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-09-12T16:07:44.227 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-09-12T16:07:44.228 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-12T16:07:44.228 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-12T16:07:44.228 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-12T16:07:44.228 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-12T16:07:44.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:44.230 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-09-12T16:07:44.231 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-09-12T16:07:44.231 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-12T16:07:44.231 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-12T16:07:44.232 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-12T16:07:44.232 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-09-12T16:07:44.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:44.972 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-09-12T16:07:45.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:45.020 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list-id 2023-09-12T16:07:45.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:45.107 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-09-12T16:07:45.107 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-09-12T16:07:45.107 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-12T16:07:45.107 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-09-12T16:07:45.108 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-09-12T16:07:45.250 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-09-12T16:07:45.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:45.251 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-09-12T16:07:45.251 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-09-12T16:07:45.251 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-09-12T16:07:45.252 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-12T16:07:45.252 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-09-12T16:07:45.252 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-09-12T16:07:45.252 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-09-12T16:07:45.253 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-09-12T16:07:45.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:45.516 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-09-12T16:07:45.516 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-09-12T16:07:45.517 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-09-12T16:07:45.517 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set dev brx.0 master ceph-brx 2023-09-12T16:07:45.517 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-09-12T16:07:45.689 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-12T16:07:45.689 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-12T16:07:45.735 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-12T16:07:45.736 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-12T16:07:45.736 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-12T16:07:45.822 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-12T16:07:45.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:45.822 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-12T16:07:45.969 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-12T16:07:45.969 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-12T16:07:45.969 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-09-12T16:07:46.395 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-12T16:07:46.396 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-12T16:07:46.396 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-09-12T16:07:46.396 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-09-12T16:07:46.396 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-12T16:07:46.422 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-12T16:07:46.422 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-12T16:07:46.422 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-09-12T16:07:46.422 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-09-12T16:07:46.423 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-12T16:07:46.423 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.112:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-09-12T16:07:46.423 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.112:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-09-12T16:07:46.424 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=81d9ebed-ec6c-4564-a5d4-cdbd74c977f8" will pass to kernel 2023-09-12T16:07:46.429 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-12T16:07:46.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:46.430 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-12T16:07:46.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:46.501 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-12T16:07:46.599 INFO:teuthology.orchestra.run.smithi144.stdout:client4896 2023-09-12T16:07:46.600 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:07:46.600 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T16:07:46.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:46.650 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-12T16:07:46.774 INFO:teuthology.orchestra.run.smithi144.stdout:client4896 2023-09-12T16:07:46.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:46.775 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-12T16:07:46.862 INFO:teuthology.orchestra.run.smithi144.stdout:client4896 2023-09-12T16:07:46.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:46.863 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/81d9ebed-ec6c-4564-a5d4-cdbd74c977f8.client4896/status') 2023-09-12T16:07:46.972 INFO:teuthology.orchestra.run.smithi144.stdout:instance: client.4896 (3)172.21.15.144:0/1081032904 2023-09-12T16:07:46.972 INFO:teuthology.orchestra.run.smithi144.stdout:blocklisted: false 2023-09-12T16:07:46.972 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records in 2023-09-12T16:07:46.973 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records out 2023-09-12T16:07:46.973 INFO:teuthology.orchestra.run.smithi144.stderr:71 bytes copied, 4.8207e-05 s, 1.5 MB/s 2023-09-12T16:07:46.974 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-09-12T16:07:46.975 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-12T16:07:46.975 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-09-12T16:07:46.975 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-12T16:07:47.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.186+0000 7f82de7ff700 1 -- 172.21.15.112:0/110278481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82d8070e00 msgr2=0x7f82d80cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:47.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.186+0000 7f82de7ff700 1 --2- 172.21.15.112:0/110278481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82d8070e00 0x7f82d80cd980 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009fd0 tx=0x7f82d000b380 comp rx=0 tx=0).stop 2023-09-12T16:07:47.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.186+0000 7f82de7ff700 1 -- 172.21.15.112:0/110278481 shutdown_connections 2023-09-12T16:07:47.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.186+0000 7f82de7ff700 1 --2- 172.21.15.112:0/110278481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82d8070e00 0x7f82d80cd980 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:47.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.186+0000 7f82de7ff700 1 --2- 172.21.15.112:0/110278481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82d8159af0 0x7f82d80cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:47.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.186+0000 7f82de7ff700 1 -- 172.21.15.112:0/110278481 >> 172.21.15.112:0/110278481 conn(0x7f82d806a650 msgr2=0x7f82d806c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:47.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.186+0000 7f82de7ff700 1 -- 172.21.15.112:0/110278481 shutdown_connections 2023-09-12T16:07:47.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.186+0000 7f82de7ff700 1 -- 172.21.15.112:0/110278481 wait complete. 2023-09-12T16:07:47.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.188+0000 7f82de7ff700 1 Processor -- start 2023-09-12T16:07:47.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.188+0000 7f82de7ff700 1 -- start start 2023-09-12T16:07:47.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.189+0000 7f82de7ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82d8070e00 0x7f82d81f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:47.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.189+0000 7f82de7ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82d8159af0 0x7f82d815b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:47.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.189+0000 7f82de7ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82d81e2e40 0x7f82d80ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:47.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.189+0000 7f82de7ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d815ce30 con 0x7f82d8159af0 2023-09-12T16:07:47.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.189+0000 7f82de7ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d815c1b0 con 0x7f82d81e2e40 2023-09-12T16:07:47.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.189+0000 7f82de7ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d815c490 con 0x7f82d8070e00 2023-09-12T16:07:47.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.189+0000 7f82d77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82d8159af0 0x7f82d815b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:47.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.189+0000 7f82d77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82d8159af0 0x7f82d815b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45618/0 (socket says 172.21.15.112:45618) 2023-09-12T16:07:47.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.189+0000 7f82d77fe700 1 -- 172.21.15.112:0/1408691741 learned_addr learned my addr 172.21.15.112:0/1408691741 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:47.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.189+0000 7f82d7fff700 1 --2- 172.21.15.112:0/1408691741 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82d8070e00 0x7f82d81f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:47.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.189+0000 7f82dcd9c700 1 --2- 172.21.15.112:0/1408691741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82d81e2e40 0x7f82d80ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:47.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.190+0000 7f82d77fe700 1 -- 172.21.15.112:0/1408691741 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82d8070e00 msgr2=0x7f82d81f1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:47.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.190+0000 7f82d77fe700 1 --2- 172.21.15.112:0/1408691741 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82d8070e00 0x7f82d81f1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:47.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.190+0000 7f82d77fe700 1 -- 172.21.15.112:0/1408691741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82d81e2e40 msgr2=0x7f82d80ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:47.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.190+0000 7f82d77fe700 1 --2- 172.21.15.112:0/1408691741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82d81e2e40 0x7f82d80ad7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:47.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.190+0000 7f82d77fe700 1 -- 172.21.15.112:0/1408691741 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d0009d00 con 0x7f82d8159af0 2023-09-12T16:07:47.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.190+0000 7f82d77fe700 1 --2- 172.21.15.112:0/1408691741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82d8159af0 0x7f82d815b840 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00c4e0 tx=0x7f82cc00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:47.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.190+0000 7f82d4ff9700 1 -- 172.21.15.112:0/1408691741 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0052d0 con 0x7f82d8159af0 2023-09-12T16:07:47.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.190+0000 7f82d4ff9700 1 -- 172.21.15.112:0/1408691741 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f82cc005520 con 0x7f82d8159af0 2023-09-12T16:07:47.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.190+0000 7f82de7ff700 1 -- 172.21.15.112:0/1408691741 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d815c770 con 0x7f82d8159af0 2023-09-12T16:07:47.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.190+0000 7f82d4ff9700 1 -- 172.21.15.112:0/1408691741 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0038e0 con 0x7f82d8159af0 2023-09-12T16:07:47.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.190+0000 7f82de7ff700 1 -- 172.21.15.112:0/1408691741 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d81f1f50 con 0x7f82d8159af0 2023-09-12T16:07:47.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.191+0000 7f82de7ff700 1 -- 172.21.15.112:0/1408691741 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d804e300 con 0x7f82d8159af0 2023-09-12T16:07:47.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.192+0000 7f82d4ff9700 1 -- 172.21.15.112:0/1408691741 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f82cc003a40 con 0x7f82d8159af0 2023-09-12T16:07:47.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.193+0000 7f82d4ff9700 1 --2- 172.21.15.112:0/1408691741 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f82c406a580 0x7f82c406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:47.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.193+0000 7f82d4ff9700 1 -- 172.21.15.112:0/1408691741 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f82cc088590 con 0x7f82d8159af0 2023-09-12T16:07:47.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.193+0000 7f82d7fff700 1 --2- 172.21.15.112:0/1408691741 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f82c406a580 0x7f82c406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:47.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.194+0000 7f82d7fff700 1 --2- 172.21.15.112:0/1408691741 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f82c406a580 0x7f82c406ca40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f82c8005950 tx=0x7f82c800b410 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:47.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.198+0000 7f82d4ff9700 1 -- 172.21.15.112:0/1408691741 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f82cc053610 con 0x7f82d8159af0 2023-09-12T16:07:47.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.441+0000 7f82de7ff700 1 -- 172.21.15.112:0/1408691741 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f82d806d0d0 con 0x7f82d8159af0 2023-09-12T16:07:47.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.442+0000 7f82d4ff9700 1 -- 172.21.15.112:0/1408691741 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f82cc056c30 con 0x7f82d8159af0 2023-09-12T16:07:47.442 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-12T16:07:47.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.444+0000 7f82de7ff700 1 -- 172.21.15.112:0/1408691741 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f82c406a580 msgr2=0x7f82c406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:47.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.444+0000 7f82de7ff700 1 --2- 172.21.15.112:0/1408691741 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f82c406a580 0x7f82c406ca40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f82c8005950 tx=0x7f82c800b410 comp rx=0 tx=0).stop 2023-09-12T16:07:47.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.444+0000 7f82de7ff700 1 -- 172.21.15.112:0/1408691741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82d8159af0 msgr2=0x7f82d815b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:47.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.444+0000 7f82de7ff700 1 --2- 172.21.15.112:0/1408691741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82d8159af0 0x7f82d815b840 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00c4e0 tx=0x7f82cc00c7f0 comp rx=0 tx=0).stop 2023-09-12T16:07:47.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.444+0000 7f82de7ff700 1 -- 172.21.15.112:0/1408691741 shutdown_connections 2023-09-12T16:07:47.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.444+0000 7f82de7ff700 1 --2- 172.21.15.112:0/1408691741 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f82c406a580 0x7f82c406ca40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:47.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.444+0000 7f82de7ff700 1 --2- 172.21.15.112:0/1408691741 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82d8070e00 0x7f82d81f1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:47.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.444+0000 7f82de7ff700 1 --2- 172.21.15.112:0/1408691741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82d81e2e40 0x7f82d80ad7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:47.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.444+0000 7f82de7ff700 1 --2- 172.21.15.112:0/1408691741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82d8159af0 0x7f82d815b840 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:47.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.444+0000 7f82de7ff700 1 -- 172.21.15.112:0/1408691741 >> 172.21.15.112:0/1408691741 conn(0x7f82d806a650 msgr2=0x7f82d80c2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:47.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.445+0000 7f82de7ff700 1 -- 172.21.15.112:0/1408691741 shutdown_connections 2023-09-12T16:07:47.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:47.445+0000 7f82de7ff700 1 -- 172.21.15.112:0/1408691741 wait complete. 2023-09-12T16:07:47.465 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-12T16:07:47.466 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-12T16:07:47.466 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-09-12T16:07:47.466 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-09-12T16:07:47.467 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-09-12T16:07:47.467 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-12T16:07:47.467 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-12T16:07:47.467 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-12T16:07:47.468 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-09-12T16:07:47.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:47.468 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-09-12T16:07:47.515 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-12T16:07:47.516 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-12T16:07:47.516 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-09-12T16:07:47.516 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:47.517 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-09-12T16:07:47.517 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:47.517 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-12T16:07:47.517 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-09-12T16:07:47.517 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-09-12T16:07:47.518 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-12T16:07:47.518 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-09-12T16:07:47.518 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-09-12T16:07:47.518 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-12T16:07:47.518 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-09-12T16:07:47.519 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-12T16:07:47.519 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-09-12T16:07:47.519 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-12T16:07:47.519 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42314sec preferred_lft 42314sec 2023-09-12T16:07:47.519 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2023-09-12T16:07:47.520 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:47.520 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-12T16:07:47.520 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether be:4d:24:f2:1c:d4 brd ff:ff:ff:ff:ff:ff 2023-09-12T16:07:47.520 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-12T16:07:47.520 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:47.521 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::a4c1:9bff:febb:541c/64 scope link 2023-09-12T16:07:47.521 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:47.521 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-12T16:07:47.521 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether be:4d:24:f2:1c:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-12T16:07:47.521 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bc4d:24ff:fef2:1cd4/64 scope link 2023-09-12T16:07:47.521 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:47.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:47.523 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-12T16:07:47.590 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-09-12T16:07:47.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:47.593 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-09-12T16:07:47.643 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-09-12T16:07:47.643 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-12T16:07:47.643 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-12T16:07:47.644 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-12T16:07:47.644 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-12T16:07:47.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:47.645 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-09-12T16:07:47.645 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-09-12T16:07:47.645 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-12T16:07:47.645 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-12T16:07:47.646 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-12T16:07:47.646 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-09-12T16:07:47.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:47.815 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-09-12T16:07:47.861 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-12T16:07:47.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:47.862 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list-id 2023-09-12T16:07:47.908 INFO:teuthology.orchestra.run.smithi144.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-09-12T16:07:47.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:47.910 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-09-12T16:07:47.910 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-09-12T16:07:47.910 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-12T16:07:47.911 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-09-12T16:07:47.911 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-09-12T16:07:48.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:48.054 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-09-12T16:07:48.125 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-12T16:07:48.126 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-12T16:07:48.126 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-09-12T16:07:48.126 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:48.126 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-09-12T16:07:48.126 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:48.127 INFO:teuthology.orchestra.run.smithi144.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-12T16:07:48.127 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 46:19:ac:c3:b1:b5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-12T16:07:48.127 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-12T16:07:48.127 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:48.128 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::4419:acff:fec3:b1b5/64 scope link 2023-09-12T16:07:48.128 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:48.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:48.129 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-09-12T16:07:48.199 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-12T16:07:48.199 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-12T16:07:48.200 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-09-12T16:07:48.200 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:48.200 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-09-12T16:07:48.200 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:48.200 INFO:teuthology.orchestra.run.smithi144.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-12T16:07:48.201 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 46:19:ac:c3:b1:b5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-12T16:07:48.201 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-12T16:07:48.201 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:48.201 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::4419:acff:fec3:b1b5/64 scope link 2023-09-12T16:07:48.201 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:07:48.203 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-09-12T16:07:48.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:48.203 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-09-12T16:07:48.204 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-09-12T16:07:48.204 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-09-12T16:07:48.204 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-09-12T16:07:48.205 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-09-12T16:07:48.205 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-09-12T16:07:48.205 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-09-12T16:07:48.205 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-09-12T16:07:48.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:48.452 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-09-12T16:07:48.452 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-09-12T16:07:48.452 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.1 up 2023-09-12T16:07:48.453 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set dev brx.1 master ceph-brx 2023-09-12T16:07:48.453 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-09-12T16:07:48.626 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-12T16:07:48.627 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-09-12T16:07:48.673 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-09-12T16:07:48.673 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-12T16:07:48.674 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-09-12T16:07:48.758 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-12T16:07:48.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:48.759 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-09-12T16:07:48.905 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-09-12T16:07:48.905 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-09-12T16:07:48.906 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-09-12T16:07:48.922 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-09-12T16:07:48.922 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-09-12T16:07:48.922 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-09-12T16:07:48.922 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-09-12T16:07:48.923 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-12T16:07:48.945 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-09-12T16:07:48.945 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-09-12T16:07:48.945 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-09-12T16:07:48.945 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-09-12T16:07:48.946 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-12T16:07:48.946 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.112:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-09-12T16:07:48.946 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.112:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-09-12T16:07:48.946 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=81d9ebed-ec6c-4564-a5d4-cdbd74c977f8" will pass to kernel 2023-09-12T16:07:48.951 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-12T16:07:48.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:48.951 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-09-12T16:07:49.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:49.021 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-12T16:07:49.109 INFO:teuthology.orchestra.run.smithi144.stdout:client4682 2023-09-12T16:07:49.110 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:07:49.110 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T16:07:49.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:49.156 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-12T16:07:49.283 INFO:teuthology.orchestra.run.smithi144.stdout:client4682 2023-09-12T16:07:49.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:49.284 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-12T16:07:49.371 INFO:teuthology.orchestra.run.smithi144.stdout:client4682 2023-09-12T16:07:49.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:07:49.372 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/81d9ebed-ec6c-4564-a5d4-cdbd74c977f8.client4682/status') 2023-09-12T16:07:49.480 INFO:teuthology.orchestra.run.smithi144.stdout:instance: client.4682 (3)192.168.0.2:0/2174329912 2023-09-12T16:07:49.481 INFO:teuthology.orchestra.run.smithi144.stdout:blocklisted: false 2023-09-12T16:07:49.481 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records in 2023-09-12T16:07:49.481 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records out 2023-09-12T16:07:49.482 INFO:teuthology.orchestra.run.smithi144.stderr:69 bytes copied, 5.1312e-05 s, 1.3 MB/s 2023-09-12T16:07:49.484 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-09-12T16:07:49.500 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:07:49.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.710+0000 7fe810dff700 1 -- 172.21.15.112:0/1688468126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe80c06a020 msgr2=0x7fe80c06a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:49.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.710+0000 7fe810dff700 1 --2- 172.21.15.112:0/1688468126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe80c06a020 0x7fe80c06a4d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0cc0c0 tx=0x7fe80400b380 comp rx=0 tx=0).stop 2023-09-12T16:07:49.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.710+0000 7fe810dff700 1 -- 172.21.15.112:0/1688468126 shutdown_connections 2023-09-12T16:07:49.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.710+0000 7fe810dff700 1 --2- 172.21.15.112:0/1688468126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe80c06a020 0x7fe80c06a4d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:49.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.710+0000 7fe810dff700 1 --2- 172.21.15.112:0/1688468126 >> v2:172.21.15.144:3300/0 conn(0x7fe80c159da0 0x7fe80c072070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:49.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.710+0000 7fe810dff700 1 --2- 172.21.15.112:0/1688468126 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe80c0c8f20 0x7fe80c0c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:49.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.710+0000 7fe810dff700 1 -- 172.21.15.112:0/1688468126 >> 172.21.15.112:0/1688468126 conn(0x7fe80c06b760 msgr2=0x7fe80c06d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:49.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.710+0000 7fe810dff700 1 -- 172.21.15.112:0/1688468126 shutdown_connections 2023-09-12T16:07:49.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.710+0000 7fe810dff700 1 -- 172.21.15.112:0/1688468126 wait complete. 2023-09-12T16:07:49.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.712+0000 7fe810dff700 1 Processor -- start 2023-09-12T16:07:49.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.712+0000 7fe810dff700 1 -- start start 2023-09-12T16:07:49.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.713+0000 7fe810dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe80c06a020 0x7fe80c15a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:49.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.713+0000 7fe810dff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe80c0c8f20 0x7fe80c0ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:49.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.713+0000 7fe810dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe80c159da0 0x7fe80c14da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:49.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.713+0000 7fe810dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0ab7e0 con 0x7fe80c159da0 2023-09-12T16:07:49.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.713+0000 7fe810dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c14df90 con 0x7fe80c06a020 2023-09-12T16:07:49.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.713+0000 7fe810dff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0ad060 con 0x7fe80c0c8f20 2023-09-12T16:07:49.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.713+0000 7fe80ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe80c159da0 0x7fe80c14da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:49.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.713+0000 7fe80ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe80c159da0 0x7fe80c14da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45636/0 (socket says 172.21.15.112:45636) 2023-09-12T16:07:49.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.713+0000 7fe80ad9d700 1 -- 172.21.15.112:0/3878829500 learned_addr learned my addr 172.21.15.112:0/3878829500 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:49.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.713+0000 7fe80a59c700 1 --2- 172.21.15.112:0/3878829500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe80c06a020 0x7fe80c15a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:49.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.713+0000 7fe809d9b700 1 --2- 172.21.15.112:0/3878829500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe80c0c8f20 0x7fe80c0ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:49.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.714+0000 7fe80ad9d700 1 -- 172.21.15.112:0/3878829500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe80c0c8f20 msgr2=0x7fe80c0ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:49.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.714+0000 7fe80ad9d700 1 --2- 172.21.15.112:0/3878829500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe80c0c8f20 0x7fe80c0ab2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:49.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.714+0000 7fe80ad9d700 1 -- 172.21.15.112:0/3878829500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe80c06a020 msgr2=0x7fe80c15a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:49.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.714+0000 7fe80ad9d700 1 --2- 172.21.15.112:0/3878829500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe80c06a020 0x7fe80c15a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:49.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.714+0000 7fe80ad9d700 1 -- 172.21.15.112:0/3878829500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe804009d00 con 0x7fe80c159da0 2023-09-12T16:07:49.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.714+0000 7fe80a59c700 1 --2- 172.21.15.112:0/3878829500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe80c06a020 0x7fe80c15a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-12T16:07:49.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.714+0000 7fe80ad9d700 1 --2- 172.21.15.112:0/3878829500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe80c159da0 0x7fe80c14da50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe80c06ace0 tx=0x7fe804007b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:49.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.714+0000 7fe7faffd700 1 -- 172.21.15.112:0/3878829500 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80400e040 con 0x7fe80c159da0 2023-09-12T16:07:49.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.714+0000 7fe7faffd700 1 -- 172.21.15.112:0/3878829500 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe80401d680 con 0x7fe80c159da0 2023-09-12T16:07:49.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.714+0000 7fe7faffd700 1 -- 172.21.15.112:0/3878829500 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80401da90 con 0x7fe80c159da0 2023-09-12T16:07:49.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.714+0000 7fe810dff700 1 -- 172.21.15.112:0/3878829500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80c0ad340 con 0x7fe80c159da0 2023-09-12T16:07:49.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.714+0000 7fe810dff700 1 -- 172.21.15.112:0/3878829500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80c0cc580 con 0x7fe80c159da0 2023-09-12T16:07:49.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.715+0000 7fe810dff700 1 -- 172.21.15.112:0/3878829500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80c0c93a0 con 0x7fe80c159da0 2023-09-12T16:07:49.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.716+0000 7fe7faffd700 1 -- 172.21.15.112:0/3878829500 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe80401dbf0 con 0x7fe80c159da0 2023-09-12T16:07:49.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.717+0000 7fe7faffd700 1 --2- 172.21.15.112:0/3878829500 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe7ec06a5b0 0x7fe7ec06ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:49.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.717+0000 7fe7faffd700 1 -- 172.21.15.112:0/3878829500 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe80408aac0 con 0x7fe80c159da0 2023-09-12T16:07:49.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.717+0000 7fe80a59c700 1 --2- 172.21.15.112:0/3878829500 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe7ec06a5b0 0x7fe7ec06ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:49.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.718+0000 7fe80a59c700 1 --2- 172.21.15.112:0/3878829500 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe7ec06a5b0 0x7fe7ec06ca70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc009fb0 tx=0x7fe7fc009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:49.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.722+0000 7fe7faffd700 1 -- 172.21.15.112:0/3878829500 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe804055b30 con 0x7fe80c159da0 2023-09-12T16:07:49.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.918+0000 7fe810dff700 1 -- 172.21.15.112:0/3878829500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe80c072630 con 0x7fe80c159da0 2023-09-12T16:07:49.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.919+0000 7fe7faffd700 1 -- 172.21.15.112:0/3878829500 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18816 (secure 0 0 0) 0x7fe804059150 con 0x7fe80c159da0 2023-09-12T16:07:49.920 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:49.920 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:44.445226+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:07:49.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.922+0000 7fe810dff700 1 -- 172.21.15.112:0/3878829500 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe7ec06a5b0 msgr2=0x7fe7ec06ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:49.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.922+0000 7fe810dff700 1 --2- 172.21.15.112:0/3878829500 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe7ec06a5b0 0x7fe7ec06ca70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc009fb0 tx=0x7fe7fc009260 comp rx=0 tx=0).stop 2023-09-12T16:07:49.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.922+0000 7fe810dff700 1 -- 172.21.15.112:0/3878829500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe80c159da0 msgr2=0x7fe80c14da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:49.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.922+0000 7fe810dff700 1 --2- 172.21.15.112:0/3878829500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe80c159da0 0x7fe80c14da50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe80c06ace0 tx=0x7fe804007b60 comp rx=0 tx=0).stop 2023-09-12T16:07:49.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.922+0000 7fe810dff700 1 -- 172.21.15.112:0/3878829500 shutdown_connections 2023-09-12T16:07:49.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.922+0000 7fe810dff700 1 --2- 172.21.15.112:0/3878829500 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe7ec06a5b0 0x7fe7ec06ca70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:49.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.922+0000 7fe810dff700 1 --2- 172.21.15.112:0/3878829500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe80c159da0 0x7fe80c14da50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:49.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.922+0000 7fe810dff700 1 --2- 172.21.15.112:0/3878829500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe80c06a020 0x7fe80c15a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:49.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.922+0000 7fe810dff700 1 --2- 172.21.15.112:0/3878829500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe80c0c8f20 0x7fe80c0ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:49.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.922+0000 7fe810dff700 1 -- 172.21.15.112:0/3878829500 >> 172.21.15.112:0/3878829500 conn(0x7fe80c06b760 msgr2=0x7fe80c0c4170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:49.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.922+0000 7fe810dff700 1 -- 172.21.15.112:0/3878829500 shutdown_connections 2023-09-12T16:07:49.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:49.922+0000 7fe810dff700 1 -- 172.21.15.112:0/3878829500 wait complete. 2023-09-12T16:07:49.940 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-12T16:06:48.871680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-12T16:06:58.137223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-12T16:06:58.684034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-12T16:07:02.283459+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-12T16:07:49.941 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-12T16:07:50.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.143+0000 7fafe43ff700 1 -- 172.21.15.112:0/3589536384 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fafdc15bb40 msgr2=0x7fafdc0d1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:50.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.143+0000 7fafe43ff700 1 --2- 172.21.15.112:0/3589536384 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fafdc15bb40 0x7fafdc0d1ed0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fafd8005fd0 tx=0x7fafd8009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:50.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.143+0000 7fafe43ff700 1 -- 172.21.15.112:0/3589536384 shutdown_connections 2023-09-12T16:07:50.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.143+0000 7fafe43ff700 1 --2- 172.21.15.112:0/3589536384 >> v2:172.21.15.144:3300/0 conn(0x7fafdc15fc40 0x7fafdc0b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:50.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.143+0000 7fafe43ff700 1 --2- 172.21.15.112:0/3589536384 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fafdc15bb40 0x7fafdc0d1ed0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:50.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.143+0000 7fafe43ff700 1 -- 172.21.15.112:0/3589536384 >> 172.21.15.112:0/3589536384 conn(0x7fafdc09aa90 msgr2=0x7fafdc0d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:50.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.143+0000 7fafe43ff700 1 -- 172.21.15.112:0/3589536384 shutdown_connections 2023-09-12T16:07:50.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.143+0000 7fafe43ff700 1 -- 172.21.15.112:0/3589536384 wait complete. 2023-09-12T16:07:50.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.145+0000 7fafe43ff700 1 Processor -- start 2023-09-12T16:07:50.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.145+0000 7fafe43ff700 1 -- start start 2023-09-12T16:07:50.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.146+0000 7fafe43ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafdc0d2410 0x7fafdc146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:50.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.146+0000 7fafe43ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fafdc15bb40 0x7fafdc0c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:50.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.146+0000 7fafe43ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafdc15fc40 0x7fafdc0c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:50.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.146+0000 7fafe43ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc15dd70 con 0x7fafdc0d2410 2023-09-12T16:07:50.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.146+0000 7fafe43ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc15e050 con 0x7fafdc15fc40 2023-09-12T16:07:50.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.146+0000 7fafe43ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc15e330 con 0x7fafdc15bb40 2023-09-12T16:07:50.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.146+0000 7fafe219b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafdc0d2410 0x7fafdc146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:50.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.146+0000 7fafe219b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafdc0d2410 0x7fafdc146760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45644/0 (socket says 172.21.15.112:45644) 2023-09-12T16:07:50.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.146+0000 7fafe219b700 1 -- 172.21.15.112:0/1762011277 learned_addr learned my addr 172.21.15.112:0/1762011277 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:50.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.146+0000 7fafe199a700 1 --2- 172.21.15.112:0/1762011277 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fafdc15bb40 0x7fafdc0c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:50.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.147+0000 7fafe299c700 1 --2- 172.21.15.112:0/1762011277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafdc15fc40 0x7fafdc0c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:50.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.147+0000 7fafe219b700 1 -- 172.21.15.112:0/1762011277 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fafdc15bb40 msgr2=0x7fafdc0c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:50.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.147+0000 7fafe219b700 1 --2- 172.21.15.112:0/1762011277 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fafdc15bb40 0x7fafdc0c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:50.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.147+0000 7fafe219b700 1 -- 172.21.15.112:0/1762011277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafdc15fc40 msgr2=0x7fafdc0c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:50.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.147+0000 7fafe219b700 1 --2- 172.21.15.112:0/1762011277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafdc15fc40 0x7fafdc0c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:50.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.147+0000 7fafe219b700 1 -- 172.21.15.112:0/1762011277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd80095f0 con 0x7fafdc0d2410 2023-09-12T16:07:50.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.147+0000 7fafe219b700 1 --2- 172.21.15.112:0/1762011277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafdc0d2410 0x7fafdc146760 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fafd80098e0 tx=0x7fafd8003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:50.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.147+0000 7fafd2ffd700 1 -- 172.21.15.112:0/1762011277 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd801d070 con 0x7fafdc0d2410 2023-09-12T16:07:50.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.147+0000 7fafd2ffd700 1 -- 172.21.15.112:0/1762011277 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fafd800b820 con 0x7fafdc0d2410 2023-09-12T16:07:50.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.147+0000 7fafe43ff700 1 -- 172.21.15.112:0/1762011277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafdc15e610 con 0x7fafdc0d2410 2023-09-12T16:07:50.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.147+0000 7fafd2ffd700 1 -- 172.21.15.112:0/1762011277 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd80045f0 con 0x7fafdc0d2410 2023-09-12T16:07:50.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.148+0000 7fafe43ff700 1 -- 172.21.15.112:0/1762011277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafdc15d060 con 0x7fafdc0d2410 2023-09-12T16:07:50.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.148+0000 7fafe43ff700 1 -- 172.21.15.112:0/1762011277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafdc146e60 con 0x7fafdc0d2410 2023-09-12T16:07:50.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.149+0000 7fafd2ffd700 1 -- 172.21.15.112:0/1762011277 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fafd800bc10 con 0x7fafdc0d2410 2023-09-12T16:07:50.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.150+0000 7fafd2ffd700 1 --2- 172.21.15.112:0/1762011277 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fafc006a580 0x7fafc006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:50.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.150+0000 7fafd2ffd700 1 -- 172.21.15.112:0/1762011277 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fafd808a400 con 0x7fafdc0d2410 2023-09-12T16:07:50.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.150+0000 7fafe199a700 1 --2- 172.21.15.112:0/1762011277 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fafc006a580 0x7fafc006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:50.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.151+0000 7fafe199a700 1 --2- 172.21.15.112:0/1762011277 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fafc006a580 0x7fafc006ca40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fafdc1f51a0 tx=0x7fafcc009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:50.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.154+0000 7fafd2ffd700 1 -- 172.21.15.112:0/1762011277 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fafd80556b0 con 0x7fafdc0d2410 2023-09-12T16:07:50.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.350+0000 7fafe43ff700 1 -- 172.21.15.112:0/1762011277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fafdc073ea0 con 0x7fafdc0d2410 2023-09-12T16:07:50.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.350+0000 7fafd2ffd700 1 -- 172.21.15.112:0/1762011277 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fafd8058cd0 con 0x7fafdc0d2410 2023-09-12T16:07:50.351 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-09-12T16:07:50.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.352+0000 7fafe43ff700 1 -- 172.21.15.112:0/1762011277 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fafc006a580 msgr2=0x7fafc006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:50.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.352+0000 7fafe43ff700 1 --2- 172.21.15.112:0/1762011277 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fafc006a580 0x7fafc006ca40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fafdc1f51a0 tx=0x7fafcc009040 comp rx=0 tx=0).stop 2023-09-12T16:07:50.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.352+0000 7fafe43ff700 1 -- 172.21.15.112:0/1762011277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafdc0d2410 msgr2=0x7fafdc146760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:50.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.352+0000 7fafe43ff700 1 --2- 172.21.15.112:0/1762011277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafdc0d2410 0x7fafdc146760 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fafd80098e0 tx=0x7fafd8003d00 comp rx=0 tx=0).stop 2023-09-12T16:07:50.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.353+0000 7fafe43ff700 1 -- 172.21.15.112:0/1762011277 shutdown_connections 2023-09-12T16:07:50.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.353+0000 7fafe43ff700 1 --2- 172.21.15.112:0/1762011277 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fafc006a580 0x7fafc006ca40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:50.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.353+0000 7fafe43ff700 1 --2- 172.21.15.112:0/1762011277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafdc15fc40 0x7fafdc0c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:50.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.353+0000 7fafe43ff700 1 --2- 172.21.15.112:0/1762011277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafdc0d2410 0x7fafdc146760 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:50.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.353+0000 7fafe43ff700 1 --2- 172.21.15.112:0/1762011277 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fafdc15bb40 0x7fafdc0c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:50.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.353+0000 7fafe43ff700 1 -- 172.21.15.112:0/1762011277 >> 172.21.15.112:0/1762011277 conn(0x7fafdc09aa90 msgr2=0x7fafdc0b6450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:50.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.353+0000 7fafe43ff700 1 -- 172.21.15.112:0/1762011277 shutdown_connections 2023-09-12T16:07:50.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.353+0000 7fafe43ff700 1 -- 172.21.15.112:0/1762011277 wait complete. 2023-09-12T16:07:50.371 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-12T16:07:50.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.574+0000 7fea073ff700 1 -- 172.21.15.112:0/1594303535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea000cfdb0 msgr2=0x7fea000d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:50.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.574+0000 7fea073ff700 1 --2- 172.21.15.112:0/1594303535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea000cfdb0 0x7fea000d01e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fea0008bf50 tx=0x7fe9f800b380 comp rx=0 tx=0).stop 2023-09-12T16:07:50.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.574+0000 7fea073ff700 1 -- 172.21.15.112:0/1594303535 shutdown_connections 2023-09-12T16:07:50.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.574+0000 7fea073ff700 1 --2- 172.21.15.112:0/1594303535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea000cfdb0 0x7fea000d01e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:50.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.574+0000 7fea073ff700 1 --2- 172.21.15.112:0/1594303535 >> v2:172.21.15.144:3300/0 conn(0x7fea0015bca0 0x7fea0015cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:50.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.574+0000 7fea073ff700 1 --2- 172.21.15.112:0/1594303535 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fea000cf5b0 0x7fea000cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:50.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.574+0000 7fea073ff700 1 -- 172.21.15.112:0/1594303535 >> 172.21.15.112:0/1594303535 conn(0x7fea000d17d0 msgr2=0x7fea000d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:50.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.574+0000 7fea073ff700 1 -- 172.21.15.112:0/1594303535 shutdown_connections 2023-09-12T16:07:50.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.574+0000 7fea073ff700 1 -- 172.21.15.112:0/1594303535 wait complete. 2023-09-12T16:07:50.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.575+0000 7fea073ff700 1 Processor -- start 2023-09-12T16:07:50.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.576+0000 7fea073ff700 1 -- start start 2023-09-12T16:07:50.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.576+0000 7fea073ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea000cfdb0 0x7fea001583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:50.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.576+0000 7fea073ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea0015bca0 0x7fea000c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:50.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.576+0000 7fea073ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fea0015a030 0x7fea000c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:50.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.576+0000 7fea073ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea00159eb0 con 0x7fea0015bca0 2023-09-12T16:07:50.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.576+0000 7fea073ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea00158930 con 0x7fea000cfdb0 2023-09-12T16:07:50.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.576+0000 7fea073ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea000c9f60 con 0x7fea0015a030 2023-09-12T16:07:50.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.577+0000 7fea0499a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea0015bca0 0x7fea000c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:50.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.577+0000 7fea0499a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea0015bca0 0x7fea000c70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45660/0 (socket says 172.21.15.112:45660) 2023-09-12T16:07:50.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.577+0000 7fea0499a700 1 -- 172.21.15.112:0/590233575 learned_addr learned my addr 172.21.15.112:0/590233575 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:50.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.577+0000 7fea0519b700 1 --2- 172.21.15.112:0/590233575 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea000cfdb0 0x7fea001583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:50.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.577+0000 7fea0599c700 1 --2- 172.21.15.112:0/590233575 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fea0015a030 0x7fea000c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:50.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.577+0000 7fea0499a700 1 -- 172.21.15.112:0/590233575 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fea0015a030 msgr2=0x7fea000c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:50.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.577+0000 7fea0499a700 1 --2- 172.21.15.112:0/590233575 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fea0015a030 0x7fea000c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:50.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.577+0000 7fea0499a700 1 -- 172.21.15.112:0/590233575 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea000cfdb0 msgr2=0x7fea001583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:50.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.577+0000 7fea0499a700 1 --2- 172.21.15.112:0/590233575 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea000cfdb0 0x7fea001583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:50.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.577+0000 7fea0499a700 1 -- 172.21.15.112:0/590233575 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f8009d00 con 0x7fea0015bca0 2023-09-12T16:07:50.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.577+0000 7fea0519b700 1 --2- 172.21.15.112:0/590233575 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea000cfdb0 0x7fea001583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:07:50.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.577+0000 7fea0499a700 1 --2- 172.21.15.112:0/590233575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea0015bca0 0x7fea000c70f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe9f000b560 tx=0x7fe9f000b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:50.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.578+0000 7fe9f5ffb700 1 -- 172.21.15.112:0/590233575 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0011830 con 0x7fea0015bca0 2023-09-12T16:07:50.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.578+0000 7fe9f5ffb700 1 -- 172.21.15.112:0/590233575 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe9f0011a80 con 0x7fea0015bca0 2023-09-12T16:07:50.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.578+0000 7fe9f5ffb700 1 -- 172.21.15.112:0/590233575 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0011e90 con 0x7fea0015bca0 2023-09-12T16:07:50.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.578+0000 7fea073ff700 1 -- 172.21.15.112:0/590233575 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea000c82d0 con 0x7fea0015bca0 2023-09-12T16:07:50.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.578+0000 7fea073ff700 1 -- 172.21.15.112:0/590233575 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea001598f0 con 0x7fea0015bca0 2023-09-12T16:07:50.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.579+0000 7fea073ff700 1 -- 172.21.15.112:0/590233575 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea00073ea0 con 0x7fea0015bca0 2023-09-12T16:07:50.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.580+0000 7fe9f5ffb700 1 -- 172.21.15.112:0/590233575 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe9f001a400 con 0x7fea0015bca0 2023-09-12T16:07:50.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.581+0000 7fe9f5ffb700 1 --2- 172.21.15.112:0/590233575 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe9e406a580 0x7fe9e406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:50.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.581+0000 7fe9f5ffb700 1 -- 172.21.15.112:0/590233575 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe9f00890c0 con 0x7fea0015bca0 2023-09-12T16:07:50.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.581+0000 7fea0519b700 1 --2- 172.21.15.112:0/590233575 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe9e406a580 0x7fe9e406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:50.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.582+0000 7fea0519b700 1 --2- 172.21.15.112:0/590233575 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe9e406a580 0x7fe9e406ca40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc006fd0 tx=0x7fe9fc008040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:50.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.585+0000 7fe9f5ffb700 1 -- 172.21.15.112:0/590233575 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe9f00542f0 con 0x7fea0015bca0 2023-09-12T16:07:50.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.781+0000 7fea073ff700 1 -- 172.21.15.112:0/590233575 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fea0008b860 con 0x7fea0015bca0 2023-09-12T16:07:50.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.781+0000 7fe9f5ffb700 1 -- 172.21.15.112:0/590233575 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe9f0015020 con 0x7fea0015bca0 2023-09-12T16:07:50.782 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:07:50.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.784+0000 7fea073ff700 1 -- 172.21.15.112:0/590233575 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe9e406a580 msgr2=0x7fe9e406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:50.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.784+0000 7fea073ff700 1 --2- 172.21.15.112:0/590233575 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe9e406a580 0x7fe9e406ca40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc006fd0 tx=0x7fe9fc008040 comp rx=0 tx=0).stop 2023-09-12T16:07:50.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.784+0000 7fea073ff700 1 -- 172.21.15.112:0/590233575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea0015bca0 msgr2=0x7fea000c70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:50.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.784+0000 7fea073ff700 1 --2- 172.21.15.112:0/590233575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea0015bca0 0x7fea000c70f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe9f000b560 tx=0x7fe9f000b920 comp rx=0 tx=0).stop 2023-09-12T16:07:50.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.784+0000 7fea073ff700 1 -- 172.21.15.112:0/590233575 shutdown_connections 2023-09-12T16:07:50.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.784+0000 7fea073ff700 1 --2- 172.21.15.112:0/590233575 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe9e406a580 0x7fe9e406ca40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:50.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.784+0000 7fea073ff700 1 --2- 172.21.15.112:0/590233575 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fea0015a030 0x7fea000c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:50.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.784+0000 7fea073ff700 1 --2- 172.21.15.112:0/590233575 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea000cfdb0 0x7fea001583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:50.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.784+0000 7fea073ff700 1 --2- 172.21.15.112:0/590233575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea0015bca0 0x7fea000c70f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:50.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.784+0000 7fea073ff700 1 -- 172.21.15.112:0/590233575 >> 172.21.15.112:0/590233575 conn(0x7fea000d17d0 msgr2=0x7fea0015a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:50.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.784+0000 7fea073ff700 1 -- 172.21.15.112:0/590233575 shutdown_connections 2023-09-12T16:07:50.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:50.784+0000 7fea073ff700 1 -- 172.21.15.112:0/590233575 wait complete. 2023-09-12T16:07:50.802 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-12T16:07:51.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.004+0000 7f3abefff700 1 -- 172.21.15.112:0/4292982392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab80cfdb0 msgr2=0x7f3ab80d0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:51.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.004+0000 7f3abefff700 1 --2- 172.21.15.112:0/4292982392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab80cfdb0 0x7f3ab80d0200 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0009fd0 tx=0x7f3ab000b380 comp rx=0 tx=0).stop 2023-09-12T16:07:51.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.004+0000 7f3abefff700 1 -- 172.21.15.112:0/4292982392 shutdown_connections 2023-09-12T16:07:51.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.004+0000 7f3abefff700 1 --2- 172.21.15.112:0/4292982392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab80cfdb0 0x7f3ab80d0200 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.004+0000 7f3abefff700 1 --2- 172.21.15.112:0/4292982392 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ab815bca0 0x7f3ab815cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.004+0000 7f3abefff700 1 -- 172.21.15.112:0/4292982392 >> 172.21.15.112:0/4292982392 conn(0x7f3ab80d17d0 msgr2=0x7f3ab80d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:51.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.004+0000 7f3abefff700 1 -- 172.21.15.112:0/4292982392 shutdown_connections 2023-09-12T16:07:51.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.005+0000 7f3abefff700 1 -- 172.21.15.112:0/4292982392 wait complete. 2023-09-12T16:07:51.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.006+0000 7f3abefff700 1 Processor -- start 2023-09-12T16:07:51.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.006+0000 7f3abefff700 1 -- start start 2023-09-12T16:07:51.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.007+0000 7f3abefff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab80cfdb0 0x7f3ab81f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:51.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.007+0000 7f3abefff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ab815bca0 0x7f3ab80c5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:51.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.007+0000 7f3abefff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ab80c5840 0x7f3ab8158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:51.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.007+0000 7f3abefff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab81583b0 con 0x7f3ab80cfdb0 2023-09-12T16:07:51.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.007+0000 7f3abefff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab81577a0 con 0x7f3ab815bca0 2023-09-12T16:07:51.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.007+0000 7f3abefff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab8157a80 con 0x7f3ab80c5840 2023-09-12T16:07:51.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.007+0000 7f3abcd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab80cfdb0 0x7f3ab81f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:51.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.008+0000 7f3abcd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab80cfdb0 0x7f3ab81f1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45690/0 (socket says 172.21.15.112:45690) 2023-09-12T16:07:51.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.008+0000 7f3abcd9b700 1 -- 172.21.15.112:0/3044059296 learned_addr learned my addr 172.21.15.112:0/3044059296 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:51.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.008+0000 7f3ab7fff700 1 --2- 172.21.15.112:0/3044059296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ab815bca0 0x7f3ab80c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:51.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.008+0000 7f3abd59c700 1 --2- 172.21.15.112:0/3044059296 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ab80c5840 0x7f3ab8158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:51.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.008+0000 7f3abcd9b700 1 -- 172.21.15.112:0/3044059296 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ab80c5840 msgr2=0x7f3ab8158840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:51.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.008+0000 7f3abcd9b700 1 --2- 172.21.15.112:0/3044059296 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ab80c5840 0x7f3ab8158840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.008+0000 7f3abcd9b700 1 -- 172.21.15.112:0/3044059296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ab815bca0 msgr2=0x7f3ab80c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:51.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.008+0000 7f3abcd9b700 1 --2- 172.21.15.112:0/3044059296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ab815bca0 0x7f3ab80c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.008+0000 7f3abcd9b700 1 -- 172.21.15.112:0/3044059296 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab0009d00 con 0x7f3ab80cfdb0 2023-09-12T16:07:51.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.008+0000 7f3abcd9b700 1 --2- 172.21.15.112:0/3044059296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab80cfdb0 0x7f3ab81f1d10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3aac00b4a0 tx=0x7f3aac00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:51.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.008+0000 7f3ab57fa700 1 -- 172.21.15.112:0/3044059296 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac011830 con 0x7f3ab80cfdb0 2023-09-12T16:07:51.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.009+0000 7f3ab57fa700 1 -- 172.21.15.112:0/3044059296 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3aac011a80 con 0x7f3ab80cfdb0 2023-09-12T16:07:51.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.009+0000 7f3abefff700 1 -- 172.21.15.112:0/3044059296 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab8157d60 con 0x7f3ab80cfdb0 2023-09-12T16:07:51.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.009+0000 7f3ab57fa700 1 -- 172.21.15.112:0/3044059296 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac011e90 con 0x7f3ab80cfdb0 2023-09-12T16:07:51.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.009+0000 7f3abefff700 1 -- 172.21.15.112:0/3044059296 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab8159790 con 0x7f3ab80cfdb0 2023-09-12T16:07:51.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.010+0000 7f3abefff700 1 -- 172.21.15.112:0/3044059296 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab8158690 con 0x7f3ab80cfdb0 2023-09-12T16:07:51.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.011+0000 7f3ab57fa700 1 -- 172.21.15.112:0/3044059296 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f3aac01a400 con 0x7f3ab80cfdb0 2023-09-12T16:07:51.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.012+0000 7f3ab57fa700 1 --2- 172.21.15.112:0/3044059296 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3a9c06a5b0 0x7f3a9c06ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:51.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.013+0000 7f3ab57fa700 1 -- 172.21.15.112:0/3044059296 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3aac089070 con 0x7f3ab80cfdb0 2023-09-12T16:07:51.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.013+0000 7f3ab7fff700 1 --2- 172.21.15.112:0/3044059296 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3a9c06a5b0 0x7f3a9c06ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:51.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.013+0000 7f3ab7fff700 1 --2- 172.21.15.112:0/3044059296 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3a9c06a5b0 0x7f3a9c06ca70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3ab806b690 tx=0x7f3aa4009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:51.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.017+0000 7f3ab57fa700 1 -- 172.21.15.112:0/3044059296 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f3aac0bb9b0 con 0x7f3ab80cfdb0 2023-09-12T16:07:51.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.211+0000 7f3abefff700 1 -- 172.21.15.112:0/3044059296 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3ab8073ea0 con 0x7f3ab80cfdb0 2023-09-12T16:07:51.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.212+0000 7f3ab57fa700 1 -- 172.21.15.112:0/3044059296 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3aac0150a0 con 0x7f3ab80cfdb0 2023-09-12T16:07:51.212 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-09-12T16:07:51.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.214+0000 7f3abefff700 1 -- 172.21.15.112:0/3044059296 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3a9c06a5b0 msgr2=0x7f3a9c06ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:51.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.214+0000 7f3abefff700 1 --2- 172.21.15.112:0/3044059296 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3a9c06a5b0 0x7f3a9c06ca70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3ab806b690 tx=0x7f3aa4009040 comp rx=0 tx=0).stop 2023-09-12T16:07:51.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.214+0000 7f3abefff700 1 -- 172.21.15.112:0/3044059296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab80cfdb0 msgr2=0x7f3ab81f1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:51.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.214+0000 7f3abefff700 1 --2- 172.21.15.112:0/3044059296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab80cfdb0 0x7f3ab81f1d10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3aac00b4a0 tx=0x7f3aac00b7b0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.215+0000 7f3abefff700 1 -- 172.21.15.112:0/3044059296 shutdown_connections 2023-09-12T16:07:51.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.215+0000 7f3abefff700 1 --2- 172.21.15.112:0/3044059296 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3a9c06a5b0 0x7f3a9c06ca70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.215+0000 7f3abefff700 1 --2- 172.21.15.112:0/3044059296 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ab80c5840 0x7f3ab8158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.215+0000 7f3abefff700 1 --2- 172.21.15.112:0/3044059296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab80cfdb0 0x7f3ab81f1d10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.215+0000 7f3abefff700 1 --2- 172.21.15.112:0/3044059296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ab815bca0 0x7f3ab80c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.215+0000 7f3abefff700 1 -- 172.21.15.112:0/3044059296 >> 172.21.15.112:0/3044059296 conn(0x7f3ab80d17d0 msgr2=0x7f3ab80b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:51.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.215+0000 7f3abefff700 1 -- 172.21.15.112:0/3044059296 shutdown_connections 2023-09-12T16:07:51.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.215+0000 7f3abefff700 1 -- 172.21.15.112:0/3044059296 wait complete. 2023-09-12T16:07:51.233 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-12T16:07:51.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.436+0000 7fd6a3dff700 1 -- 172.21.15.112:0/3568194785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd69c15bca0 msgr2=0x7fd69c15cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:51.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.436+0000 7fd6a3dff700 1 --2- 172.21.15.112:0/3568194785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd69c15bca0 0x7fd69c15cb90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd6980098c0 tx=0x7fd698009bd0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.436+0000 7fd6a3dff700 1 -- 172.21.15.112:0/3568194785 shutdown_connections 2023-09-12T16:07:51.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.436+0000 7fd6a3dff700 1 --2- 172.21.15.112:0/3568194785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd69c15bca0 0x7fd69c15cb90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.436+0000 7fd6a3dff700 1 --2- 172.21.15.112:0/3568194785 >> v2:172.21.15.144:3300/0 conn(0x7fd69c0cf5b0 0x7fd69c0cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.436+0000 7fd6a3dff700 1 -- 172.21.15.112:0/3568194785 >> 172.21.15.112:0/3568194785 conn(0x7fd69c0d17d0 msgr2=0x7fd69c0d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:51.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.436+0000 7fd6a3dff700 1 -- 172.21.15.112:0/3568194785 shutdown_connections 2023-09-12T16:07:51.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.436+0000 7fd6a3dff700 1 -- 172.21.15.112:0/3568194785 wait complete. 2023-09-12T16:07:51.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.438+0000 7fd6a3dff700 1 Processor -- start 2023-09-12T16:07:51.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.438+0000 7fd6a3dff700 1 -- start start 2023-09-12T16:07:51.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.439+0000 7fd6a3dff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd69c0cfdb0 0x7fd69c1586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:51.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.439+0000 7fd6a3dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd69c15bca0 0x7fd69c06bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:51.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.439+0000 7fd6a3dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd69c06c490 0x7fd69c0b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:51.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.439+0000 7fd6a3dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c06c920 con 0x7fd69c15bca0 2023-09-12T16:07:51.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.439+0000 7fd6a3dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c0b1e70 con 0x7fd69c06c490 2023-09-12T16:07:51.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.439+0000 7fd6a3dff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c0b18b0 con 0x7fd69c0cfdb0 2023-09-12T16:07:51.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.439+0000 7fd6a139a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd69c15bca0 0x7fd69c06bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:51.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.440+0000 7fd6a139a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd69c15bca0 0x7fd69c06bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45698/0 (socket says 172.21.15.112:45698) 2023-09-12T16:07:51.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.440+0000 7fd6a139a700 1 -- 172.21.15.112:0/1424536868 learned_addr learned my addr 172.21.15.112:0/1424536868 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:51.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.440+0000 7fd6a1b9b700 1 --2- 172.21.15.112:0/1424536868 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd69c0cfdb0 0x7fd69c1586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:51.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.440+0000 7fd6a239c700 1 --2- 172.21.15.112:0/1424536868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd69c06c490 0x7fd69c0b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:51.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.440+0000 7fd6a139a700 1 -- 172.21.15.112:0/1424536868 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd69c0cfdb0 msgr2=0x7fd69c1586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:51.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.440+0000 7fd6a139a700 1 --2- 172.21.15.112:0/1424536868 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd69c0cfdb0 0x7fd69c1586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.440+0000 7fd6a139a700 1 -- 172.21.15.112:0/1424536868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd69c06c490 msgr2=0x7fd69c0b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:51.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.440+0000 7fd6a139a700 1 --2- 172.21.15.112:0/1424536868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd69c06c490 0x7fd69c0b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.440+0000 7fd6a139a700 1 -- 172.21.15.112:0/1424536868 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd698009520 con 0x7fd69c15bca0 2023-09-12T16:07:51.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.440+0000 7fd6a139a700 1 --2- 172.21.15.112:0/1424536868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd69c15bca0 0x7fd69c06bf50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd68c00e9c0 tx=0x7fd68c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:51.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.440+0000 7fd6927fc700 1 -- 172.21.15.112:0/1424536868 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c004a30 con 0x7fd69c15bca0 2023-09-12T16:07:51.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.440+0000 7fd6927fc700 1 -- 172.21.15.112:0/1424536868 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd68c004bb0 con 0x7fd69c15bca0 2023-09-12T16:07:51.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.440+0000 7fd6a3dff700 1 -- 172.21.15.112:0/1424536868 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd69c0b1b90 con 0x7fd69c15bca0 2023-09-12T16:07:51.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.440+0000 7fd6927fc700 1 -- 172.21.15.112:0/1424536868 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c00c7c0 con 0x7fd69c15bca0 2023-09-12T16:07:51.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.441+0000 7fd6a3dff700 1 -- 172.21.15.112:0/1424536868 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd69c0c9b50 con 0x7fd69c15bca0 2023-09-12T16:07:51.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.442+0000 7fd6a3dff700 1 -- 172.21.15.112:0/1424536868 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd69c0c96d0 con 0x7fd69c15bca0 2023-09-12T16:07:51.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.443+0000 7fd6927fc700 1 -- 172.21.15.112:0/1424536868 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fd68c00c920 con 0x7fd69c15bca0 2023-09-12T16:07:51.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.443+0000 7fd6927fc700 1 --2- 172.21.15.112:0/1424536868 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd68006a580 0x7fd68006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:51.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.444+0000 7fd6927fc700 1 -- 172.21.15.112:0/1424536868 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd68c014070 con 0x7fd69c15bca0 2023-09-12T16:07:51.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.444+0000 7fd6a1b9b700 1 --2- 172.21.15.112:0/1424536868 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd68006a580 0x7fd68006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:51.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.444+0000 7fd6a1b9b700 1 --2- 172.21.15.112:0/1424536868 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd68006a580 0x7fd68006ca40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd698000c00 tx=0x7fd69801a040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:51.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.448+0000 7fd6927fc700 1 -- 172.21.15.112:0/1424536868 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd69c0c96d0 con 0x7fd69c15bca0 2023-09-12T16:07:51.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.646+0000 7fd6a3dff700 1 -- 172.21.15.112:0/1424536868 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd69c0c96d0 con 0x7fd69c15bca0 2023-09-12T16:07:51.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.647+0000 7fd6927fc700 1 -- 172.21.15.112:0/1424536868 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd69c0c96d0 con 0x7fd69c15bca0 2023-09-12T16:07:51.647 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:07:51.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.649+0000 7fd6a3dff700 1 -- 172.21.15.112:0/1424536868 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd68006a580 msgr2=0x7fd68006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:51.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.649+0000 7fd6a3dff700 1 --2- 172.21.15.112:0/1424536868 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd68006a580 0x7fd68006ca40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd698000c00 tx=0x7fd69801a040 comp rx=0 tx=0).stop 2023-09-12T16:07:51.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.649+0000 7fd6a3dff700 1 -- 172.21.15.112:0/1424536868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd69c15bca0 msgr2=0x7fd69c06bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:51.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.649+0000 7fd6a3dff700 1 --2- 172.21.15.112:0/1424536868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd69c15bca0 0x7fd69c06bf50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd68c00e9c0 tx=0x7fd68c00ecd0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.649+0000 7fd6a3dff700 1 -- 172.21.15.112:0/1424536868 shutdown_connections 2023-09-12T16:07:51.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.649+0000 7fd6a3dff700 1 --2- 172.21.15.112:0/1424536868 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd68006a580 0x7fd68006ca40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.649+0000 7fd6a3dff700 1 --2- 172.21.15.112:0/1424536868 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd69c0cfdb0 0x7fd69c1586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.649+0000 7fd6a3dff700 1 --2- 172.21.15.112:0/1424536868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd69c06c490 0x7fd69c0b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.649+0000 7fd6a3dff700 1 --2- 172.21.15.112:0/1424536868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd69c15bca0 0x7fd69c06bf50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.649+0000 7fd6a3dff700 1 -- 172.21.15.112:0/1424536868 >> 172.21.15.112:0/1424536868 conn(0x7fd69c0d17d0 msgr2=0x7fd69c0afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:51.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.649+0000 7fd6a3dff700 1 -- 172.21.15.112:0/1424536868 shutdown_connections 2023-09-12T16:07:51.652 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.649+0000 7fd6a3dff700 1 -- 172.21.15.112:0/1424536868 wait complete. 2023-09-12T16:07:51.668 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:07:51.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.867+0000 7f3103dff700 1 -- 172.21.15.112:0/4129651557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30fc0c9ac0 msgr2=0x7f30fc0cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:51.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.867+0000 7f3103dff700 1 --2- 172.21.15.112:0/4129651557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30fc0c9ac0 0x7f30fc0cd980 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f30fc0cd360 tx=0x7f30ec009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:51.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.867+0000 7f3103dff700 1 -- 172.21.15.112:0/4129651557 shutdown_connections 2023-09-12T16:07:51.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.867+0000 7f3103dff700 1 --2- 172.21.15.112:0/4129651557 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30fc070e00 0x7f30fc15d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.867+0000 7f3103dff700 1 --2- 172.21.15.112:0/4129651557 >> v2:172.21.15.144:3300/0 conn(0x7f30fc159af0 0x7f30fc0cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.867+0000 7f3103dff700 1 --2- 172.21.15.112:0/4129651557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30fc0c9ac0 0x7f30fc0cd980 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.867+0000 7f3103dff700 1 -- 172.21.15.112:0/4129651557 >> 172.21.15.112:0/4129651557 conn(0x7f30fc06a650 msgr2=0x7f30fc06c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:51.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.867+0000 7f3103dff700 1 -- 172.21.15.112:0/4129651557 shutdown_connections 2023-09-12T16:07:51.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.868+0000 7f3103dff700 1 -- 172.21.15.112:0/4129651557 wait complete. 2023-09-12T16:07:51.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.869+0000 7f3103dff700 1 Processor -- start 2023-09-12T16:07:51.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.869+0000 7f3103dff700 1 -- start start 2023-09-12T16:07:51.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.870+0000 7f3103dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30fc070e00 0x7f30fc1e6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:51.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.870+0000 7f3103dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30fc159af0 0x7f30fc0c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:51.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.870+0000 7f3103dff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30fc15a230 0x7f30fc15a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:51.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.870+0000 7f3103dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc15ac20 con 0x7f30fc070e00 2023-09-12T16:07:51.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.870+0000 7f3103dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc1e74d0 con 0x7f30fc159af0 2023-09-12T16:07:51.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.870+0000 7f3103dff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc1e77b0 con 0x7f30fc15a230 2023-09-12T16:07:51.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.870+0000 7f3101b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30fc070e00 0x7f30fc1e6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:51.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.870+0000 7f3101b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30fc070e00 0x7f30fc1e6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45722/0 (socket says 172.21.15.112:45722) 2023-09-12T16:07:51.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.870+0000 7f3101b9b700 1 -- 172.21.15.112:0/553587654 learned_addr learned my addr 172.21.15.112:0/553587654 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:51.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.871+0000 7f310139a700 1 --2- 172.21.15.112:0/553587654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30fc159af0 0x7f30fc0c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:51.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.871+0000 7f310239c700 1 --2- 172.21.15.112:0/553587654 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30fc15a230 0x7f30fc15a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:51.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.871+0000 7f3101b9b700 1 -- 172.21.15.112:0/553587654 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30fc15a230 msgr2=0x7f30fc15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:51.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.871+0000 7f3101b9b700 1 --2- 172.21.15.112:0/553587654 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30fc15a230 0x7f30fc15a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.871+0000 7f3101b9b700 1 -- 172.21.15.112:0/553587654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30fc159af0 msgr2=0x7f30fc0c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:51.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.871+0000 7f3101b9b700 1 --2- 172.21.15.112:0/553587654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30fc159af0 0x7f30fc0c7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:51.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.871+0000 7f3101b9b700 1 -- 172.21.15.112:0/553587654 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ec0095f0 con 0x7f30fc070e00 2023-09-12T16:07:51.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.871+0000 7f3101b9b700 1 --2- 172.21.15.112:0/553587654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30fc070e00 0x7f30fc1e6ed0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f30f800d980 tx=0x7f30f800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:51.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.871+0000 7f30f27fc700 1 -- 172.21.15.112:0/553587654 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f8004220 con 0x7f30fc070e00 2023-09-12T16:07:51.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.871+0000 7f30f27fc700 1 -- 172.21.15.112:0/553587654 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f30f8004470 con 0x7f30fc070e00 2023-09-12T16:07:51.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.871+0000 7f30f27fc700 1 -- 172.21.15.112:0/553587654 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f8004a90 con 0x7f30fc070e00 2023-09-12T16:07:51.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.871+0000 7f3103dff700 1 -- 172.21.15.112:0/553587654 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30fc1e7a90 con 0x7f30fc070e00 2023-09-12T16:07:51.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.871+0000 7f3103dff700 1 -- 172.21.15.112:0/553587654 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30fc1e8050 con 0x7f30fc070e00 2023-09-12T16:07:51.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.872+0000 7f3103dff700 1 -- 172.21.15.112:0/553587654 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30fc1e81e0 con 0x7f30fc070e00 2023-09-12T16:07:51.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.873+0000 7f30f27fc700 1 -- 172.21.15.112:0/553587654 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f30f8004bf0 con 0x7f30fc070e00 2023-09-12T16:07:51.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.874+0000 7f30f27fc700 1 --2- 172.21.15.112:0/553587654 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f30e006a5b0 0x7f30e006ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:51.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.874+0000 7f30f27fc700 1 -- 172.21.15.112:0/553587654 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f30f80890d0 con 0x7f30fc070e00 2023-09-12T16:07:51.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.875+0000 7f310139a700 1 --2- 172.21.15.112:0/553587654 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f30e006a5b0 0x7f30e006ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:51.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.875+0000 7f310139a700 1 --2- 172.21.15.112:0/553587654 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f30e006a5b0 0x7f30e006ca70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0098e0 tx=0x7f30ec0047c0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:51.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:51.878+0000 7f30f27fc700 1 -- 172.21.15.112:0/553587654 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f30f80541d0 con 0x7f30fc070e00 2023-09-12T16:07:52.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.076+0000 7f3103dff700 1 -- 172.21.15.112:0/553587654 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30fc04e300 con 0x7f30fc070e00 2023-09-12T16:07:52.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.077+0000 7f30f27fc700 1 -- 172.21.15.112:0/553587654 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18816 (secure 0 0 0) 0x7f30f8017020 con 0x7f30fc070e00 2023-09-12T16:07:52.078 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:52.078 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:44.445226+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:07:52.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.080+0000 7f3103dff700 1 -- 172.21.15.112:0/553587654 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f30e006a5b0 msgr2=0x7f30e006ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:52.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.080+0000 7f3103dff700 1 --2- 172.21.15.112:0/553587654 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f30e006a5b0 0x7f30e006ca70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0098e0 tx=0x7f30ec0047c0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.080+0000 7f3103dff700 1 -- 172.21.15.112:0/553587654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30fc070e00 msgr2=0x7f30fc1e6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:52.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.080+0000 7f3103dff700 1 --2- 172.21.15.112:0/553587654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30fc070e00 0x7f30fc1e6ed0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f30f800d980 tx=0x7f30f800dc90 comp rx=0 tx=0).stop 2023-09-12T16:07:52.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.080+0000 7f3103dff700 1 -- 172.21.15.112:0/553587654 shutdown_connections 2023-09-12T16:07:52.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.080+0000 7f3103dff700 1 --2- 172.21.15.112:0/553587654 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f30e006a5b0 0x7f30e006ca70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.080+0000 7f3103dff700 1 --2- 172.21.15.112:0/553587654 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30fc15a230 0x7f30fc15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.080+0000 7f3103dff700 1 --2- 172.21.15.112:0/553587654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30fc070e00 0x7f30fc1e6ed0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.080+0000 7f3103dff700 1 --2- 172.21.15.112:0/553587654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30fc159af0 0x7f30fc0c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.080+0000 7f3103dff700 1 -- 172.21.15.112:0/553587654 >> 172.21.15.112:0/553587654 conn(0x7f30fc06a650 msgr2=0x7f30fc0cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:52.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.080+0000 7f3103dff700 1 -- 172.21.15.112:0/553587654 shutdown_connections 2023-09-12T16:07:52.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.080+0000 7f3103dff700 1 -- 172.21.15.112:0/553587654 wait complete. 2023-09-12T16:07:52.099 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-12T16:06:48.871680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-12T16:06:58.137223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-12T16:06:58.684034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-12T16:07:02.283459+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-12T16:07:52.099 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-12T16:07:52.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.302+0000 7fdae15ff700 1 -- 172.21.15.112:0/2380699526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdadc0cd5b0 msgr2=0x7fdadc0cda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:52.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.302+0000 7fdae15ff700 1 --2- 172.21.15.112:0/2380699526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdadc0cd5b0 0x7fdadc0cda40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdadc0ce290 tx=0x7fdad400b380 comp rx=0 tx=0).stop 2023-09-12T16:07:52.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.302+0000 7fdae15ff700 1 -- 172.21.15.112:0/2380699526 shutdown_connections 2023-09-12T16:07:52.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.302+0000 7fdae15ff700 1 --2- 172.21.15.112:0/2380699526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdadc0cd5b0 0x7fdadc0cda40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.302+0000 7fdae15ff700 1 --2- 172.21.15.112:0/2380699526 >> v2:172.21.15.144:3300/0 conn(0x7fdadc142ef0 0x7fdadc15a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.302+0000 7fdae15ff700 1 --2- 172.21.15.112:0/2380699526 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdadc15dc20 0x7fdadc070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.302+0000 7fdae15ff700 1 -- 172.21.15.112:0/2380699526 >> 172.21.15.112:0/2380699526 conn(0x7fdadc06a200 msgr2=0x7fdadc06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:52.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.302+0000 7fdae15ff700 1 -- 172.21.15.112:0/2380699526 shutdown_connections 2023-09-12T16:07:52.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.302+0000 7fdae15ff700 1 -- 172.21.15.112:0/2380699526 wait complete. 2023-09-12T16:07:52.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.304+0000 7fdae15ff700 1 Processor -- start 2023-09-12T16:07:52.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.304+0000 7fdae15ff700 1 -- start start 2023-09-12T16:07:52.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.305+0000 7fdae15ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdadc0cd5b0 0x7fdadc1f25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:52.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.305+0000 7fdae15ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdadc142ef0 0x7fdadc0c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:52.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.305+0000 7fdae15ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdadc15dc20 0x7fdadc0c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:52.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.305+0000 7fdae15ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc1efa00 con 0x7fdadc15dc20 2023-09-12T16:07:52.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.305+0000 7fdae15ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc1f1140 con 0x7fdadc0cd5b0 2023-09-12T16:07:52.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.305+0000 7fdae15ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc135bd0 con 0x7fdadc142ef0 2023-09-12T16:07:52.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.305+0000 7fdadb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdadc15dc20 0x7fdadc0c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:52.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.305+0000 7fdadb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdadc15dc20 0x7fdadc0c66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45748/0 (socket says 172.21.15.112:45748) 2023-09-12T16:07:52.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.305+0000 7fdadb7fe700 1 -- 172.21.15.112:0/126085317 learned_addr learned my addr 172.21.15.112:0/126085317 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:52.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.305+0000 7fdada7fc700 1 --2- 172.21.15.112:0/126085317 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdadc142ef0 0x7fdadc0c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:52.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.305+0000 7fdadaffd700 1 --2- 172.21.15.112:0/126085317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdadc0cd5b0 0x7fdadc1f25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:52.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.306+0000 7fdadb7fe700 1 -- 172.21.15.112:0/126085317 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdadc142ef0 msgr2=0x7fdadc0c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:52.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.306+0000 7fdadb7fe700 1 --2- 172.21.15.112:0/126085317 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdadc142ef0 0x7fdadc0c6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.306+0000 7fdadb7fe700 1 -- 172.21.15.112:0/126085317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdadc0cd5b0 msgr2=0x7fdadc1f25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:52.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.306+0000 7fdadb7fe700 1 --2- 172.21.15.112:0/126085317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdadc0cd5b0 0x7fdadc1f25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.306+0000 7fdadb7fe700 1 -- 172.21.15.112:0/126085317 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad4009d00 con 0x7fdadc15dc20 2023-09-12T16:07:52.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.306+0000 7fdadb7fe700 1 --2- 172.21.15.112:0/126085317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdadc15dc20 0x7fdadc0c66d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdadc0ce2c0 tx=0x7fdad4007b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:52.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.306+0000 7fdac37fe700 1 -- 172.21.15.112:0/126085317 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad400e040 con 0x7fdadc15dc20 2023-09-12T16:07:52.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.306+0000 7fdac37fe700 1 -- 172.21.15.112:0/126085317 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdad401d680 con 0x7fdadc15dc20 2023-09-12T16:07:52.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.306+0000 7fdac37fe700 1 -- 172.21.15.112:0/126085317 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad401dad0 con 0x7fdadc15dc20 2023-09-12T16:07:52.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.306+0000 7fdae15ff700 1 -- 172.21.15.112:0/126085317 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdadc135eb0 con 0x7fdadc15dc20 2023-09-12T16:07:52.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.307+0000 7fdae15ff700 1 -- 172.21.15.112:0/126085317 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdadc136470 con 0x7fdadc15dc20 2023-09-12T16:07:52.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.308+0000 7fdae15ff700 1 -- 172.21.15.112:0/126085317 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdadc073ea0 con 0x7fdadc15dc20 2023-09-12T16:07:52.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.308+0000 7fdac37fe700 1 -- 172.21.15.112:0/126085317 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fdad401dc30 con 0x7fdadc15dc20 2023-09-12T16:07:52.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.310+0000 7fdac37fe700 1 --2- 172.21.15.112:0/126085317 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdac806a580 0x7fdac806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:52.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.310+0000 7fdac37fe700 1 -- 172.21.15.112:0/126085317 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fdad408b030 con 0x7fdadc15dc20 2023-09-12T16:07:52.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.310+0000 7fdadaffd700 1 --2- 172.21.15.112:0/126085317 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdac806a580 0x7fdac806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:52.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.310+0000 7fdadaffd700 1 --2- 172.21.15.112:0/126085317 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdac806a580 0x7fdac806ca40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdacc005950 tx=0x7fdacc00b410 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:52.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.314+0000 7fdac37fe700 1 -- 172.21.15.112:0/126085317 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fdad4056380 con 0x7fdadc15dc20 2023-09-12T16:07:52.513 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.513+0000 7fdae15ff700 1 -- 172.21.15.112:0/126085317 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdadc067700 con 0x7fdadc15dc20 2023-09-12T16:07:52.513 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.513+0000 7fdac37fe700 1 -- 172.21.15.112:0/126085317 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdad40599a0 con 0x7fdadc15dc20 2023-09-12T16:07:52.513 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-09-12T16:07:52.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.515+0000 7fdae15ff700 1 -- 172.21.15.112:0/126085317 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdac806a580 msgr2=0x7fdac806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:52.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.515+0000 7fdae15ff700 1 --2- 172.21.15.112:0/126085317 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdac806a580 0x7fdac806ca40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdacc005950 tx=0x7fdacc00b410 comp rx=0 tx=0).stop 2023-09-12T16:07:52.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.515+0000 7fdae15ff700 1 -- 172.21.15.112:0/126085317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdadc15dc20 msgr2=0x7fdadc0c66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:52.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.515+0000 7fdae15ff700 1 --2- 172.21.15.112:0/126085317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdadc15dc20 0x7fdadc0c66d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdadc0ce2c0 tx=0x7fdad4007b60 comp rx=0 tx=0).stop 2023-09-12T16:07:52.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.515+0000 7fdae15ff700 1 -- 172.21.15.112:0/126085317 shutdown_connections 2023-09-12T16:07:52.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.515+0000 7fdae15ff700 1 --2- 172.21.15.112:0/126085317 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdac806a580 0x7fdac806ca40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.515+0000 7fdae15ff700 1 --2- 172.21.15.112:0/126085317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdadc15dc20 0x7fdadc0c66d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.515+0000 7fdae15ff700 1 --2- 172.21.15.112:0/126085317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdadc0cd5b0 0x7fdadc1f25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.515+0000 7fdae15ff700 1 --2- 172.21.15.112:0/126085317 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdadc142ef0 0x7fdadc0c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.515+0000 7fdae15ff700 1 -- 172.21.15.112:0/126085317 >> 172.21.15.112:0/126085317 conn(0x7fdadc06a200 msgr2=0x7fdadc142140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:52.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.515+0000 7fdae15ff700 1 -- 172.21.15.112:0/126085317 shutdown_connections 2023-09-12T16:07:52.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.515+0000 7fdae15ff700 1 -- 172.21.15.112:0/126085317 wait complete. 2023-09-12T16:07:52.533 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-12T16:07:52.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.742+0000 7f0c213ff700 1 -- 172.21.15.112:0/3423346617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c1c0cf5b0 msgr2=0x7f0c1c0cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:52.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.742+0000 7f0c213ff700 1 --2- 172.21.15.112:0/3423346617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c1c0cf5b0 0x7f0c1c0cebc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c08abe0 tx=0x7f0c10009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:52.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.742+0000 7f0c213ff700 1 -- 172.21.15.112:0/3423346617 shutdown_connections 2023-09-12T16:07:52.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.742+0000 7f0c213ff700 1 --2- 172.21.15.112:0/3423346617 >> v2:172.21.15.144:3300/0 conn(0x7f0c1c0cfdb0 0x7f0c1c0d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.742+0000 7f0c213ff700 1 --2- 172.21.15.112:0/3423346617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c1c15bca0 0x7f0c1c15cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.742+0000 7f0c213ff700 1 --2- 172.21.15.112:0/3423346617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c1c0cf5b0 0x7f0c1c0cebc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.742+0000 7f0c213ff700 1 -- 172.21.15.112:0/3423346617 >> 172.21.15.112:0/3423346617 conn(0x7f0c1c0d17d0 msgr2=0x7f0c1c0d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:52.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.742+0000 7f0c213ff700 1 -- 172.21.15.112:0/3423346617 shutdown_connections 2023-09-12T16:07:52.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.742+0000 7f0c213ff700 1 -- 172.21.15.112:0/3423346617 wait complete. 2023-09-12T16:07:52.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.744+0000 7f0c213ff700 1 Processor -- start 2023-09-12T16:07:52.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.744+0000 7f0c213ff700 1 -- start start 2023-09-12T16:07:52.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.745+0000 7f0c213ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c1c0cfdb0 0x7f0c1c15a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:52.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.745+0000 7f0c213ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c1c15bca0 0x7f0c1c0c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:52.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.745+0000 7f0c213ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c1c0c7cf0 0x7f0c1c0c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:52.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.745+0000 7f0c213ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c0c86e0 con 0x7f0c1c0cfdb0 2023-09-12T16:07:52.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.745+0000 7f0c213ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c0cbd20 con 0x7f0c1c15bca0 2023-09-12T16:07:52.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.745+0000 7f0c213ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c1e53d0 con 0x7f0c1c0c7cf0 2023-09-12T16:07:52.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.745+0000 7f0c1affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c1c0cfdb0 0x7f0c1c15a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:52.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.745+0000 7f0c1affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c1c0cfdb0 0x7f0c1c15a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45770/0 (socket says 172.21.15.112:45770) 2023-09-12T16:07:52.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.745+0000 7f0c1affd700 1 -- 172.21.15.112:0/2650692234 learned_addr learned my addr 172.21.15.112:0/2650692234 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:52.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.745+0000 7f0c1b7fe700 1 --2- 172.21.15.112:0/2650692234 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c1c0c7cf0 0x7f0c1c0c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:52.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.745+0000 7f0c1a7fc700 1 --2- 172.21.15.112:0/2650692234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c1c15bca0 0x7f0c1c0c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:52.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.745+0000 7f0c1affd700 1 -- 172.21.15.112:0/2650692234 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c1c0c7cf0 msgr2=0x7f0c1c0c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:52.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.745+0000 7f0c1affd700 1 --2- 172.21.15.112:0/2650692234 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c1c0c7cf0 0x7f0c1c0c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.745+0000 7f0c1affd700 1 -- 172.21.15.112:0/2650692234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c1c15bca0 msgr2=0x7f0c1c0c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:52.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.745+0000 7f0c1affd700 1 --2- 172.21.15.112:0/2650692234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c1c15bca0 0x7f0c1c0c58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.745+0000 7f0c1affd700 1 -- 172.21.15.112:0/2650692234 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c100095f0 con 0x7f0c1c0cfdb0 2023-09-12T16:07:52.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.745+0000 7f0c1a7fc700 1 --2- 172.21.15.112:0/2650692234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c1c15bca0 0x7f0c1c0c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:52.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.746+0000 7f0c1affd700 1 --2- 172.21.15.112:0/2650692234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c1c0cfdb0 0x7f0c1c15a460 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c00d980 tx=0x7f0c0c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:52.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.746+0000 7f0c037fe700 1 -- 172.21.15.112:0/2650692234 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c009b40 con 0x7f0c1c0cfdb0 2023-09-12T16:07:52.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.746+0000 7f0c037fe700 1 -- 172.21.15.112:0/2650692234 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0c0c009d90 con 0x7f0c1c0cfdb0 2023-09-12T16:07:52.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.746+0000 7f0c037fe700 1 -- 172.21.15.112:0/2650692234 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c0106c0 con 0x7f0c1c0cfdb0 2023-09-12T16:07:52.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.746+0000 7f0c213ff700 1 -- 172.21.15.112:0/2650692234 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c1c1e56b0 con 0x7f0c1c0cfdb0 2023-09-12T16:07:52.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.746+0000 7f0c213ff700 1 -- 172.21.15.112:0/2650692234 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c1c1e5c70 con 0x7f0c1c0cfdb0 2023-09-12T16:07:52.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.747+0000 7f0c213ff700 1 -- 172.21.15.112:0/2650692234 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c1c1e5e30 con 0x7f0c1c0cfdb0 2023-09-12T16:07:52.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.748+0000 7f0c037fe700 1 -- 172.21.15.112:0/2650692234 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f0c0c010820 con 0x7f0c1c0cfdb0 2023-09-12T16:07:52.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.749+0000 7f0c037fe700 1 --2- 172.21.15.112:0/2650692234 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f0c0806a580 0x7f0c0806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:52.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.749+0000 7f0c037fe700 1 -- 172.21.15.112:0/2650692234 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f0c0c0891d0 con 0x7f0c1c0cfdb0 2023-09-12T16:07:52.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.749+0000 7f0c1a7fc700 1 --2- 172.21.15.112:0/2650692234 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f0c0806a580 0x7f0c0806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:52.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.750+0000 7f0c1a7fc700 1 --2- 172.21.15.112:0/2650692234 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f0c0806a580 0x7f0c0806ca40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c06c620 tx=0x7f0c100047c0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:52.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.753+0000 7f0c037fe700 1 -- 172.21.15.112:0/2650692234 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f0c0c054360 con 0x7f0c1c0cfdb0 2023-09-12T16:07:52.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.952+0000 7f0c213ff700 1 -- 172.21.15.112:0/2650692234 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0c1c073ea0 con 0x7f0c1c0cfdb0 2023-09-12T16:07:52.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.952+0000 7f0c037fe700 1 -- 172.21.15.112:0/2650692234 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0c0c057980 con 0x7f0c1c0cfdb0 2023-09-12T16:07:52.953 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:07:52.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.955+0000 7f0c213ff700 1 -- 172.21.15.112:0/2650692234 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f0c0806a580 msgr2=0x7f0c0806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:52.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.955+0000 7f0c213ff700 1 --2- 172.21.15.112:0/2650692234 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f0c0806a580 0x7f0c0806ca40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c06c620 tx=0x7f0c100047c0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.955+0000 7f0c213ff700 1 -- 172.21.15.112:0/2650692234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c1c0cfdb0 msgr2=0x7f0c1c15a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:52.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.955+0000 7f0c213ff700 1 --2- 172.21.15.112:0/2650692234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c1c0cfdb0 0x7f0c1c15a460 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c00d980 tx=0x7f0c0c00dd40 comp rx=0 tx=0).stop 2023-09-12T16:07:52.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.955+0000 7f0c213ff700 1 -- 172.21.15.112:0/2650692234 shutdown_connections 2023-09-12T16:07:52.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.955+0000 7f0c213ff700 1 --2- 172.21.15.112:0/2650692234 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f0c0806a580 0x7f0c0806ca40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.955+0000 7f0c213ff700 1 --2- 172.21.15.112:0/2650692234 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c1c0c7cf0 0x7f0c1c0c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.955+0000 7f0c213ff700 1 --2- 172.21.15.112:0/2650692234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c1c0cfdb0 0x7f0c1c15a460 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.955+0000 7f0c213ff700 1 --2- 172.21.15.112:0/2650692234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c1c15bca0 0x7f0c1c0c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:52.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.955+0000 7f0c213ff700 1 -- 172.21.15.112:0/2650692234 >> 172.21.15.112:0/2650692234 conn(0x7f0c1c0d17d0 msgr2=0x7f0c1c15ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:52.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.955+0000 7f0c213ff700 1 -- 172.21.15.112:0/2650692234 shutdown_connections 2023-09-12T16:07:52.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:52.955+0000 7f0c213ff700 1 -- 172.21.15.112:0/2650692234 wait complete. 2023-09-12T16:07:52.973 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-12T16:07:53.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.176+0000 7ff4f13ff700 1 -- 172.21.15.112:0/1081008345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4ec0d16a0 msgr2=0x7ff4ec0d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:53.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.176+0000 7ff4f13ff700 1 --2- 172.21.15.112:0/1081008345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4ec0d16a0 0x7ff4ec0d1a80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0cf080 tx=0x7ff4dc009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:53.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.176+0000 7ff4f13ff700 1 -- 172.21.15.112:0/1081008345 shutdown_connections 2023-09-12T16:07:53.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.176+0000 7ff4f13ff700 1 --2- 172.21.15.112:0/1081008345 >> v2:172.21.15.144:3300/0 conn(0x7ff4ec0b3190 0x7ff4ec0b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:53.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.176+0000 7ff4f13ff700 1 --2- 172.21.15.112:0/1081008345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4ec0d16a0 0x7ff4ec0d1a80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:53.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.176+0000 7ff4f13ff700 1 --2- 172.21.15.112:0/1081008345 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4ec0cc050 0x7ff4ec0cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:53.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.176+0000 7ff4f13ff700 1 -- 172.21.15.112:0/1081008345 >> 172.21.15.112:0/1081008345 conn(0x7ff4ec071b70 msgr2=0x7ff4ec071f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:53.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.176+0000 7ff4f13ff700 1 -- 172.21.15.112:0/1081008345 shutdown_connections 2023-09-12T16:07:53.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.176+0000 7ff4f13ff700 1 -- 172.21.15.112:0/1081008345 wait complete. 2023-09-12T16:07:53.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.178+0000 7ff4f13ff700 1 Processor -- start 2023-09-12T16:07:53.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.178+0000 7ff4f13ff700 1 -- start start 2023-09-12T16:07:53.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.179+0000 7ff4f13ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4ec0b3190 0x7ff4ec15ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:53.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.179+0000 7ff4f13ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4ec0cc050 0x7ff4ec0cab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:53.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.179+0000 7ff4f13ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4ec0d16a0 0x7ff4ec14cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:53.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.179+0000 7ff4f13ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec14c7a0 con 0x7ff4ec0b3190 2023-09-12T16:07:53.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.179+0000 7ff4f13ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec14bb90 con 0x7ff4ec0d16a0 2023-09-12T16:07:53.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.179+0000 7ff4f13ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec14be70 con 0x7ff4ec0cc050 2023-09-12T16:07:53.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.179+0000 7ff4eaffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4ec0b3190 0x7ff4ec15ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:53.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.179+0000 7ff4eaffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4ec0b3190 0x7ff4ec15ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45788/0 (socket says 172.21.15.112:45788) 2023-09-12T16:07:53.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.179+0000 7ff4eaffd700 1 -- 172.21.15.112:0/565199273 learned_addr learned my addr 172.21.15.112:0/565199273 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:53.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.179+0000 7ff4eb7fe700 1 --2- 172.21.15.112:0/565199273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4ec0d16a0 0x7ff4ec14cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:53.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.179+0000 7ff4ea7fc700 1 --2- 172.21.15.112:0/565199273 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4ec0cc050 0x7ff4ec0cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:53.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.180+0000 7ff4eaffd700 1 -- 172.21.15.112:0/565199273 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4ec0cc050 msgr2=0x7ff4ec0cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:53.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.180+0000 7ff4eaffd700 1 --2- 172.21.15.112:0/565199273 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4ec0cc050 0x7ff4ec0cab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:53.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.180+0000 7ff4eaffd700 1 -- 172.21.15.112:0/565199273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4ec0d16a0 msgr2=0x7ff4ec14cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:53.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.180+0000 7ff4eaffd700 1 --2- 172.21.15.112:0/565199273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4ec0d16a0 0x7ff4ec14cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:53.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.180+0000 7ff4eaffd700 1 -- 172.21.15.112:0/565199273 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4dc0095f0 con 0x7ff4ec0b3190 2023-09-12T16:07:53.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.180+0000 7ff4eaffd700 1 --2- 172.21.15.112:0/565199273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4ec0b3190 0x7ff4ec15ea60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0d2560 tx=0x7ff4dc004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:53.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.180+0000 7ff4d37fe700 1 -- 172.21.15.112:0/565199273 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc01c070 con 0x7ff4ec0b3190 2023-09-12T16:07:53.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.180+0000 7ff4d37fe700 1 -- 172.21.15.112:0/565199273 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff4dc00b7b0 con 0x7ff4ec0b3190 2023-09-12T16:07:53.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.180+0000 7ff4f13ff700 1 -- 172.21.15.112:0/565199273 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4ec14c150 con 0x7ff4ec0b3190 2023-09-12T16:07:53.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.180+0000 7ff4d37fe700 1 -- 172.21.15.112:0/565199273 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0045f0 con 0x7ff4ec0b3190 2023-09-12T16:07:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.180+0000 7ff4f13ff700 1 -- 172.21.15.112:0/565199273 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ec0cb0c0 con 0x7ff4ec0b3190 2023-09-12T16:07:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.181+0000 7ff4f13ff700 1 -- 172.21.15.112:0/565199273 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ec14ca80 con 0x7ff4ec0b3190 2023-09-12T16:07:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.182+0000 7ff4d37fe700 1 -- 172.21.15.112:0/565199273 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ff4dc00bb40 con 0x7ff4ec0b3190 2023-09-12T16:07:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.183+0000 7ff4d37fe700 1 --2- 172.21.15.112:0/565199273 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff4d806a580 0x7ff4d806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.183+0000 7ff4d37fe700 1 -- 172.21.15.112:0/565199273 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff4dc08a210 con 0x7ff4ec0b3190 2023-09-12T16:07:53.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.184+0000 7ff4ea7fc700 1 --2- 172.21.15.112:0/565199273 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff4d806a580 0x7ff4d806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:53.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.184+0000 7ff4ea7fc700 1 --2- 172.21.15.112:0/565199273 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff4d806a580 0x7ff4d806ca40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0b6a20 tx=0x7ff4e0009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:53.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.188+0000 7ff4d37fe700 1 -- 172.21.15.112:0/565199273 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff4dc055310 con 0x7ff4ec0b3190 2023-09-12T16:07:53.275 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:07:53.280 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:07:53.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.396+0000 7ff4f13ff700 1 -- 172.21.15.112:0/565199273 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff4ec04eb50 con 0x7ff4ec0b3190 2023-09-12T16:07:53.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.396+0000 7ff4d37fe700 1 -- 172.21.15.112:0/565199273 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff4dc058930 con 0x7ff4ec0b3190 2023-09-12T16:07:53.396 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-09-12T16:07:53.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.399+0000 7ff4f13ff700 1 -- 172.21.15.112:0/565199273 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff4d806a580 msgr2=0x7ff4d806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:53.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.399+0000 7ff4f13ff700 1 --2- 172.21.15.112:0/565199273 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff4d806a580 0x7ff4d806ca40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0b6a20 tx=0x7ff4e0009260 comp rx=0 tx=0).stop 2023-09-12T16:07:53.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.399+0000 7ff4f13ff700 1 -- 172.21.15.112:0/565199273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4ec0b3190 msgr2=0x7ff4ec15ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:53.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.399+0000 7ff4f13ff700 1 --2- 172.21.15.112:0/565199273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4ec0b3190 0x7ff4ec15ea60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0d2560 tx=0x7ff4dc004260 comp rx=0 tx=0).stop 2023-09-12T16:07:53.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.399+0000 7ff4f13ff700 1 -- 172.21.15.112:0/565199273 shutdown_connections 2023-09-12T16:07:53.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.399+0000 7ff4f13ff700 1 --2- 172.21.15.112:0/565199273 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff4d806a580 0x7ff4d806ca40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:53.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.399+0000 7ff4f13ff700 1 --2- 172.21.15.112:0/565199273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4ec0d16a0 0x7ff4ec14cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:53.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.399+0000 7ff4f13ff700 1 --2- 172.21.15.112:0/565199273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4ec0b3190 0x7ff4ec15ea60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:53.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.399+0000 7ff4f13ff700 1 --2- 172.21.15.112:0/565199273 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4ec0cc050 0x7ff4ec0cab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:53.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.399+0000 7ff4f13ff700 1 -- 172.21.15.112:0/565199273 >> 172.21.15.112:0/565199273 conn(0x7ff4ec071b70 msgr2=0x7ff4ec071f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:53.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.399+0000 7ff4f13ff700 1 -- 172.21.15.112:0/565199273 shutdown_connections 2023-09-12T16:07:53.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.399+0000 7ff4f13ff700 1 -- 172.21.15.112:0/565199273 wait complete. 2023-09-12T16:07:53.418 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-12T16:07:53.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.659+0000 7efd757ff700 1 -- 172.21.15.112:0/159269091 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd7015f9b0 msgr2=0x7efd700b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:53.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.659+0000 7efd757ff700 1 --2- 172.21.15.112:0/159269091 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd7015f9b0 0x7efd700b54e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efd68009fd0 tx=0x7efd6800b380 comp rx=0 tx=0).stop 2023-09-12T16:07:53.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.659+0000 7efd757ff700 1 -- 172.21.15.112:0/159269091 shutdown_connections 2023-09-12T16:07:53.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.659+0000 7efd757ff700 1 --2- 172.21.15.112:0/159269091 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd7015f9b0 0x7efd700b54e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:53.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.659+0000 7efd757ff700 1 -- 172.21.15.112:0/159269091 >> 172.21.15.112:0/159269091 conn(0x7efd7009aa90 msgr2=0x7efd700d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:53.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.660+0000 7efd757ff700 1 -- 172.21.15.112:0/159269091 shutdown_connections 2023-09-12T16:07:53.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.660+0000 7efd757ff700 1 -- 172.21.15.112:0/159269091 wait complete. 2023-09-12T16:07:53.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.661+0000 7efd757ff700 1 Processor -- start 2023-09-12T16:07:53.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.661+0000 7efd757ff700 1 -- start start 2023-09-12T16:07:53.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.662+0000 7efd757ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd7015bb40 0x7efd70158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:53.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.662+0000 7efd757ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd7015f530 0x7efd700c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:53.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.662+0000 7efd757ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd7015f9b0 0x7efd700c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:53.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.662+0000 7efd757ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd700c8250 con 0x7efd7015bb40 2023-09-12T16:07:53.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.662+0000 7efd757ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd700c96d0 con 0x7efd7015f530 2023-09-12T16:07:53.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.662+0000 7efd757ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd70159180 con 0x7efd7015f9b0 2023-09-12T16:07:53.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.662+0000 7efd6effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd7015bb40 0x7efd70158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:53.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.663+0000 7efd6effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd7015bb40 0x7efd70158c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45806/0 (socket says 172.21.15.112:45806) 2023-09-12T16:07:53.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.663+0000 7efd6effd700 1 -- 172.21.15.112:0/43630785 learned_addr learned my addr 172.21.15.112:0/43630785 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:53.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.663+0000 7efd6f7fe700 1 --2- 172.21.15.112:0/43630785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd7015f9b0 0x7efd700c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:53.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.663+0000 7efd67fff700 1 --2- 172.21.15.112:0/43630785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd7015f530 0x7efd700c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:53.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.663+0000 7efd6effd700 1 -- 172.21.15.112:0/43630785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd7015f9b0 msgr2=0x7efd700c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:53.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.663+0000 7efd6effd700 1 --2- 172.21.15.112:0/43630785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd7015f9b0 0x7efd700c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:53.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.663+0000 7efd6effd700 1 -- 172.21.15.112:0/43630785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd7015f530 msgr2=0x7efd700c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:53.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.663+0000 7efd6effd700 1 --2- 172.21.15.112:0/43630785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd7015f530 0x7efd700c77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:53.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.663+0000 7efd6effd700 1 -- 172.21.15.112:0/43630785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd68009d00 con 0x7efd7015bb40 2023-09-12T16:07:53.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.663+0000 7efd6effd700 1 --2- 172.21.15.112:0/43630785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd7015bb40 0x7efd70158c40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efd60001eb0 tx=0x7efd6000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:53.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.663+0000 7efd677fe700 1 -- 172.21.15.112:0/43630785 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd600054e0 con 0x7efd7015bb40 2023-09-12T16:07:53.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.663+0000 7efd677fe700 1 -- 172.21.15.112:0/43630785 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efd60003680 con 0x7efd7015bb40 2023-09-12T16:07:53.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.663+0000 7efd757ff700 1 -- 172.21.15.112:0/43630785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd700c5be0 con 0x7efd7015bb40 2023-09-12T16:07:53.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.663+0000 7efd677fe700 1 -- 172.21.15.112:0/43630785 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60003a50 con 0x7efd7015bb40 2023-09-12T16:07:53.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.664+0000 7efd757ff700 1 -- 172.21.15.112:0/43630785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd700c61a0 con 0x7efd7015bb40 2023-09-12T16:07:53.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.664+0000 7efd757ff700 1 -- 172.21.15.112:0/43630785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd70073ea0 con 0x7efd7015bb40 2023-09-12T16:07:53.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.665+0000 7efd677fe700 1 -- 172.21.15.112:0/43630785 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7efd60003bb0 con 0x7efd7015bb40 2023-09-12T16:07:53.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.666+0000 7efd677fe700 1 --2- 172.21.15.112:0/43630785 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7efd5006a5b0 0x7efd5006ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:53.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.666+0000 7efd677fe700 1 -- 172.21.15.112:0/43630785 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7efd60088410 con 0x7efd7015bb40 2023-09-12T16:07:53.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.667+0000 7efd67fff700 1 --2- 172.21.15.112:0/43630785 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7efd5006a5b0 0x7efd5006ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:53.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.667+0000 7efd67fff700 1 --2- 172.21.15.112:0/43630785 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7efd5006a5b0 0x7efd5006ca70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efd7015dc60 tx=0x7efd58009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:53.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.671+0000 7efd677fe700 1 -- 172.21.15.112:0/43630785 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7efd60053510 con 0x7efd7015bb40 2023-09-12T16:07:53.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.865+0000 7efd757ff700 1 -- 172.21.15.112:0/43630785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efd700b36f0 con 0x7efd7015bb40 2023-09-12T16:07:53.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.866+0000 7efd677fe700 1 -- 172.21.15.112:0/43630785 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7efd60017020 con 0x7efd7015bb40 2023-09-12T16:07:53.866 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:07:53.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.868+0000 7efd757ff700 1 -- 172.21.15.112:0/43630785 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7efd5006a5b0 msgr2=0x7efd5006ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:53.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.868+0000 7efd757ff700 1 --2- 172.21.15.112:0/43630785 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7efd5006a5b0 0x7efd5006ca70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efd7015dc60 tx=0x7efd58009040 comp rx=0 tx=0).stop 2023-09-12T16:07:53.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.868+0000 7efd757ff700 1 -- 172.21.15.112:0/43630785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd7015bb40 msgr2=0x7efd70158c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:53.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.868+0000 7efd757ff700 1 --2- 172.21.15.112:0/43630785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd7015bb40 0x7efd70158c40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efd60001eb0 tx=0x7efd6000c800 comp rx=0 tx=0).stop 2023-09-12T16:07:53.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.868+0000 7efd757ff700 1 -- 172.21.15.112:0/43630785 shutdown_connections 2023-09-12T16:07:53.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.868+0000 7efd757ff700 1 --2- 172.21.15.112:0/43630785 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7efd5006a5b0 0x7efd5006ca70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:53.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.868+0000 7efd757ff700 1 --2- 172.21.15.112:0/43630785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd7015f9b0 0x7efd700c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:53.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.868+0000 7efd757ff700 1 --2- 172.21.15.112:0/43630785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd7015bb40 0x7efd70158c40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:53.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.868+0000 7efd757ff700 1 --2- 172.21.15.112:0/43630785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd7015f530 0x7efd700c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:53.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.868+0000 7efd757ff700 1 -- 172.21.15.112:0/43630785 >> 172.21.15.112:0/43630785 conn(0x7efd7009aa90 msgr2=0x7efd7006b300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:53.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.868+0000 7efd757ff700 1 -- 172.21.15.112:0/43630785 shutdown_connections 2023-09-12T16:07:53.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:53.868+0000 7efd757ff700 1 -- 172.21.15.112:0/43630785 wait complete. 2023-09-12T16:07:53.886 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:07:54.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.086+0000 7f6c5ddff700 1 -- 172.21.15.112:0/605056882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580d05d0 msgr2=0x7f6c58165930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:54.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.086+0000 7f6c5ddff700 1 --2- 172.21.15.112:0/605056882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580d05d0 0x7f6c58165930 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6c5809f880 tx=0x7f6c5000b380 comp rx=0 tx=0).stop 2023-09-12T16:07:54.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.086+0000 7f6c5ddff700 1 -- 172.21.15.112:0/605056882 shutdown_connections 2023-09-12T16:07:54.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.086+0000 7f6c5ddff700 1 --2- 172.21.15.112:0/605056882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580d05d0 0x7f6c58165930 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.086+0000 7f6c5ddff700 1 --2- 172.21.15.112:0/605056882 >> v2:172.21.15.144:3300/0 conn(0x7f6c5815ba80 0x7f6c580cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.086+0000 7f6c5ddff700 1 -- 172.21.15.112:0/605056882 >> 172.21.15.112:0/605056882 conn(0x7f6c58088ff0 msgr2=0x7f6c580d1900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:54.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.086+0000 7f6c5ddff700 1 -- 172.21.15.112:0/605056882 shutdown_connections 2023-09-12T16:07:54.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.086+0000 7f6c5ddff700 1 -- 172.21.15.112:0/605056882 wait complete. 2023-09-12T16:07:54.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.088+0000 7f6c5ddff700 1 Processor -- start 2023-09-12T16:07:54.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.088+0000 7f6c5ddff700 1 -- start start 2023-09-12T16:07:54.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.089+0000 7f6c5ddff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c580cfa10 0x7f6c58156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:54.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.089+0000 7f6c5ddff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580d05d0 0x7f6c58154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:54.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.089+0000 7f6c5ddff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c5815ba80 0x7f6c58154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:54.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.089+0000 7f6c5ddff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c58156110 con 0x7f6c580d05d0 2023-09-12T16:07:54.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.089+0000 7f6c5ddff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c58155260 con 0x7f6c580cfa10 2023-09-12T16:07:54.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.089+0000 7f6c5ddff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c58155490 con 0x7f6c5815ba80 2023-09-12T16:07:54.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.089+0000 7f6c56ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580d05d0 0x7f6c58154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:54.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.089+0000 7f6c56ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580d05d0 0x7f6c58154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45818/0 (socket says 172.21.15.112:45818) 2023-09-12T16:07:54.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.089+0000 7f6c56ffd700 1 -- 172.21.15.112:0/1533043447 learned_addr learned my addr 172.21.15.112:0/1533043447 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:54.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.089+0000 7f6c57fff700 1 --2- 172.21.15.112:0/1533043447 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c5815ba80 0x7f6c58154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:54.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.089+0000 7f6c577fe700 1 --2- 172.21.15.112:0/1533043447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c580cfa10 0x7f6c58156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:54.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.090+0000 7f6c56ffd700 1 -- 172.21.15.112:0/1533043447 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c5815ba80 msgr2=0x7f6c58154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:54.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.090+0000 7f6c56ffd700 1 --2- 172.21.15.112:0/1533043447 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c5815ba80 0x7f6c58154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.090+0000 7f6c56ffd700 1 -- 172.21.15.112:0/1533043447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c580cfa10 msgr2=0x7f6c58156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:54.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.090+0000 7f6c56ffd700 1 --2- 172.21.15.112:0/1533043447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c580cfa10 0x7f6c58156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.090+0000 7f6c56ffd700 1 -- 172.21.15.112:0/1533043447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c50009d00 con 0x7f6c580d05d0 2023-09-12T16:07:54.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.090+0000 7f6c56ffd700 1 --2- 172.21.15.112:0/1533043447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580d05d0 0x7f6c58154690 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c00c4e0 tx=0x7f6c4c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:54.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.090+0000 7f6c3ffff700 1 -- 172.21.15.112:0/1533043447 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0052d0 con 0x7f6c580d05d0 2023-09-12T16:07:54.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.090+0000 7f6c3ffff700 1 -- 172.21.15.112:0/1533043447 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6c4c005520 con 0x7f6c580d05d0 2023-09-12T16:07:54.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.090+0000 7f6c5ddff700 1 -- 172.21.15.112:0/1533043447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c58155770 con 0x7f6c580d05d0 2023-09-12T16:07:54.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.090+0000 7f6c3ffff700 1 -- 172.21.15.112:0/1533043447 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0038e0 con 0x7f6c580d05d0 2023-09-12T16:07:54.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.090+0000 7f6c5ddff700 1 -- 172.21.15.112:0/1533043447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c58155d30 con 0x7f6c580d05d0 2023-09-12T16:07:54.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.091+0000 7f6c5ddff700 1 -- 172.21.15.112:0/1533043447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c5804e300 con 0x7f6c580d05d0 2023-09-12T16:07:54.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.092+0000 7f6c3ffff700 1 -- 172.21.15.112:0/1533043447 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f6c4c003a40 con 0x7f6c580d05d0 2023-09-12T16:07:54.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.093+0000 7f6c3ffff700 1 --2- 172.21.15.112:0/1533043447 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6c4406a580 0x7f6c4406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:54.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.093+0000 7f6c3ffff700 1 -- 172.21.15.112:0/1533043447 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f6c4c088550 con 0x7f6c580d05d0 2023-09-12T16:07:54.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.093+0000 7f6c577fe700 1 --2- 172.21.15.112:0/1533043447 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6c4406a580 0x7f6c4406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:54.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.094+0000 7f6c577fe700 1 --2- 172.21.15.112:0/1533043447 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6c4406a580 0x7f6c4406ca40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6c48009870 tx=0x7f6c48008040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:54.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.098+0000 7f6c3ffff700 1 -- 172.21.15.112:0/1533043447 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6c4c053650 con 0x7f6c580d05d0 2023-09-12T16:07:54.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.297+0000 7f6c5ddff700 1 -- 172.21.15.112:0/1533043447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c580d2760 con 0x7f6c580d05d0 2023-09-12T16:07:54.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.298+0000 7f6c3ffff700 1 -- 172.21.15.112:0/1533043447 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18816 (secure 0 0 0) 0x7f6c4c056c70 con 0x7f6c580d05d0 2023-09-12T16:07:54.298 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:54.299 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:44.445226+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:07:54.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.300+0000 7f6c5ddff700 1 -- 172.21.15.112:0/1533043447 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6c4406a580 msgr2=0x7f6c4406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:54.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.300+0000 7f6c5ddff700 1 --2- 172.21.15.112:0/1533043447 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6c4406a580 0x7f6c4406ca40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6c48009870 tx=0x7f6c48008040 comp rx=0 tx=0).stop 2023-09-12T16:07:54.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.300+0000 7f6c5ddff700 1 -- 172.21.15.112:0/1533043447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580d05d0 msgr2=0x7f6c58154690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:54.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.300+0000 7f6c5ddff700 1 --2- 172.21.15.112:0/1533043447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580d05d0 0x7f6c58154690 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c00c4e0 tx=0x7f6c4c00c7f0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.301+0000 7f6c5ddff700 1 -- 172.21.15.112:0/1533043447 shutdown_connections 2023-09-12T16:07:54.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.301+0000 7f6c5ddff700 1 --2- 172.21.15.112:0/1533043447 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6c4406a580 0x7f6c4406ca40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.301+0000 7f6c5ddff700 1 --2- 172.21.15.112:0/1533043447 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c5815ba80 0x7f6c58154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.301+0000 7f6c5ddff700 1 --2- 172.21.15.112:0/1533043447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c580cfa10 0x7f6c58156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.301+0000 7f6c5ddff700 1 --2- 172.21.15.112:0/1533043447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580d05d0 0x7f6c58154690 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.301+0000 7f6c5ddff700 1 -- 172.21.15.112:0/1533043447 >> 172.21.15.112:0/1533043447 conn(0x7f6c58088ff0 msgr2=0x7f6c580ae530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:54.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.301+0000 7f6c5ddff700 1 -- 172.21.15.112:0/1533043447 shutdown_connections 2023-09-12T16:07:54.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.301+0000 7f6c5ddff700 1 -- 172.21.15.112:0/1533043447 wait complete. 2023-09-12T16:07:54.319 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-12T16:06:48.871680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-12T16:06:58.137223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-12T16:06:58.684034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-12T16:07:02.283459+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-12T16:07:54.320 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-12T16:07:54.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.523+0000 7fbb8abff700 1 -- 172.21.15.112:0/2151224988 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb840cfdb0 msgr2=0x7fbb840d0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:54.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.523+0000 7fbb8abff700 1 --2- 172.21.15.112:0/2151224988 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb840cfdb0 0x7fbb840d0220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c009f60 tx=0x7fbb7c009f90 comp rx=0 tx=0).stop 2023-09-12T16:07:54.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.523+0000 7fbb8abff700 1 -- 172.21.15.112:0/2151224988 shutdown_connections 2023-09-12T16:07:54.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.523+0000 7fbb8abff700 1 --2- 172.21.15.112:0/2151224988 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb840cfdb0 0x7fbb840d0220 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.523+0000 7fbb8abff700 1 --2- 172.21.15.112:0/2151224988 >> v2:172.21.15.144:3300/0 conn(0x7fbb8415bca0 0x7fbb8415cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.523+0000 7fbb8abff700 1 -- 172.21.15.112:0/2151224988 >> 172.21.15.112:0/2151224988 conn(0x7fbb840d17d0 msgr2=0x7fbb840d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:54.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.523+0000 7fbb8abff700 1 -- 172.21.15.112:0/2151224988 shutdown_connections 2023-09-12T16:07:54.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.523+0000 7fbb8abff700 1 -- 172.21.15.112:0/2151224988 wait complete. 2023-09-12T16:07:54.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.525+0000 7fbb8abff700 1 Processor -- start 2023-09-12T16:07:54.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.525+0000 7fbb8abff700 1 -- start start 2023-09-12T16:07:54.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.526+0000 7fbb8abff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb840cfdb0 0x7fbb841591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:54.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.526+0000 7fbb8abff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb8415bca0 0x7fbb840c5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:54.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.526+0000 7fbb8abff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb840ca8d0 0x7fbb840af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:54.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.526+0000 7fbb8abff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb841596e0 con 0x7fbb840ca8d0 2023-09-12T16:07:54.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.526+0000 7fbb8abff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb840c5b30 con 0x7fbb8415bca0 2023-09-12T16:07:54.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.526+0000 7fbb8abff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb840c5e10 con 0x7fbb840cfdb0 2023-09-12T16:07:54.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.526+0000 7fbb8919c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb840ca8d0 0x7fbb840af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:54.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.526+0000 7fbb8919c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb840ca8d0 0x7fbb840af3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45822/0 (socket says 172.21.15.112:45822) 2023-09-12T16:07:54.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.526+0000 7fbb8919c700 1 -- 172.21.15.112:0/3565973577 learned_addr learned my addr 172.21.15.112:0/3565973577 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:54.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.526+0000 7fbb83fff700 1 --2- 172.21.15.112:0/3565973577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb8415bca0 0x7fbb840c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:54.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.526+0000 7fbb8899b700 1 --2- 172.21.15.112:0/3565973577 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb840cfdb0 0x7fbb841591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:54.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.527+0000 7fbb8919c700 1 -- 172.21.15.112:0/3565973577 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb840cfdb0 msgr2=0x7fbb841591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:54.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.527+0000 7fbb8919c700 1 --2- 172.21.15.112:0/3565973577 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb840cfdb0 0x7fbb841591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.527+0000 7fbb8919c700 1 -- 172.21.15.112:0/3565973577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb8415bca0 msgr2=0x7fbb840c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:54.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.527+0000 7fbb8919c700 1 --2- 172.21.15.112:0/3565973577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb8415bca0 0x7fbb840c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.527+0000 7fbb8919c700 1 -- 172.21.15.112:0/3565973577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb780095f0 con 0x7fbb840ca8d0 2023-09-12T16:07:54.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.527+0000 7fbb8919c700 1 --2- 172.21.15.112:0/3565973577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb840ca8d0 0x7fbb840af3f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c00b610 tx=0x7fbb7c007aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:54.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.527+0000 7fbb817fa700 1 -- 172.21.15.112:0/3565973577 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c00e040 con 0x7fbb840ca8d0 2023-09-12T16:07:54.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.527+0000 7fbb817fa700 1 -- 172.21.15.112:0/3565973577 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbb7c01d680 con 0x7fbb840ca8d0 2023-09-12T16:07:54.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.527+0000 7fbb817fa700 1 -- 172.21.15.112:0/3565973577 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c01da70 con 0x7fbb840ca8d0 2023-09-12T16:07:54.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.527+0000 7fbb8abff700 1 -- 172.21.15.112:0/3565973577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb7c009c40 con 0x7fbb840ca8d0 2023-09-12T16:07:54.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.527+0000 7fbb8abff700 1 -- 172.21.15.112:0/3565973577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb840c63d0 con 0x7fbb840ca8d0 2023-09-12T16:07:54.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.528+0000 7fbb8abff700 1 -- 172.21.15.112:0/3565973577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb84073ea0 con 0x7fbb840ca8d0 2023-09-12T16:07:54.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.529+0000 7fbb817fa700 1 -- 172.21.15.112:0/3565973577 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fbb7c01dbd0 con 0x7fbb840ca8d0 2023-09-12T16:07:54.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.531+0000 7fbb817fa700 1 --2- 172.21.15.112:0/3565973577 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbb6806a5b0 0x7fbb6806ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:54.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.531+0000 7fbb817fa700 1 -- 172.21.15.112:0/3565973577 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fbb7c08a9b0 con 0x7fbb840ca8d0 2023-09-12T16:07:54.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.531+0000 7fbb8899b700 1 --2- 172.21.15.112:0/3565973577 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbb6806a5b0 0x7fbb6806ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:54.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.531+0000 7fbb8899b700 1 --2- 172.21.15.112:0/3565973577 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbb6806a5b0 0x7fbb6806ca70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbb78005fd0 tx=0x7fbb78009310 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:54.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.535+0000 7fbb817fa700 1 -- 172.21.15.112:0/3565973577 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fbb7c055b50 con 0x7fbb840ca8d0 2023-09-12T16:07:54.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.733+0000 7fbb8abff700 1 -- 172.21.15.112:0/3565973577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbb8408b860 con 0x7fbb840ca8d0 2023-09-12T16:07:54.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.733+0000 7fbb817fa700 1 -- 172.21.15.112:0/3565973577 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb7c021020 con 0x7fbb840ca8d0 2023-09-12T16:07:54.734 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-09-12T16:07:54.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.736+0000 7fbb8abff700 1 -- 172.21.15.112:0/3565973577 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbb6806a5b0 msgr2=0x7fbb6806ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:54.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.736+0000 7fbb8abff700 1 --2- 172.21.15.112:0/3565973577 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbb6806a5b0 0x7fbb6806ca70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbb78005fd0 tx=0x7fbb78009310 comp rx=0 tx=0).stop 2023-09-12T16:07:54.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.736+0000 7fbb8abff700 1 -- 172.21.15.112:0/3565973577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb840ca8d0 msgr2=0x7fbb840af3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:54.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.736+0000 7fbb8abff700 1 --2- 172.21.15.112:0/3565973577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb840ca8d0 0x7fbb840af3f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c00b610 tx=0x7fbb7c007aa0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.736+0000 7fbb8abff700 1 -- 172.21.15.112:0/3565973577 shutdown_connections 2023-09-12T16:07:54.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.736+0000 7fbb8abff700 1 --2- 172.21.15.112:0/3565973577 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbb6806a5b0 0x7fbb6806ca70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.736+0000 7fbb8abff700 1 --2- 172.21.15.112:0/3565973577 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb840cfdb0 0x7fbb841591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.736+0000 7fbb8abff700 1 --2- 172.21.15.112:0/3565973577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb840ca8d0 0x7fbb840af3f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.736+0000 7fbb8abff700 1 --2- 172.21.15.112:0/3565973577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb8415bca0 0x7fbb840c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.736+0000 7fbb8abff700 1 -- 172.21.15.112:0/3565973577 >> 172.21.15.112:0/3565973577 conn(0x7fbb840d17d0 msgr2=0x7fbb8415af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:54.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.736+0000 7fbb8abff700 1 -- 172.21.15.112:0/3565973577 shutdown_connections 2023-09-12T16:07:54.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.736+0000 7fbb8abff700 1 -- 172.21.15.112:0/3565973577 wait complete. 2023-09-12T16:07:54.754 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-12T16:07:54.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.956+0000 7fc1de3ff700 1 -- 172.21.15.112:0/829696531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d815efd0 msgr2=0x7fc1d80d21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:54.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.956+0000 7fc1de3ff700 1 --2- 172.21.15.112:0/829696531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d815efd0 0x7fc1d80d21c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80d17d0 tx=0x7fc1c800b380 comp rx=0 tx=0).stop 2023-09-12T16:07:54.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.956+0000 7fc1de3ff700 1 -- 172.21.15.112:0/829696531 shutdown_connections 2023-09-12T16:07:54.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.956+0000 7fc1de3ff700 1 --2- 172.21.15.112:0/829696531 >> v2:172.21.15.144:3300/0 conn(0x7fc1d80ce650 0x7fc1d80cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.956+0000 7fc1de3ff700 1 --2- 172.21.15.112:0/829696531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d815efd0 0x7fc1d80d21c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.956+0000 7fc1de3ff700 1 --2- 172.21.15.112:0/829696531 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1d80b0a60 0x7fc1d80ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.956+0000 7fc1de3ff700 1 -- 172.21.15.112:0/829696531 >> 172.21.15.112:0/829696531 conn(0x7fc1d809aa90 msgr2=0x7fc1d80d1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:54.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.956+0000 7fc1de3ff700 1 -- 172.21.15.112:0/829696531 shutdown_connections 2023-09-12T16:07:54.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.956+0000 7fc1de3ff700 1 -- 172.21.15.112:0/829696531 wait complete. 2023-09-12T16:07:54.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.958+0000 7fc1de3ff700 1 Processor -- start 2023-09-12T16:07:54.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.958+0000 7fc1de3ff700 1 -- start start 2023-09-12T16:07:54.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.959+0000 7fc1de3ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1d80b0a60 0x7fc1d80cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:54.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.959+0000 7fc1de3ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d80ce650 0x7fc1d81f1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:54.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.959+0000 7fc1de3ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1d815efd0 0x7fc1d8144c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:54.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.959+0000 7fc1de3ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d80c9df0 con 0x7fc1d80ce650 2023-09-12T16:07:54.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.959+0000 7fc1de3ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d80ca0d0 con 0x7fc1d815efd0 2023-09-12T16:07:54.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.959+0000 7fc1de3ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d80ca3b0 con 0x7fc1d80b0a60 2023-09-12T16:07:54.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.959+0000 7fc1cf7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d80ce650 0x7fc1d81f1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:54.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.959+0000 7fc1cf7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d80ce650 0x7fc1d81f1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45838/0 (socket says 172.21.15.112:45838) 2023-09-12T16:07:54.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.959+0000 7fc1cf7fe700 1 -- 172.21.15.112:0/2403347156 learned_addr learned my addr 172.21.15.112:0/2403347156 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:54.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.959+0000 7fc1d7fff700 1 --2- 172.21.15.112:0/2403347156 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1d80b0a60 0x7fc1d80cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:54.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.960+0000 7fc1dc99c700 1 --2- 172.21.15.112:0/2403347156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1d815efd0 0x7fc1d8144c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:54.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.960+0000 7fc1cf7fe700 1 -- 172.21.15.112:0/2403347156 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1d80b0a60 msgr2=0x7fc1d80cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:54.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.960+0000 7fc1cf7fe700 1 --2- 172.21.15.112:0/2403347156 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1d80b0a60 0x7fc1d80cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.960+0000 7fc1cf7fe700 1 -- 172.21.15.112:0/2403347156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1d815efd0 msgr2=0x7fc1d8144c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:54.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.960+0000 7fc1cf7fe700 1 --2- 172.21.15.112:0/2403347156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1d815efd0 0x7fc1d8144c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:54.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.960+0000 7fc1cf7fe700 1 -- 172.21.15.112:0/2403347156 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c8009d00 con 0x7fc1d80ce650 2023-09-12T16:07:54.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.960+0000 7fc1cf7fe700 1 --2- 172.21.15.112:0/2403347156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d80ce650 0x7fc1d81f1320 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000d980 tx=0x7fc1c000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:54.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.960+0000 7fc1d57fa700 1 -- 172.21.15.112:0/2403347156 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0009930 con 0x7fc1d80ce650 2023-09-12T16:07:54.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.960+0000 7fc1d57fa700 1 -- 172.21.15.112:0/2403347156 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc1c0009b80 con 0x7fc1d80ce650 2023-09-12T16:07:54.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.960+0000 7fc1d57fa700 1 -- 172.21.15.112:0/2403347156 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0010460 con 0x7fc1d80ce650 2023-09-12T16:07:54.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.960+0000 7fc1de3ff700 1 -- 172.21.15.112:0/2403347156 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d80ca690 con 0x7fc1d80ce650 2023-09-12T16:07:54.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.960+0000 7fc1de3ff700 1 -- 172.21.15.112:0/2403347156 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d8157f50 con 0x7fc1d80ce650 2023-09-12T16:07:54.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.961+0000 7fc1de3ff700 1 -- 172.21.15.112:0/2403347156 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d80cabb0 con 0x7fc1d80ce650 2023-09-12T16:07:54.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.962+0000 7fc1d57fa700 1 -- 172.21.15.112:0/2403347156 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fc1c00105c0 con 0x7fc1d80ce650 2023-09-12T16:07:54.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.963+0000 7fc1d57fa700 1 --2- 172.21.15.112:0/2403347156 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc1b806a580 0x7fc1b806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:54.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.963+0000 7fc1d57fa700 1 -- 172.21.15.112:0/2403347156 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc1c0089080 con 0x7fc1d80ce650 2023-09-12T16:07:54.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.963+0000 7fc1d7fff700 1 --2- 172.21.15.112:0/2403347156 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc1b806a580 0x7fc1b806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:54.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.964+0000 7fc1d7fff700 1 --2- 172.21.15.112:0/2403347156 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc1b806a580 0x7fc1b806ca40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8000f80 tx=0x7fc1c8014040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:54.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:54.968+0000 7fc1d57fa700 1 -- 172.21.15.112:0/2403347156 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fc1c00bb9b0 con 0x7fc1d80ce650 2023-09-12T16:07:55.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.163+0000 7fc1de3ff700 1 -- 172.21.15.112:0/2403347156 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc1d8073ea0 con 0x7fc1d80ce650 2023-09-12T16:07:55.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.163+0000 7fc1d57fa700 1 -- 172.21.15.112:0/2403347156 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc1d80cabb0 con 0x7fc1d80ce650 2023-09-12T16:07:55.164 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:07:55.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.166+0000 7fc1de3ff700 1 -- 172.21.15.112:0/2403347156 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc1b806a580 msgr2=0x7fc1b806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:55.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.166+0000 7fc1de3ff700 1 --2- 172.21.15.112:0/2403347156 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc1b806a580 0x7fc1b806ca40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8000f80 tx=0x7fc1c8014040 comp rx=0 tx=0).stop 2023-09-12T16:07:55.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.166+0000 7fc1de3ff700 1 -- 172.21.15.112:0/2403347156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d80ce650 msgr2=0x7fc1d81f1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:55.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.166+0000 7fc1de3ff700 1 --2- 172.21.15.112:0/2403347156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d80ce650 0x7fc1d81f1320 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000d980 tx=0x7fc1c000dc90 comp rx=0 tx=0).stop 2023-09-12T16:07:55.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.166+0000 7fc1de3ff700 1 -- 172.21.15.112:0/2403347156 shutdown_connections 2023-09-12T16:07:55.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.166+0000 7fc1de3ff700 1 --2- 172.21.15.112:0/2403347156 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc1b806a580 0x7fc1b806ca40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:55.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.166+0000 7fc1de3ff700 1 --2- 172.21.15.112:0/2403347156 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1d80b0a60 0x7fc1d80cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:55.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.166+0000 7fc1de3ff700 1 --2- 172.21.15.112:0/2403347156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1d815efd0 0x7fc1d8144c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:55.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.166+0000 7fc1de3ff700 1 --2- 172.21.15.112:0/2403347156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d80ce650 0x7fc1d81f1320 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:55.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.166+0000 7fc1de3ff700 1 -- 172.21.15.112:0/2403347156 >> 172.21.15.112:0/2403347156 conn(0x7fc1d809aa90 msgr2=0x7fc1d80b4930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:55.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.166+0000 7fc1de3ff700 1 -- 172.21.15.112:0/2403347156 shutdown_connections 2023-09-12T16:07:55.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.166+0000 7fc1de3ff700 1 -- 172.21.15.112:0/2403347156 wait complete. 2023-09-12T16:07:55.184 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-12T16:07:55.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.387+0000 7fe7195ff700 1 -- 172.21.15.112:0/3167537795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe71415f530 msgr2=0x7fe71415f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:55.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.387+0000 7fe7195ff700 1 --2- 172.21.15.112:0/3167537795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe71415f530 0x7fe71415f9b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe714072710 tx=0x7fe6fc009ba0 comp rx=0 tx=0).stop 2023-09-12T16:07:55.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.388+0000 7fe7195ff700 1 -- 172.21.15.112:0/3167537795 shutdown_connections 2023-09-12T16:07:55.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.388+0000 7fe7195ff700 1 --2- 172.21.15.112:0/3167537795 >> v2:172.21.15.144:3300/0 conn(0x7fe7140b4dd0 0x7fe7140b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:55.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.388+0000 7fe7195ff700 1 --2- 172.21.15.112:0/3167537795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe71415f530 0x7fe71415f9b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:55.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.388+0000 7fe7195ff700 1 -- 172.21.15.112:0/3167537795 >> 172.21.15.112:0/3167537795 conn(0x7fe71409aa90 msgr2=0x7fe7140d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:55.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.388+0000 7fe7195ff700 1 -- 172.21.15.112:0/3167537795 shutdown_connections 2023-09-12T16:07:55.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.388+0000 7fe7195ff700 1 -- 172.21.15.112:0/3167537795 wait complete. 2023-09-12T16:07:55.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.389+0000 7fe7195ff700 1 Processor -- start 2023-09-12T16:07:55.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.389+0000 7fe7195ff700 1 -- start start 2023-09-12T16:07:55.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.390+0000 7fe7195ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7140b4dd0 0x7fe71415a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:55.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.390+0000 7fe7195ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe71415bb40 0x7fe7141e6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:55.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.390+0000 7fe7195ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe71415f530 0x7fe7140c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:55.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.390+0000 7fe7195ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71415aef0 con 0x7fe7140b4dd0 2023-09-12T16:07:55.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.390+0000 7fe7195ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7141e83d0 con 0x7fe71415bb40 2023-09-12T16:07:55.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.390+0000 7fe7195ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7141e7dc0 con 0x7fe71415f530 2023-09-12T16:07:55.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.391+0000 7fe712ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7140b4dd0 0x7fe71415a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:55.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.391+0000 7fe712ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7140b4dd0 0x7fe71415a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45858/0 (socket says 172.21.15.112:45858) 2023-09-12T16:07:55.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.391+0000 7fe712ffd700 1 -- 172.21.15.112:0/1240054983 learned_addr learned my addr 172.21.15.112:0/1240054983 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:55.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.391+0000 7fe70bfff700 1 --2- 172.21.15.112:0/1240054983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe71415bb40 0x7fe7141e6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:55.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.391+0000 7fe7137fe700 1 --2- 172.21.15.112:0/1240054983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe71415f530 0x7fe7140c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:55.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.391+0000 7fe712ffd700 1 -- 172.21.15.112:0/1240054983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe71415f530 msgr2=0x7fe7140c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:55.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.391+0000 7fe712ffd700 1 --2- 172.21.15.112:0/1240054983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe71415f530 0x7fe7140c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:55.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.391+0000 7fe712ffd700 1 -- 172.21.15.112:0/1240054983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe71415bb40 msgr2=0x7fe7141e6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:55.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.391+0000 7fe712ffd700 1 --2- 172.21.15.112:0/1240054983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe71415bb40 0x7fe7141e6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:55.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.391+0000 7fe712ffd700 1 -- 172.21.15.112:0/1240054983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc009520 con 0x7fe7140b4dd0 2023-09-12T16:07:55.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.391+0000 7fe712ffd700 1 --2- 172.21.15.112:0/1240054983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7140b4dd0 0x7fe71415a0e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe70400c750 tx=0x7fe70400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:55.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.391+0000 7fe70b7fe700 1 -- 172.21.15.112:0/1240054983 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7040054e0 con 0x7fe7140b4dd0 2023-09-12T16:07:55.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.392+0000 7fe70b7fe700 1 -- 172.21.15.112:0/1240054983 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe704003680 con 0x7fe7140b4dd0 2023-09-12T16:07:55.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.392+0000 7fe70b7fe700 1 -- 172.21.15.112:0/1240054983 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe704003a90 con 0x7fe7140b4dd0 2023-09-12T16:07:55.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.392+0000 7fe7195ff700 1 -- 172.21.15.112:0/1240054983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7140cfe40 con 0x7fe7140b4dd0 2023-09-12T16:07:55.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.392+0000 7fe7195ff700 1 -- 172.21.15.112:0/1240054983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7141e8060 con 0x7fe7140b4dd0 2023-09-12T16:07:55.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.393+0000 7fe7195ff700 1 -- 172.21.15.112:0/1240054983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe714073ea0 con 0x7fe7140b4dd0 2023-09-12T16:07:55.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.394+0000 7fe70b7fe700 1 -- 172.21.15.112:0/1240054983 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe704003bf0 con 0x7fe7140b4dd0 2023-09-12T16:07:55.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.395+0000 7fe70b7fe700 1 --2- 172.21.15.112:0/1240054983 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe6f406a580 0x7fe6f406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:55.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.395+0000 7fe70b7fe700 1 -- 172.21.15.112:0/1240054983 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe704088540 con 0x7fe7140b4dd0 2023-09-12T16:07:55.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.395+0000 7fe70bfff700 1 --2- 172.21.15.112:0/1240054983 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe6f406a580 0x7fe6f406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:55.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.396+0000 7fe70bfff700 1 --2- 172.21.15.112:0/1240054983 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe6f406a580 0x7fe6f406ca40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc009fd0 tx=0x7fe6fc0047c0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:55.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.399+0000 7fe70b7fe700 1 -- 172.21.15.112:0/1240054983 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe7040536e0 con 0x7fe7140b4dd0 2023-09-12T16:07:55.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.598+0000 7fe7195ff700 1 -- 172.21.15.112:0/1240054983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe7140d25b0 con 0x7fe7140b4dd0 2023-09-12T16:07:55.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.598+0000 7fe70b7fe700 1 -- 172.21.15.112:0/1240054983 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe704056d00 con 0x7fe7140b4dd0 2023-09-12T16:07:55.599 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-09-12T16:07:55.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.600+0000 7fe7195ff700 1 -- 172.21.15.112:0/1240054983 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe6f406a580 msgr2=0x7fe6f406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:55.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.600+0000 7fe7195ff700 1 --2- 172.21.15.112:0/1240054983 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe6f406a580 0x7fe6f406ca40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc009fd0 tx=0x7fe6fc0047c0 comp rx=0 tx=0).stop 2023-09-12T16:07:55.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.600+0000 7fe7195ff700 1 -- 172.21.15.112:0/1240054983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7140b4dd0 msgr2=0x7fe71415a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:55.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.600+0000 7fe7195ff700 1 --2- 172.21.15.112:0/1240054983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7140b4dd0 0x7fe71415a0e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe70400c750 tx=0x7fe70400cb10 comp rx=0 tx=0).stop 2023-09-12T16:07:55.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.600+0000 7fe7195ff700 1 -- 172.21.15.112:0/1240054983 shutdown_connections 2023-09-12T16:07:55.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.600+0000 7fe7195ff700 1 --2- 172.21.15.112:0/1240054983 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe6f406a580 0x7fe6f406ca40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:55.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.600+0000 7fe7195ff700 1 --2- 172.21.15.112:0/1240054983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe71415f530 0x7fe7140c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:55.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.600+0000 7fe7195ff700 1 --2- 172.21.15.112:0/1240054983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7140b4dd0 0x7fe71415a0e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:55.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.600+0000 7fe7195ff700 1 --2- 172.21.15.112:0/1240054983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe71415bb40 0x7fe7141e6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:55.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.600+0000 7fe7195ff700 1 -- 172.21.15.112:0/1240054983 >> 172.21.15.112:0/1240054983 conn(0x7fe71409aa90 msgr2=0x7fe7140d1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:55.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.601+0000 7fe7195ff700 1 -- 172.21.15.112:0/1240054983 shutdown_connections 2023-09-12T16:07:55.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.601+0000 7fe7195ff700 1 -- 172.21.15.112:0/1240054983 wait complete. 2023-09-12T16:07:55.619 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-12T16:07:55.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.819+0000 7f21db9ff700 1 -- 172.21.15.112:0/2408154307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21c0004850 msgr2=0x7f21c0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:55.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.819+0000 7f21db9ff700 1 --2- 172.21.15.112:0/2408154307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21c0004850 0x7f21c0004cd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f21c40016f0 tx=0x7f21c0005880 comp rx=0 tx=0).stop 2023-09-12T16:07:55.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.819+0000 7f21d9f9c700 1 -- 172.21.15.112:0/2408154307 reap_dead start 2023-09-12T16:07:55.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.819+0000 7f21db9ff700 1 -- 172.21.15.112:0/2408154307 shutdown_connections 2023-09-12T16:07:55.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.819+0000 7f21db9ff700 1 -- 172.21.15.112:0/2408154307 >> 172.21.15.112:0/2408154307 conn(0x7f21d40d17d0 msgr2=0x7f21d40d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:55.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.819+0000 7f21db9ff700 1 -- 172.21.15.112:0/2408154307 shutdown_connections 2023-09-12T16:07:55.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.819+0000 7f21db9ff700 1 -- 172.21.15.112:0/2408154307 wait complete. 2023-09-12T16:07:55.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.821+0000 7f21db9ff700 1 Processor -- start 2023-09-12T16:07:55.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.821+0000 7f21db9ff700 1 -- start start 2023-09-12T16:07:55.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.822+0000 7f21db9ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c0004850 0x7f21d40c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:55.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.822+0000 7f21db9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21d40c88a0 0x7f21d414ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:55.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.822+0000 7f21db9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21d406bf50 0x7f21d406c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:55.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.822+0000 7f21db9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d406c910 con 0x7f21d406bf50 2023-09-12T16:07:55.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.822+0000 7f21db9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d40c9eb0 con 0x7f21d40c88a0 2023-09-12T16:07:55.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.822+0000 7f21db9ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d40c6250 con 0x7f21c0004850 2023-09-12T16:07:55.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.822+0000 7f21d9f9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21d406bf50 0x7f21d406c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:55.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.822+0000 7f21d9f9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21d406bf50 0x7f21d406c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45868/0 (socket says 172.21.15.112:45868) 2023-09-12T16:07:55.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.822+0000 7f21d9f9c700 1 -- 172.21.15.112:0/1164295273 learned_addr learned my addr 172.21.15.112:0/1164295273 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:55.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.822+0000 7f21d979b700 1 --2- 172.21.15.112:0/1164295273 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c0004850 0x7f21d40c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:55.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.822+0000 7f21d8f9a700 1 --2- 172.21.15.112:0/1164295273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21d40c88a0 0x7f21d414ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:55.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.823+0000 7f21d9f9c700 1 -- 172.21.15.112:0/1164295273 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c0004850 msgr2=0x7f21d40c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:55.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.823+0000 7f21d9f9c700 1 --2- 172.21.15.112:0/1164295273 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c0004850 0x7f21d40c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:55.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.823+0000 7f21d9f9c700 1 -- 172.21.15.112:0/1164295273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21d40c88a0 msgr2=0x7f21d414ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:55.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.823+0000 7f21d9f9c700 1 --2- 172.21.15.112:0/1164295273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21d40c88a0 0x7f21d414ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:55.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.823+0000 7f21d9f9c700 1 -- 172.21.15.112:0/1164295273 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d414d1f0 con 0x7f21d406bf50 2023-09-12T16:07:55.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.823+0000 7f21d9f9c700 1 --2- 172.21.15.112:0/1164295273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21d406bf50 0x7f21d406c3d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f21d408bf50 tx=0x7f21cc0065e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:55.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.823+0000 7f21c9ffb700 1 -- 172.21.15.112:0/1164295273 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21cc011840 con 0x7f21d406bf50 2023-09-12T16:07:55.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.823+0000 7f21c9ffb700 1 -- 172.21.15.112:0/1164295273 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f21cc0119e0 con 0x7f21d406bf50 2023-09-12T16:07:55.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.823+0000 7f21db9ff700 1 -- 172.21.15.112:0/1164295273 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d40c8e10 con 0x7f21d406bf50 2023-09-12T16:07:55.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.823+0000 7f21c9ffb700 1 -- 172.21.15.112:0/1164295273 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21cc011df0 con 0x7f21d406bf50 2023-09-12T16:07:55.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.823+0000 7f21db9ff700 1 -- 172.21.15.112:0/1164295273 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d40c93d0 con 0x7f21d406bf50 2023-09-12T16:07:55.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.825+0000 7f21db9ff700 1 -- 172.21.15.112:0/1164295273 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d4073ea0 con 0x7f21d406bf50 2023-09-12T16:07:55.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.825+0000 7f21c9ffb700 1 -- 172.21.15.112:0/1164295273 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f21cc01d460 con 0x7f21d406bf50 2023-09-12T16:07:55.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.826+0000 7f21c9ffb700 1 --2- 172.21.15.112:0/1164295273 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f21b806a580 0x7f21b806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:55.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.826+0000 7f21c9ffb700 1 -- 172.21.15.112:0/1164295273 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f21cc089960 con 0x7f21d406bf50 2023-09-12T16:07:55.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.826+0000 7f21d979b700 1 --2- 172.21.15.112:0/1164295273 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f21b806a580 0x7f21b806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:55.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.827+0000 7f21d979b700 1 --2- 172.21.15.112:0/1164295273 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f21b806a580 0x7f21b806ca40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009c60 tx=0x7f21d0009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:55.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:55.830+0000 7f21c9ffb700 1 -- 172.21.15.112:0/1164295273 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f21cc054b00 con 0x7f21d406bf50 2023-09-12T16:07:56.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.029+0000 7f21db9ff700 1 -- 172.21.15.112:0/1164295273 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f21d408b860 con 0x7f21d406bf50 2023-09-12T16:07:56.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.029+0000 7f21c9ffb700 1 -- 172.21.15.112:0/1164295273 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f21cc058120 con 0x7f21d406bf50 2023-09-12T16:07:56.031 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:07:56.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.032+0000 7f21db9ff700 1 -- 172.21.15.112:0/1164295273 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f21b806a580 msgr2=0x7f21b806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:56.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.032+0000 7f21db9ff700 1 --2- 172.21.15.112:0/1164295273 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f21b806a580 0x7f21b806ca40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009c60 tx=0x7f21d0009260 comp rx=0 tx=0).stop 2023-09-12T16:07:56.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.032+0000 7f21db9ff700 1 -- 172.21.15.112:0/1164295273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21d406bf50 msgr2=0x7f21d406c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:56.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.032+0000 7f21db9ff700 1 --2- 172.21.15.112:0/1164295273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21d406bf50 0x7f21d406c3d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f21d408bf50 tx=0x7f21cc0065e0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.032+0000 7f21db9ff700 1 -- 172.21.15.112:0/1164295273 shutdown_connections 2023-09-12T16:07:56.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.032+0000 7f21db9ff700 1 --2- 172.21.15.112:0/1164295273 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f21b806a580 0x7f21b806ca40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.032+0000 7f21db9ff700 1 --2- 172.21.15.112:0/1164295273 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c0004850 0x7f21d40c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.032+0000 7f21db9ff700 1 --2- 172.21.15.112:0/1164295273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21d406bf50 0x7f21d406c3d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.032+0000 7f21db9ff700 1 --2- 172.21.15.112:0/1164295273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21d40c88a0 0x7f21d414ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.032+0000 7f21db9ff700 1 -- 172.21.15.112:0/1164295273 >> 172.21.15.112:0/1164295273 conn(0x7f21d40d17d0 msgr2=0x7f21d40afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:56.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.032+0000 7f21db9ff700 1 -- 172.21.15.112:0/1164295273 shutdown_connections 2023-09-12T16:07:56.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.032+0000 7f21db9ff700 1 -- 172.21.15.112:0/1164295273 wait complete. 2023-09-12T16:07:56.051 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:07:56.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.250+0000 7f7a12bff700 1 -- 172.21.15.112:0/3332610369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a0c15f480 msgr2=0x7f7a0c0cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:56.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.250+0000 7f7a12bff700 1 --2- 172.21.15.112:0/3332610369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a0c15f480 0x7f7a0c0cfe80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009970 tx=0x7f7a00009c80 comp rx=0 tx=0).stop 2023-09-12T16:07:56.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.250+0000 7f7a12bff700 1 -- 172.21.15.112:0/3332610369 shutdown_connections 2023-09-12T16:07:56.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.250+0000 7f7a12bff700 1 --2- 172.21.15.112:0/3332610369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a0c15f480 0x7f7a0c0cfe80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.250+0000 7f7a12bff700 1 --2- 172.21.15.112:0/3332610369 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a0c0cdfb0 0x7f7a0c0d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.250+0000 7f7a12bff700 1 -- 172.21.15.112:0/3332610369 >> 172.21.15.112:0/3332610369 conn(0x7f7a0c0d1930 msgr2=0x7f7a0c0d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:56.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.250+0000 7f7a12bff700 1 -- 172.21.15.112:0/3332610369 shutdown_connections 2023-09-12T16:07:56.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.251+0000 7f7a12bff700 1 -- 172.21.15.112:0/3332610369 wait complete. 2023-09-12T16:07:56.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.253+0000 7f7a12bff700 1 Processor -- start 2023-09-12T16:07:56.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.253+0000 7f7a12bff700 1 -- start start 2023-09-12T16:07:56.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.254+0000 7f7a12bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a0c0b28f0 0x7f7a0c1f2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:56.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.254+0000 7f7a12bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a0c0cdfb0 0x7f7a0c15aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:56.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.254+0000 7f7a12bff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a0c15f480 0x7f7a0c0aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:56.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.254+0000 7f7a12bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c1f2550 con 0x7f7a0c0b28f0 2023-09-12T16:07:56.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.254+0000 7f7a12bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c1f3010 con 0x7f7a0c0cdfb0 2023-09-12T16:07:56.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.254+0000 7f7a12bff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c15b0e0 con 0x7f7a0c15f480 2023-09-12T16:07:56.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.254+0000 7f7a1099b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a0c0b28f0 0x7f7a0c1f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:56.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.255+0000 7f7a1099b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a0c0b28f0 0x7f7a0c1f2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53786/0 (socket says 172.21.15.112:53786) 2023-09-12T16:07:56.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.255+0000 7f7a1099b700 1 -- 172.21.15.112:0/1280613843 learned_addr learned my addr 172.21.15.112:0/1280613843 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:56.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.255+0000 7f7a1119c700 1 --2- 172.21.15.112:0/1280613843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a0c15f480 0x7f7a0c0aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:56.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.255+0000 7f7a0bfff700 1 --2- 172.21.15.112:0/1280613843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a0c0cdfb0 0x7f7a0c15aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:56.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.255+0000 7f7a1099b700 1 -- 172.21.15.112:0/1280613843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a0c15f480 msgr2=0x7f7a0c0aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:56.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.255+0000 7f7a1099b700 1 --2- 172.21.15.112:0/1280613843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a0c15f480 0x7f7a0c0aecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.255+0000 7f7a1099b700 1 -- 172.21.15.112:0/1280613843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a0c0cdfb0 msgr2=0x7f7a0c15aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:56.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.255+0000 7f7a1099b700 1 --2- 172.21.15.112:0/1280613843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a0c0cdfb0 0x7f7a0c15aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.255+0000 7f7a1099b700 1 -- 172.21.15.112:0/1280613843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a00009580 con 0x7f7a0c0b28f0 2023-09-12T16:07:56.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.255+0000 7f7a0bfff700 1 --2- 172.21.15.112:0/1280613843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a0c0cdfb0 0x7f7a0c15aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:56.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.255+0000 7f7a1119c700 1 --2- 172.21.15.112:0/1280613843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a0c15f480 0x7f7a0c0aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:56.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.255+0000 7f7a1099b700 1 --2- 172.21.15.112:0/1280613843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a0c0b28f0 0x7f7a0c1f2010 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c08b1f0 tx=0x7f7a000050f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:56.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.255+0000 7f7a097fa700 1 -- 172.21.15.112:0/1280613843 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0001e070 con 0x7f7a0c0b28f0 2023-09-12T16:07:56.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.255+0000 7f7a097fa700 1 -- 172.21.15.112:0/1280613843 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7a0000b7f0 con 0x7f7a0c0b28f0 2023-09-12T16:07:56.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.255+0000 7f7a12bff700 1 -- 172.21.15.112:0/1280613843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a0c0af210 con 0x7f7a0c0b28f0 2023-09-12T16:07:56.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.255+0000 7f7a097fa700 1 -- 172.21.15.112:0/1280613843 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0000bc00 con 0x7f7a0c0b28f0 2023-09-12T16:07:56.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.256+0000 7f7a12bff700 1 -- 172.21.15.112:0/1280613843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a0c1f2a50 con 0x7f7a0c0b28f0 2023-09-12T16:07:56.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.257+0000 7f7a12bff700 1 -- 172.21.15.112:0/1280613843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a0c04e300 con 0x7f7a0c0b28f0 2023-09-12T16:07:56.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.257+0000 7f7a097fa700 1 -- 172.21.15.112:0/1280613843 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f7a0000bd60 con 0x7f7a0c0b28f0 2023-09-12T16:07:56.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.258+0000 7f7a097fa700 1 --2- 172.21.15.112:0/1280613843 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f79f006a580 0x7f79f006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:56.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.259+0000 7f7a097fa700 1 -- 172.21.15.112:0/1280613843 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f7a0008a310 con 0x7f7a0c0b28f0 2023-09-12T16:07:56.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.259+0000 7f7a0bfff700 1 --2- 172.21.15.112:0/1280613843 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f79f006a580 0x7f79f006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:56.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.259+0000 7f7a0bfff700 1 --2- 172.21.15.112:0/1280613843 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f79f006a580 0x7f79f006ca40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f79f8009be0 tx=0x7f79f8009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:56.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.262+0000 7f7a097fa700 1 -- 172.21.15.112:0/1280613843 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f7a000554a0 con 0x7f7a0c0b28f0 2023-09-12T16:07:56.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.461+0000 7f7a12bff700 1 -- 172.21.15.112:0/1280613843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a0c0b3ba0 con 0x7f7a0c0b28f0 2023-09-12T16:07:56.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.462+0000 7f7a097fa700 1 -- 172.21.15.112:0/1280613843 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18816 (secure 0 0 0) 0x7f7a00058ac0 con 0x7f7a0c0b28f0 2023-09-12T16:07:56.464 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:56.464 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:44.445226+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:07:56.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.464+0000 7f7a12bff700 1 -- 172.21.15.112:0/1280613843 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f79f006a580 msgr2=0x7f79f006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:56.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.464+0000 7f7a12bff700 1 --2- 172.21.15.112:0/1280613843 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f79f006a580 0x7f79f006ca40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f79f8009be0 tx=0x7f79f8009260 comp rx=0 tx=0).stop 2023-09-12T16:07:56.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.464+0000 7f7a12bff700 1 -- 172.21.15.112:0/1280613843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a0c0b28f0 msgr2=0x7f7a0c1f2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:56.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.464+0000 7f7a12bff700 1 --2- 172.21.15.112:0/1280613843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a0c0b28f0 0x7f7a0c1f2010 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c08b1f0 tx=0x7f7a000050f0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.465+0000 7f7a12bff700 1 -- 172.21.15.112:0/1280613843 shutdown_connections 2023-09-12T16:07:56.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.465+0000 7f7a12bff700 1 --2- 172.21.15.112:0/1280613843 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f79f006a580 0x7f79f006ca40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.465+0000 7f7a12bff700 1 --2- 172.21.15.112:0/1280613843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a0c15f480 0x7f7a0c0aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.465+0000 7f7a12bff700 1 --2- 172.21.15.112:0/1280613843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a0c0b28f0 0x7f7a0c1f2010 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.465+0000 7f7a12bff700 1 --2- 172.21.15.112:0/1280613843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a0c0cdfb0 0x7f7a0c15aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.465+0000 7f7a12bff700 1 -- 172.21.15.112:0/1280613843 >> 172.21.15.112:0/1280613843 conn(0x7f7a0c0d1930 msgr2=0x7f7a0c06cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:56.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.465+0000 7f7a12bff700 1 -- 172.21.15.112:0/1280613843 shutdown_connections 2023-09-12T16:07:56.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.465+0000 7f7a12bff700 1 -- 172.21.15.112:0/1280613843 wait complete. 2023-09-12T16:07:56.486 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-12T16:06:48.871680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-12T16:06:58.137223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-12T16:06:58.684034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-12T16:07:02.283459+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-12T16:07:56.487 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-12T16:07:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.689+0000 7f5d07bff700 1 -- 172.21.15.112:0/1655027753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d000cf5b0 msgr2=0x7f5d000cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:56.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.689+0000 7f5d07bff700 1 --2- 172.21.15.112:0/1655027753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d000cf5b0 0x7f5d000cebc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00098c0 tx=0x7f5cf0009bd0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.689+0000 7f5d07bff700 1 -- 172.21.15.112:0/1655027753 shutdown_connections 2023-09-12T16:07:56.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.689+0000 7f5d07bff700 1 --2- 172.21.15.112:0/1655027753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d000cf5b0 0x7f5d000cebc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.689+0000 7f5d07bff700 1 -- 172.21.15.112:0/1655027753 >> 172.21.15.112:0/1655027753 conn(0x7f5d000d17d0 msgr2=0x7f5d000d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:56.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.689+0000 7f5d07bff700 1 -- 172.21.15.112:0/1655027753 shutdown_connections 2023-09-12T16:07:56.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.689+0000 7f5d07bff700 1 -- 172.21.15.112:0/1655027753 wait complete. 2023-09-12T16:07:56.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.691+0000 7f5d07bff700 1 Processor -- start 2023-09-12T16:07:56.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.691+0000 7f5d07bff700 1 -- start start 2023-09-12T16:07:56.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.692+0000 7f5d07bff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d000cfdb0 0x7f5d001572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:56.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.692+0000 7f5d07bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d0015bca0 0x7f5d000c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:56.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.692+0000 7f5d07bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d00157800 0x7f5d000c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:56.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.692+0000 7f5d07bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000cb4d0 con 0x7f5d0015bca0 2023-09-12T16:07:56.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.692+0000 7f5d07bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000ca920 con 0x7f5d00157800 2023-09-12T16:07:56.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.692+0000 7f5d07bff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000cac00 con 0x7f5d000cfdb0 2023-09-12T16:07:56.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.692+0000 7f5d0519a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d0015bca0 0x7f5d000c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:56.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.692+0000 7f5d0519a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d0015bca0 0x7f5d000c9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53818/0 (socket says 172.21.15.112:53818) 2023-09-12T16:07:56.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.692+0000 7f5d0519a700 1 -- 172.21.15.112:0/746333549 learned_addr learned my addr 172.21.15.112:0/746333549 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:56.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.692+0000 7f5d0519a700 1 -- 172.21.15.112:0/746333549 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d000cfdb0 msgr2=0x7f5d001572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:56.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.692+0000 7f5d0519a700 1 --2- 172.21.15.112:0/746333549 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d000cfdb0 0x7f5d001572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.692+0000 7f5d0519a700 1 -- 172.21.15.112:0/746333549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d00157800 msgr2=0x7f5d000c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:56.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.692+0000 7f5d0519a700 1 --2- 172.21.15.112:0/746333549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d00157800 0x7f5d000c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.692+0000 7f5d0519a700 1 -- 172.21.15.112:0/746333549 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf0009520 con 0x7f5d0015bca0 2023-09-12T16:07:56.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.692+0000 7f5d0519a700 1 --2- 172.21.15.112:0/746333549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d0015bca0 0x7f5d000c9690 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0000c00 tx=0x7f5cf000f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:56.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.693+0000 7f5cf67fc700 1 -- 172.21.15.112:0/746333549 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0025070 con 0x7f5d0015bca0 2023-09-12T16:07:56.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.693+0000 7f5cf67fc700 1 -- 172.21.15.112:0/746333549 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5cf000fc70 con 0x7f5d0015bca0 2023-09-12T16:07:56.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.693+0000 7f5cf67fc700 1 -- 172.21.15.112:0/746333549 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf001b040 con 0x7f5d0015bca0 2023-09-12T16:07:56.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.693+0000 7f5d07bff700 1 -- 172.21.15.112:0/746333549 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d000cb160 con 0x7f5d0015bca0 2023-09-12T16:07:56.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.693+0000 7f5d07bff700 1 -- 172.21.15.112:0/746333549 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d000b2520 con 0x7f5d0015bca0 2023-09-12T16:07:56.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.694+0000 7f5d07bff700 1 -- 172.21.15.112:0/746333549 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d000cadc0 con 0x7f5d0015bca0 2023-09-12T16:07:56.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.695+0000 7f5cf67fc700 1 -- 172.21.15.112:0/746333549 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f5cf0004a90 con 0x7f5d0015bca0 2023-09-12T16:07:56.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.696+0000 7f5cf67fc700 1 --2- 172.21.15.112:0/746333549 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5ce406a580 0x7f5ce406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:56.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.696+0000 7f5cf67fc700 1 -- 172.21.15.112:0/746333549 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5cf008ac30 con 0x7f5d0015bca0 2023-09-12T16:07:56.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.696+0000 7f5d0599b700 1 --2- 172.21.15.112:0/746333549 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5ce406a580 0x7f5ce406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:56.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.696+0000 7f5d0599b700 1 --2- 172.21.15.112:0/746333549 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5ce406a580 0x7f5ce406ca40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0015d0 tx=0x7f5cfc0079b0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:56.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.700+0000 7f5cf67fc700 1 -- 172.21.15.112:0/746333549 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5cf0055ee0 con 0x7f5d0015bca0 2023-09-12T16:07:56.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.898+0000 7f5d07bff700 1 -- 172.21.15.112:0/746333549 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5d000ca760 con 0x7f5d0015bca0 2023-09-12T16:07:56.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.899+0000 7f5cf67fc700 1 -- 172.21.15.112:0/746333549 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5cf0059500 con 0x7f5d0015bca0 2023-09-12T16:07:56.900 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-09-12T16:07:56.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.901+0000 7f5d07bff700 1 -- 172.21.15.112:0/746333549 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5ce406a580 msgr2=0x7f5ce406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:56.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.901+0000 7f5d07bff700 1 --2- 172.21.15.112:0/746333549 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5ce406a580 0x7f5ce406ca40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0015d0 tx=0x7f5cfc0079b0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.901+0000 7f5d07bff700 1 -- 172.21.15.112:0/746333549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d0015bca0 msgr2=0x7f5d000c9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:56.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.901+0000 7f5d07bff700 1 --2- 172.21.15.112:0/746333549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d0015bca0 0x7f5d000c9690 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0000c00 tx=0x7f5cf000f7c0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.901+0000 7f5d07bff700 1 -- 172.21.15.112:0/746333549 shutdown_connections 2023-09-12T16:07:56.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.901+0000 7f5d07bff700 1 --2- 172.21.15.112:0/746333549 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5ce406a580 0x7f5ce406ca40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.901+0000 7f5d07bff700 1 --2- 172.21.15.112:0/746333549 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d000cfdb0 0x7f5d001572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.901+0000 7f5d07bff700 1 --2- 172.21.15.112:0/746333549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d00157800 0x7f5d000c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.901+0000 7f5d07bff700 1 --2- 172.21.15.112:0/746333549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d0015bca0 0x7f5d000c9690 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:56.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.901+0000 7f5d07bff700 1 -- 172.21.15.112:0/746333549 >> 172.21.15.112:0/746333549 conn(0x7f5d000d17d0 msgr2=0x7f5d0015ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:56.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.901+0000 7f5d07bff700 1 -- 172.21.15.112:0/746333549 shutdown_connections 2023-09-12T16:07:56.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:56.901+0000 7f5d07bff700 1 -- 172.21.15.112:0/746333549 wait complete. 2023-09-12T16:07:56.921 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-12T16:07:57.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.121+0000 7f4a823ff700 1 -- 172.21.15.112:0/447780033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a7c15bca0 msgr2=0x7f4a7c15cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:57.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.121+0000 7f4a823ff700 1 --2- 172.21.15.112:0/447780033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a7c15bca0 0x7f4a7c15cb90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c0cbed0 tx=0x7f4a6c009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:57.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.121+0000 7f4a823ff700 1 -- 172.21.15.112:0/447780033 shutdown_connections 2023-09-12T16:07:57.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.121+0000 7f4a823ff700 1 --2- 172.21.15.112:0/447780033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a7c15bca0 0x7f4a7c15cb90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.121+0000 7f4a823ff700 1 --2- 172.21.15.112:0/447780033 >> v2:172.21.15.144:3300/0 conn(0x7f4a7c0cf5b0 0x7f4a7c0cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.121+0000 7f4a823ff700 1 -- 172.21.15.112:0/447780033 >> 172.21.15.112:0/447780033 conn(0x7f4a7c0d17d0 msgr2=0x7f4a7c0d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:57.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.121+0000 7f4a823ff700 1 -- 172.21.15.112:0/447780033 shutdown_connections 2023-09-12T16:07:57.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.121+0000 7f4a823ff700 1 -- 172.21.15.112:0/447780033 wait complete. 2023-09-12T16:07:57.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.123+0000 7f4a823ff700 1 Processor -- start 2023-09-12T16:07:57.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.123+0000 7f4a823ff700 1 -- start start 2023-09-12T16:07:57.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.124+0000 7f4a823ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a7c0cfdb0 0x7f4a7c158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:57.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.124+0000 7f4a823ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a7c15bca0 0x7f4a7c1f1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:57.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.124+0000 7f4a823ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a7c157470 0x7f4a7c1e6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:57.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.124+0000 7f4a823ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c1f21e0 con 0x7f4a7c0cfdb0 2023-09-12T16:07:57.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.124+0000 7f4a823ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c1579e0 con 0x7f4a7c15bca0 2023-09-12T16:07:57.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.124+0000 7f4a823ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c157cc0 con 0x7f4a7c157470 2023-09-12T16:07:57.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.124+0000 7f4a7bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a7c0cfdb0 0x7f4a7c158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:57.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.124+0000 7f4a7bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a7c0cfdb0 0x7f4a7c158a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53846/0 (socket says 172.21.15.112:53846) 2023-09-12T16:07:57.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.124+0000 7f4a7bfff700 1 -- 172.21.15.112:0/3379786384 learned_addr learned my addr 172.21.15.112:0/3379786384 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:57.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.125+0000 7f4a7b7fe700 1 --2- 172.21.15.112:0/3379786384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a7c15bca0 0x7f4a7c1f1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:57.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.125+0000 7f4a8099c700 1 --2- 172.21.15.112:0/3379786384 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a7c157470 0x7f4a7c1e6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:57.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.125+0000 7f4a7bfff700 1 -- 172.21.15.112:0/3379786384 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a7c157470 msgr2=0x7f4a7c1e6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:57.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.125+0000 7f4a7bfff700 1 --2- 172.21.15.112:0/3379786384 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a7c157470 0x7f4a7c1e6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.125+0000 7f4a7bfff700 1 -- 172.21.15.112:0/3379786384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a7c15bca0 msgr2=0x7f4a7c1f1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:57.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.125+0000 7f4a7bfff700 1 --2- 172.21.15.112:0/3379786384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a7c15bca0 0x7f4a7c1f1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.125+0000 7f4a7bfff700 1 -- 172.21.15.112:0/3379786384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c0095f0 con 0x7f4a7c0cfdb0 2023-09-12T16:07:57.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.125+0000 7f4a8099c700 1 --2- 172.21.15.112:0/3379786384 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a7c157470 0x7f4a7c1e6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:57.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.125+0000 7f4a7bfff700 1 --2- 172.21.15.112:0/3379786384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a7c0cfdb0 0x7f4a7c158a80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0098e0 tx=0x7f4a6c00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:57.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.125+0000 7f4a78ff9700 1 -- 172.21.15.112:0/3379786384 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c01c070 con 0x7f4a7c0cfdb0 2023-09-12T16:07:57.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.125+0000 7f4a78ff9700 1 -- 172.21.15.112:0/3379786384 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4a6c003890 con 0x7f4a7c0cfdb0 2023-09-12T16:07:57.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.125+0000 7f4a78ff9700 1 -- 172.21.15.112:0/3379786384 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c003c60 con 0x7f4a7c0cfdb0 2023-09-12T16:07:57.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.125+0000 7f4a823ff700 1 -- 172.21.15.112:0/3379786384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7c157fa0 con 0x7f4a7c0cfdb0 2023-09-12T16:07:57.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.125+0000 7f4a823ff700 1 -- 172.21.15.112:0/3379786384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7c158560 con 0x7f4a7c0cfdb0 2023-09-12T16:07:57.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.126+0000 7f4a823ff700 1 -- 172.21.15.112:0/3379786384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a7c073ea0 con 0x7f4a7c0cfdb0 2023-09-12T16:07:57.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.127+0000 7f4a78ff9700 1 -- 172.21.15.112:0/3379786384 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f4a6c00f460 con 0x7f4a7c0cfdb0 2023-09-12T16:07:57.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.128+0000 7f4a78ff9700 1 --2- 172.21.15.112:0/3379786384 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f4a6806a580 0x7f4a6806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:57.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.128+0000 7f4a78ff9700 1 -- 172.21.15.112:0/3379786384 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f4a6c08a2c0 con 0x7f4a7c0cfdb0 2023-09-12T16:07:57.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.128+0000 7f4a7b7fe700 1 --2- 172.21.15.112:0/3379786384 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f4a6806a580 0x7f4a6806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:57.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.129+0000 7f4a7b7fe700 1 --2- 172.21.15.112:0/3379786384 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f4a6806a580 0x7f4a6806ca40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4a70005950 tx=0x7f4a700058e0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:57.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.133+0000 7f4a78ff9700 1 -- 172.21.15.112:0/3379786384 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f4a6c055450 con 0x7f4a7c0cfdb0 2023-09-12T16:07:57.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.327+0000 7f4a823ff700 1 -- 172.21.15.112:0/3379786384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4a7c06ce40 con 0x7f4a7c0cfdb0 2023-09-12T16:07:57.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.327+0000 7f4a78ff9700 1 -- 172.21.15.112:0/3379786384 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4a6c058a70 con 0x7f4a7c0cfdb0 2023-09-12T16:07:57.329 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:07:57.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.330+0000 7f4a823ff700 1 -- 172.21.15.112:0/3379786384 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f4a6806a580 msgr2=0x7f4a6806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:57.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.330+0000 7f4a823ff700 1 --2- 172.21.15.112:0/3379786384 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f4a6806a580 0x7f4a6806ca40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4a70005950 tx=0x7f4a700058e0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.330+0000 7f4a823ff700 1 -- 172.21.15.112:0/3379786384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a7c0cfdb0 msgr2=0x7f4a7c158a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:57.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.330+0000 7f4a823ff700 1 --2- 172.21.15.112:0/3379786384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a7c0cfdb0 0x7f4a7c158a80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0098e0 tx=0x7f4a6c00beb0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.330+0000 7f4a823ff700 1 -- 172.21.15.112:0/3379786384 shutdown_connections 2023-09-12T16:07:57.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.330+0000 7f4a823ff700 1 --2- 172.21.15.112:0/3379786384 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f4a6806a580 0x7f4a6806ca40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.330+0000 7f4a823ff700 1 --2- 172.21.15.112:0/3379786384 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a7c157470 0x7f4a7c1e6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.330+0000 7f4a823ff700 1 --2- 172.21.15.112:0/3379786384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a7c0cfdb0 0x7f4a7c158a80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.330+0000 7f4a823ff700 1 --2- 172.21.15.112:0/3379786384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a7c15bca0 0x7f4a7c1f1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.330+0000 7f4a823ff700 1 -- 172.21.15.112:0/3379786384 >> 172.21.15.112:0/3379786384 conn(0x7f4a7c0d17d0 msgr2=0x7f4a7c15af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:57.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.330+0000 7f4a823ff700 1 -- 172.21.15.112:0/3379786384 shutdown_connections 2023-09-12T16:07:57.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.330+0000 7f4a823ff700 1 -- 172.21.15.112:0/3379786384 wait complete. 2023-09-12T16:07:57.349 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-12T16:07:57.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.549+0000 7fbdd07ff700 1 -- 172.21.15.112:0/1251166520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdc80cf5b0 msgr2=0x7fbdc80cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:57.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.549+0000 7fbdd07ff700 1 --2- 172.21.15.112:0/1251166520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdc80cf5b0 0x7fbdc80cebc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8005fd0 tx=0x7fbdb8009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:57.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.550+0000 7fbdd07ff700 1 -- 172.21.15.112:0/1251166520 shutdown_connections 2023-09-12T16:07:57.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.550+0000 7fbdd07ff700 1 --2- 172.21.15.112:0/1251166520 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbdc815bca0 0x7fbdc815cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.550+0000 7fbdd07ff700 1 --2- 172.21.15.112:0/1251166520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdc80cf5b0 0x7fbdc80cebc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.550+0000 7fbdd07ff700 1 -- 172.21.15.112:0/1251166520 >> 172.21.15.112:0/1251166520 conn(0x7fbdc80d17d0 msgr2=0x7fbdc80d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:57.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.550+0000 7fbdd07ff700 1 -- 172.21.15.112:0/1251166520 shutdown_connections 2023-09-12T16:07:57.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.550+0000 7fbdd07ff700 1 -- 172.21.15.112:0/1251166520 wait complete. 2023-09-12T16:07:57.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.551+0000 7fbdd07ff700 1 Processor -- start 2023-09-12T16:07:57.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.551+0000 7fbdd07ff700 1 -- start start 2023-09-12T16:07:57.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.552+0000 7fbdd07ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdc80cfdb0 0x7fbdc80c5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:57.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.552+0000 7fbdd07ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbdc815bca0 0x7fbdc80ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:57.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.552+0000 7fbdd07ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdc80c7f70 0x7fbdc80cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:57.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.552+0000 7fbdd07ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc80b1dd0 con 0x7fbdc80cfdb0 2023-09-12T16:07:57.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.552+0000 7fbdd07ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc80c5840 con 0x7fbdc80c7f70 2023-09-12T16:07:57.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.552+0000 7fbdd07ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc806cab0 con 0x7fbdc815bca0 2023-09-12T16:07:57.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.553+0000 7fbdce59b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdc80cfdb0 0x7fbdc80c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:57.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.553+0000 7fbdce59b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdc80cfdb0 0x7fbdc80c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53858/0 (socket says 172.21.15.112:53858) 2023-09-12T16:07:57.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.553+0000 7fbdce59b700 1 -- 172.21.15.112:0/1425479427 learned_addr learned my addr 172.21.15.112:0/1425479427 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:57.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.553+0000 7fbdcdd9a700 1 --2- 172.21.15.112:0/1425479427 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbdc815bca0 0x7fbdc80ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:57.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.553+0000 7fbdced9c700 1 --2- 172.21.15.112:0/1425479427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdc80c7f70 0x7fbdc80cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:57.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.553+0000 7fbdce59b700 1 -- 172.21.15.112:0/1425479427 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbdc815bca0 msgr2=0x7fbdc80ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:57.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.553+0000 7fbdce59b700 1 --2- 172.21.15.112:0/1425479427 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbdc815bca0 0x7fbdc80ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.553+0000 7fbdce59b700 1 -- 172.21.15.112:0/1425479427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdc80c7f70 msgr2=0x7fbdc80cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:57.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.553+0000 7fbdce59b700 1 --2- 172.21.15.112:0/1425479427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdc80c7f70 0x7fbdc80cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.553+0000 7fbdce59b700 1 -- 172.21.15.112:0/1425479427 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb80095f0 con 0x7fbdc80cfdb0 2023-09-12T16:07:57.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.553+0000 7fbdce59b700 1 --2- 172.21.15.112:0/1425479427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdc80cfdb0 0x7fbdc80c5300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbdc400d980 tx=0x7fbdc400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:57.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.554+0000 7fbdbeffd700 1 -- 172.21.15.112:0/1425479427 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc40098d0 con 0x7fbdc80cfdb0 2023-09-12T16:07:57.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.554+0000 7fbdbeffd700 1 -- 172.21.15.112:0/1425479427 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbdc4009b20 con 0x7fbdc80cfdb0 2023-09-12T16:07:57.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.554+0000 7fbdbeffd700 1 -- 172.21.15.112:0/1425479427 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4010460 con 0x7fbdc80cfdb0 2023-09-12T16:07:57.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.554+0000 7fbdd07ff700 1 -- 172.21.15.112:0/1425479427 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc80c8500 con 0x7fbdc80cfdb0 2023-09-12T16:07:57.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.554+0000 7fbdd07ff700 1 -- 172.21.15.112:0/1425479427 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc806c7d0 con 0x7fbdc80cfdb0 2023-09-12T16:07:57.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.555+0000 7fbdd07ff700 1 -- 172.21.15.112:0/1425479427 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc80b20b0 con 0x7fbdc80cfdb0 2023-09-12T16:07:57.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.556+0000 7fbdbeffd700 1 -- 172.21.15.112:0/1425479427 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fbdc40105c0 con 0x7fbdc80cfdb0 2023-09-12T16:07:57.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.557+0000 7fbdbeffd700 1 --2- 172.21.15.112:0/1425479427 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbdac06a580 0x7fbdac06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:57.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.557+0000 7fbdbeffd700 1 -- 172.21.15.112:0/1425479427 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fbdc40890f0 con 0x7fbdc80cfdb0 2023-09-12T16:07:57.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.557+0000 7fbdcdd9a700 1 --2- 172.21.15.112:0/1425479427 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbdac06a580 0x7fbdac06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:57.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.558+0000 7fbdcdd9a700 1 --2- 172.21.15.112:0/1425479427 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbdac06a580 0x7fbdac06ca40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80098e0 tx=0x7fbdb80047c0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:57.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.561+0000 7fbdbeffd700 1 -- 172.21.15.112:0/1425479427 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fbdc4054280 con 0x7fbdc80cfdb0 2023-09-12T16:07:57.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.755+0000 7fbdd07ff700 1 -- 172.21.15.112:0/1425479427 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbdc8073ea0 con 0x7fbdc80cfdb0 2023-09-12T16:07:57.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.756+0000 7fbdbeffd700 1 -- 172.21.15.112:0/1425479427 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbdc40170a0 con 0x7fbdc80cfdb0 2023-09-12T16:07:57.757 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-09-12T16:07:57.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.758+0000 7fbdd07ff700 1 -- 172.21.15.112:0/1425479427 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbdac06a580 msgr2=0x7fbdac06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:57.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.758+0000 7fbdd07ff700 1 --2- 172.21.15.112:0/1425479427 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbdac06a580 0x7fbdac06ca40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80098e0 tx=0x7fbdb80047c0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.758+0000 7fbdd07ff700 1 -- 172.21.15.112:0/1425479427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdc80cfdb0 msgr2=0x7fbdc80c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:57.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.758+0000 7fbdd07ff700 1 --2- 172.21.15.112:0/1425479427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdc80cfdb0 0x7fbdc80c5300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbdc400d980 tx=0x7fbdc400dc90 comp rx=0 tx=0).stop 2023-09-12T16:07:57.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.758+0000 7fbdd07ff700 1 -- 172.21.15.112:0/1425479427 shutdown_connections 2023-09-12T16:07:57.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.758+0000 7fbdd07ff700 1 --2- 172.21.15.112:0/1425479427 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbdac06a580 0x7fbdac06ca40 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80098e0 tx=0x7fbdb80047c0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.758+0000 7fbdd07ff700 1 --2- 172.21.15.112:0/1425479427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdc80c7f70 0x7fbdc80cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.758+0000 7fbdd07ff700 1 --2- 172.21.15.112:0/1425479427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdc80cfdb0 0x7fbdc80c5300 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.758+0000 7fbdd07ff700 1 --2- 172.21.15.112:0/1425479427 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbdc815bca0 0x7fbdc80ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.758+0000 7fbdd07ff700 1 -- 172.21.15.112:0/1425479427 >> 172.21.15.112:0/1425479427 conn(0x7fbdc80d17d0 msgr2=0x7fbdc815ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:57.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.759+0000 7fbdd07ff700 1 -- 172.21.15.112:0/1425479427 shutdown_connections 2023-09-12T16:07:57.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.759+0000 7fbdd07ff700 1 -- 172.21.15.112:0/1425479427 wait complete. 2023-09-12T16:07:57.778 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-12T16:07:57.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.980+0000 7fd4ed3ff700 1 -- 172.21.15.112:0/1602180397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4e815bb40 msgr2=0x7fd4e80d1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:57.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.980+0000 7fd4ed3ff700 1 --2- 172.21.15.112:0/1602180397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4e815bb40 0x7fd4e80d1ed0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80cdf30 tx=0x7fd4d8009c70 comp rx=0 tx=0).stop 2023-09-12T16:07:57.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.980+0000 7fd4ed3ff700 1 -- 172.21.15.112:0/1602180397 shutdown_connections 2023-09-12T16:07:57.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.980+0000 7fd4ed3ff700 1 --2- 172.21.15.112:0/1602180397 >> v2:172.21.15.144:3300/0 conn(0x7fd4e815fc40 0x7fd4e80b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.980+0000 7fd4ed3ff700 1 --2- 172.21.15.112:0/1602180397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4e815bb40 0x7fd4e80d1ed0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.980+0000 7fd4ed3ff700 1 -- 172.21.15.112:0/1602180397 >> 172.21.15.112:0/1602180397 conn(0x7fd4e809aa90 msgr2=0x7fd4e80d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:57.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.980+0000 7fd4ed3ff700 1 -- 172.21.15.112:0/1602180397 shutdown_connections 2023-09-12T16:07:57.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.980+0000 7fd4ed3ff700 1 -- 172.21.15.112:0/1602180397 wait complete. 2023-09-12T16:07:57.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.982+0000 7fd4ed3ff700 1 Processor -- start 2023-09-12T16:07:57.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.982+0000 7fd4ed3ff700 1 -- start start 2023-09-12T16:07:57.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.983+0000 7fd4ed3ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4e80d2410 0x7fd4e81462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:57.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.983+0000 7fd4ed3ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4e815bb40 0x7fd4e80c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:57.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.983+0000 7fd4ed3ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4e815fc40 0x7fd4e80c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:57.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.983+0000 7fd4ed3ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e81591c0 con 0x7fd4e80d2410 2023-09-12T16:07:57.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.983+0000 7fd4ed3ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80c7ce0 con 0x7fd4e815fc40 2023-09-12T16:07:57.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.983+0000 7fd4ed3ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e81f2cb0 con 0x7fd4e815bb40 2023-09-12T16:07:57.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.983+0000 7fd4e6ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4e80d2410 0x7fd4e81462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:57.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.983+0000 7fd4e6ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4e80d2410 0x7fd4e81462c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53876/0 (socket says 172.21.15.112:53876) 2023-09-12T16:07:57.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.983+0000 7fd4e6ffd700 1 -- 172.21.15.112:0/1622792011 learned_addr learned my addr 172.21.15.112:0/1622792011 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:57.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.983+0000 7fd4e6ffd700 1 -- 172.21.15.112:0/1622792011 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4e815bb40 msgr2=0x7fd4e80c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:57.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.983+0000 7fd4e6ffd700 1 --2- 172.21.15.112:0/1622792011 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4e815bb40 0x7fd4e80c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.983+0000 7fd4e6ffd700 1 -- 172.21.15.112:0/1622792011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4e815fc40 msgr2=0x7fd4e80c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:57.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.983+0000 7fd4e6ffd700 1 --2- 172.21.15.112:0/1622792011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4e815fc40 0x7fd4e80c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:57.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.983+0000 7fd4e6ffd700 1 -- 172.21.15.112:0/1622792011 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d80095f0 con 0x7fd4e80d2410 2023-09-12T16:07:57.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.984+0000 7fd4e6ffd700 1 --2- 172.21.15.112:0/1622792011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4e80d2410 0x7fd4e81462c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd4e808af50 tx=0x7fd4d80050d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:57.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.984+0000 7fd4cf7fe700 1 -- 172.21.15.112:0/1622792011 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d801d070 con 0x7fd4e80d2410 2023-09-12T16:07:57.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.984+0000 7fd4cf7fe700 1 -- 172.21.15.112:0/1622792011 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd4d800b970 con 0x7fd4e80d2410 2023-09-12T16:07:57.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.984+0000 7fd4ed3ff700 1 -- 172.21.15.112:0/1622792011 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e80c73b0 con 0x7fd4e80d2410 2023-09-12T16:07:57.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.984+0000 7fd4cf7fe700 1 -- 172.21.15.112:0/1622792011 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d800bd80 con 0x7fd4e80d2410 2023-09-12T16:07:57.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.984+0000 7fd4ed3ff700 1 -- 172.21.15.112:0/1622792011 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e80c7970 con 0x7fd4e80d2410 2023-09-12T16:07:57.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.985+0000 7fd4ed3ff700 1 -- 172.21.15.112:0/1622792011 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e8073ea0 con 0x7fd4e80d2410 2023-09-12T16:07:57.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.986+0000 7fd4cf7fe700 1 -- 172.21.15.112:0/1622792011 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fd4d800f460 con 0x7fd4e80d2410 2023-09-12T16:07:57.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.987+0000 7fd4cf7fe700 1 --2- 172.21.15.112:0/1622792011 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd4d406a580 0x7fd4d406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:57.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.987+0000 7fd4cf7fe700 1 -- 172.21.15.112:0/1622792011 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd4d808a700 con 0x7fd4e80d2410 2023-09-12T16:07:57.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.987+0000 7fd4e67fc700 1 --2- 172.21.15.112:0/1622792011 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd4d406a580 0x7fd4d406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:57.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.987+0000 7fd4e67fc700 1 --2- 172.21.15.112:0/1622792011 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd4d406a580 0x7fd4d406ca40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80d2830 tx=0x7fd4dc007a20 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:57.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:57.991+0000 7fd4cf7fe700 1 -- 172.21.15.112:0/1622792011 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd4d8055890 con 0x7fd4e80d2410 2023-09-12T16:07:58.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.186+0000 7fd4ed3ff700 1 -- 172.21.15.112:0/1622792011 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd4e80b3e40 con 0x7fd4e80d2410 2023-09-12T16:07:58.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.186+0000 7fd4cf7fe700 1 -- 172.21.15.112:0/1622792011 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd4d8058eb0 con 0x7fd4e80d2410 2023-09-12T16:07:58.188 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:07:58.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.188+0000 7fd4ed3ff700 1 -- 172.21.15.112:0/1622792011 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd4d406a580 msgr2=0x7fd4d406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:58.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.188+0000 7fd4ed3ff700 1 --2- 172.21.15.112:0/1622792011 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd4d406a580 0x7fd4d406ca40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80d2830 tx=0x7fd4dc007a20 comp rx=0 tx=0).stop 2023-09-12T16:07:58.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.188+0000 7fd4ed3ff700 1 -- 172.21.15.112:0/1622792011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4e80d2410 msgr2=0x7fd4e81462c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:58.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.188+0000 7fd4ed3ff700 1 --2- 172.21.15.112:0/1622792011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4e80d2410 0x7fd4e81462c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd4e808af50 tx=0x7fd4d80050d0 comp rx=0 tx=0).stop 2023-09-12T16:07:58.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.188+0000 7fd4ed3ff700 1 -- 172.21.15.112:0/1622792011 shutdown_connections 2023-09-12T16:07:58.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.188+0000 7fd4ed3ff700 1 --2- 172.21.15.112:0/1622792011 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd4d406a580 0x7fd4d406ca40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:58.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.188+0000 7fd4ed3ff700 1 --2- 172.21.15.112:0/1622792011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4e815fc40 0x7fd4e80c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:58.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.188+0000 7fd4ed3ff700 1 --2- 172.21.15.112:0/1622792011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4e80d2410 0x7fd4e81462c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:58.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.188+0000 7fd4ed3ff700 1 --2- 172.21.15.112:0/1622792011 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4e815bb40 0x7fd4e80c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:58.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.188+0000 7fd4ed3ff700 1 -- 172.21.15.112:0/1622792011 >> 172.21.15.112:0/1622792011 conn(0x7fd4e809aa90 msgr2=0x7fd4e815ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:58.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.188+0000 7fd4ed3ff700 1 -- 172.21.15.112:0/1622792011 shutdown_connections 2023-09-12T16:07:58.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.188+0000 7fd4ed3ff700 1 -- 172.21.15.112:0/1622792011 wait complete. 2023-09-12T16:07:58.252 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-09-12T16:07:58.253 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:07:58.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.451+0000 7f86fd1ff700 1 -- 172.21.15.112:0/2560816142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e0005210 msgr2=0x7f86e000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:58.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.451+0000 7f86fd1ff700 1 --2- 172.21.15.112:0/2560816142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e0005210 0x7f86e000ba10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f86f000e320 tx=0x7f86e0005880 comp rx=0 tx=0).stop 2023-09-12T16:07:58.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.451+0000 7f86fd1ff700 1 -- 172.21.15.112:0/2560816142 shutdown_connections 2023-09-12T16:07:58.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.451+0000 7f86fd1ff700 1 --2- 172.21.15.112:0/2560816142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e0005210 0x7f86e000ba10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:58.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.451+0000 7f86fd1ff700 1 -- 172.21.15.112:0/2560816142 >> 172.21.15.112:0/2560816142 conn(0x7f86f80d1930 msgr2=0x7f86f80d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:58.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.451+0000 7f86fd1ff700 1 -- 172.21.15.112:0/2560816142 shutdown_connections 2023-09-12T16:07:58.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.451+0000 7f86fd1ff700 1 -- 172.21.15.112:0/2560816142 wait complete. 2023-09-12T16:07:58.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.453+0000 7f86fd1ff700 1 Processor -- start 2023-09-12T16:07:58.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.453+0000 7f86fd1ff700 1 -- start start 2023-09-12T16:07:58.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.454+0000 7f86fd1ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e0005210 0x7f86f80cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:58.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.454+0000 7f86fd1ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86f8155220 0x7f86f80b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:58.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.454+0000 7f86fd1ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86f80b4a60 0x7f86f81f2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:58.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.454+0000 7f86fd1ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f80b4f10 con 0x7f86e0005210 2023-09-12T16:07:58.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.454+0000 7f86fd1ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f80cb6f0 con 0x7f86f80b4a60 2023-09-12T16:07:58.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.454+0000 7f86fd1ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f80ca870 con 0x7f86f8155220 2023-09-12T16:07:58.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.454+0000 7f86f6d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e0005210 0x7f86f80cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:58.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.454+0000 7f86f6d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e0005210 0x7f86f80cb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53884/0 (socket says 172.21.15.112:53884) 2023-09-12T16:07:58.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.454+0000 7f86f6d9d700 1 -- 172.21.15.112:0/1174547546 learned_addr learned my addr 172.21.15.112:0/1174547546 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:58.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.454+0000 7f86f759e700 1 --2- 172.21.15.112:0/1174547546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86f80b4a60 0x7f86f81f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:58.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.454+0000 7f86f659c700 1 --2- 172.21.15.112:0/1174547546 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86f8155220 0x7f86f80b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:58.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.455+0000 7f86f6d9d700 1 -- 172.21.15.112:0/1174547546 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86f8155220 msgr2=0x7f86f80b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:58.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.455+0000 7f86f6d9d700 1 --2- 172.21.15.112:0/1174547546 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86f8155220 0x7f86f80b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:58.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.455+0000 7f86f6d9d700 1 -- 172.21.15.112:0/1174547546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86f80b4a60 msgr2=0x7f86f81f2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:58.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.455+0000 7f86f6d9d700 1 --2- 172.21.15.112:0/1174547546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86f80b4a60 0x7f86f81f2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:58.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.455+0000 7f86f6d9d700 1 -- 172.21.15.112:0/1174547546 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f80c9fd0 con 0x7f86e0005210 2023-09-12T16:07:58.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.455+0000 7f86f659c700 1 --2- 172.21.15.112:0/1174547546 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86f8155220 0x7f86f80b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:07:58.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.455+0000 7f86f6d9d700 1 --2- 172.21.15.112:0/1174547546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e0005210 0x7f86f80cb1b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f86e8006400 tx=0x7f86e8003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:58.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.455+0000 7f86df7fe700 1 -- 172.21.15.112:0/1174547546 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e8011630 con 0x7f86e0005210 2023-09-12T16:07:58.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.455+0000 7f86df7fe700 1 -- 172.21.15.112:0/1174547546 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f86e80117d0 con 0x7f86e0005210 2023-09-12T16:07:58.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.455+0000 7f86fd1ff700 1 -- 172.21.15.112:0/1174547546 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f80ca2b0 con 0x7f86e0005210 2023-09-12T16:07:58.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.455+0000 7f86df7fe700 1 -- 172.21.15.112:0/1174547546 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e8011be0 con 0x7f86e0005210 2023-09-12T16:07:58.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.455+0000 7f86fd1ff700 1 -- 172.21.15.112:0/1174547546 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f81f2030 con 0x7f86e0005210 2023-09-12T16:07:58.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.456+0000 7f86fd1ff700 1 -- 172.21.15.112:0/1174547546 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f81f1e90 con 0x7f86e0005210 2023-09-12T16:07:58.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.457+0000 7f86df7fe700 1 -- 172.21.15.112:0/1174547546 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f86e8011d40 con 0x7f86e0005210 2023-09-12T16:07:58.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.458+0000 7f86df7fe700 1 --2- 172.21.15.112:0/1174547546 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f86e406a580 0x7f86e406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:58.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.458+0000 7f86df7fe700 1 -- 172.21.15.112:0/1174547546 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f86e8089c60 con 0x7f86e0005210 2023-09-12T16:07:58.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.458+0000 7f86f659c700 1 --2- 172.21.15.112:0/1174547546 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f86e406a580 0x7f86e406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:58.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.459+0000 7f86f659c700 1 --2- 172.21.15.112:0/1174547546 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f86e406a580 0x7f86e406ca40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f86f815e670 tx=0x7f86ec006bc0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:58.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.462+0000 7f86df7fe700 1 -- 172.21.15.112:0/1174547546 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f86f81f1e90 con 0x7f86e0005210 2023-09-12T16:07:58.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.658+0000 7f86fd1ff700 1 -- 172.21.15.112:0/1174547546 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86f81f1e90 con 0x7f86e0005210 2023-09-12T16:07:58.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.660+0000 7f86df7fe700 1 -- 172.21.15.112:0/1174547546 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18816 (secure 0 0 0) 0x7f86f81f1e90 con 0x7f86e0005210 2023-09-12T16:07:58.661 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:07:58.662 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:44.445226+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:07:58.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.662+0000 7f86fd1ff700 1 -- 172.21.15.112:0/1174547546 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f86e406a580 msgr2=0x7f86e406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:58.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.662+0000 7f86fd1ff700 1 --2- 172.21.15.112:0/1174547546 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f86e406a580 0x7f86e406ca40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f86f815e670 tx=0x7f86ec006bc0 comp rx=0 tx=0).stop 2023-09-12T16:07:58.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.662+0000 7f86fd1ff700 1 -- 172.21.15.112:0/1174547546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e0005210 msgr2=0x7f86f80cb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:58.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.662+0000 7f86fd1ff700 1 --2- 172.21.15.112:0/1174547546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e0005210 0x7f86f80cb1b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f86e8006400 tx=0x7f86e8003960 comp rx=0 tx=0).stop 2023-09-12T16:07:58.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.662+0000 7f86fd1ff700 1 -- 172.21.15.112:0/1174547546 shutdown_connections 2023-09-12T16:07:58.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.662+0000 7f86fd1ff700 1 --2- 172.21.15.112:0/1174547546 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f86e406a580 0x7f86e406ca40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:58.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.662+0000 7f86fd1ff700 1 --2- 172.21.15.112:0/1174547546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86f80b4a60 0x7f86f81f2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:58.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.662+0000 7f86fd1ff700 1 --2- 172.21.15.112:0/1174547546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e0005210 0x7f86f80cb1b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:58.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.662+0000 7f86fd1ff700 1 --2- 172.21.15.112:0/1174547546 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86f8155220 0x7f86f80b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:58.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.662+0000 7f86fd1ff700 1 -- 172.21.15.112:0/1174547546 >> 172.21.15.112:0/1174547546 conn(0x7f86f80d1930 msgr2=0x7f86f806b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:58.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.662+0000 7f86fd1ff700 1 -- 172.21.15.112:0/1174547546 shutdown_connections 2023-09-12T16:07:58.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.662+0000 7f86fd1ff700 1 -- 172.21.15.112:0/1174547546 wait complete. 2023-09-12T16:07:58.681 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-12T16:06:48.871680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-12T16:06:58.137223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-12T16:06:58.684034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-12T16:07:02.283459+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-12T16:07:58.682 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-12T16:07:58.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.885+0000 7f12a4dff700 1 -- 172.21.15.112:0/4273860695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1288004850 msgr2=0x7f1288004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:58.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.885+0000 7f12a4dff700 1 --2- 172.21.15.112:0/4273860695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1288004850 0x7f1288004cd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f129400c2e0 tx=0x7f1288005880 comp rx=0 tx=0).stop 2023-09-12T16:07:58.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.885+0000 7f129ed9d700 1 -- 172.21.15.112:0/4273860695 reap_dead start 2023-09-12T16:07:58.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.885+0000 7f12a4dff700 1 -- 172.21.15.112:0/4273860695 shutdown_connections 2023-09-12T16:07:58.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.885+0000 7f12a4dff700 1 -- 172.21.15.112:0/4273860695 >> 172.21.15.112:0/4273860695 conn(0x7f12a006a200 msgr2=0x7f12a006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:58.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.886+0000 7f12a4dff700 1 -- 172.21.15.112:0/4273860695 shutdown_connections 2023-09-12T16:07:58.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.886+0000 7f12a4dff700 1 -- 172.21.15.112:0/4273860695 wait complete. 2023-09-12T16:07:58.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.888+0000 7f12a4dff700 1 Processor -- start 2023-09-12T16:07:58.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.888+0000 7f12a4dff700 1 -- start start 2023-09-12T16:07:58.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.889+0000 7f12a4dff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1288004850 0x7f12a01590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:58.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.889+0000 7f12a4dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12a01e4250 0x7f12a01e46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:58.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.889+0000 7f12a4dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12a00c66c0 0x7f12a00c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:58.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.889+0000 7f12a4dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a0159610 con 0x7f12a01e4250 2023-09-12T16:07:58.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.889+0000 7f12a4dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a00c7080 con 0x7f12a00c66c0 2023-09-12T16:07:58.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.889+0000 7f12a4dff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a00afa40 con 0x7f1288004850 2023-09-12T16:07:58.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.890+0000 7f129dd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12a01e4250 0x7f12a01e46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:58.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.890+0000 7f129dd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12a01e4250 0x7f12a01e46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53904/0 (socket says 172.21.15.112:53904) 2023-09-12T16:07:58.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.890+0000 7f129dd9b700 1 -- 172.21.15.112:0/2422541526 learned_addr learned my addr 172.21.15.112:0/2422541526 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:58.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.890+0000 7f129e59c700 1 --2- 172.21.15.112:0/2422541526 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1288004850 0x7f12a01590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:58.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.890+0000 7f129ed9d700 1 --2- 172.21.15.112:0/2422541526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12a00c66c0 0x7f12a00c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:58.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.890+0000 7f129dd9b700 1 -- 172.21.15.112:0/2422541526 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1288004850 msgr2=0x7f12a01590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:58.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.890+0000 7f129dd9b700 1 --2- 172.21.15.112:0/2422541526 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1288004850 0x7f12a01590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:58.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.890+0000 7f129dd9b700 1 -- 172.21.15.112:0/2422541526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12a00c66c0 msgr2=0x7f12a00c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:58.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.890+0000 7f129dd9b700 1 --2- 172.21.15.112:0/2422541526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12a00c66c0 0x7f12a00c6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:58.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.890+0000 7f129dd9b700 1 -- 172.21.15.112:0/2422541526 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a01e4da0 con 0x7f12a01e4250 2023-09-12T16:07:58.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.890+0000 7f129e59c700 1 --2- 172.21.15.112:0/2422541526 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1288004850 0x7f12a01590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:07:58.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.890+0000 7f129dd9b700 1 --2- 172.21.15.112:0/2422541526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12a01e4250 0x7f12a01e46d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f129400c8d0 tx=0x7f12940014e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:58.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.890+0000 7f128effd700 1 -- 172.21.15.112:0/2422541526 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294006650 con 0x7f12a01e4250 2023-09-12T16:07:58.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.890+0000 7f128effd700 1 -- 172.21.15.112:0/2422541526 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1294003770 con 0x7f12a01e4250 2023-09-12T16:07:58.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.891+0000 7f12a4dff700 1 -- 172.21.15.112:0/2422541526 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a01e5080 con 0x7f12a01e4250 2023-09-12T16:07:58.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.891+0000 7f128effd700 1 -- 172.21.15.112:0/2422541526 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294003b40 con 0x7f12a01e4250 2023-09-12T16:07:58.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.891+0000 7f12a4dff700 1 -- 172.21.15.112:0/2422541526 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a01e5640 con 0x7f12a01e4250 2023-09-12T16:07:58.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.892+0000 7f12a4dff700 1 -- 172.21.15.112:0/2422541526 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a0073ea0 con 0x7f12a01e4250 2023-09-12T16:07:58.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.893+0000 7f128effd700 1 -- 172.21.15.112:0/2422541526 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f1294022070 con 0x7f12a01e4250 2023-09-12T16:07:58.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.894+0000 7f128effd700 1 --2- 172.21.15.112:0/2422541526 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f128006a5b0 0x7f128006ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:58.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.894+0000 7f128effd700 1 -- 172.21.15.112:0/2422541526 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f129408afd0 con 0x7f12a01e4250 2023-09-12T16:07:58.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.894+0000 7f129e59c700 1 --2- 172.21.15.112:0/2422541526 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f128006a5b0 0x7f128006ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:58.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.895+0000 7f129e59c700 1 --2- 172.21.15.112:0/2422541526 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f128006a5b0 0x7f128006ca70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1290006fd0 tx=0x7f1290006bc0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:58.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:58.898+0000 7f128effd700 1 -- 172.21.15.112:0/2422541526 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f1294056160 con 0x7f12a01e4250 2023-09-12T16:07:59.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.096+0000 7f12a4dff700 1 -- 172.21.15.112:0/2422541526 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f12a00afc60 con 0x7f12a01e4250 2023-09-12T16:07:59.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.097+0000 7f128effd700 1 -- 172.21.15.112:0/2422541526 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f12a00afc60 con 0x7f12a01e4250 2023-09-12T16:07:59.098 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-09-12T16:07:59.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.099+0000 7f12a4dff700 1 -- 172.21.15.112:0/2422541526 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f128006a5b0 msgr2=0x7f128006ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:59.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.099+0000 7f12a4dff700 1 --2- 172.21.15.112:0/2422541526 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f128006a5b0 0x7f128006ca70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1290006fd0 tx=0x7f1290006bc0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.099+0000 7f12a4dff700 1 -- 172.21.15.112:0/2422541526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12a01e4250 msgr2=0x7f12a01e46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:59.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.099+0000 7f12a4dff700 1 --2- 172.21.15.112:0/2422541526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12a01e4250 0x7f12a01e46d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f129400c8d0 tx=0x7f12940014e0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.099+0000 7f12a4dff700 1 -- 172.21.15.112:0/2422541526 shutdown_connections 2023-09-12T16:07:59.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.099+0000 7f12a4dff700 1 --2- 172.21.15.112:0/2422541526 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f128006a5b0 0x7f128006ca70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.099+0000 7f12a4dff700 1 --2- 172.21.15.112:0/2422541526 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1288004850 0x7f12a01590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.099+0000 7f12a4dff700 1 --2- 172.21.15.112:0/2422541526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12a00c66c0 0x7f12a00c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.099+0000 7f12a4dff700 1 --2- 172.21.15.112:0/2422541526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12a01e4250 0x7f12a01e46d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.099+0000 7f12a4dff700 1 -- 172.21.15.112:0/2422541526 >> 172.21.15.112:0/2422541526 conn(0x7f12a006a200 msgr2=0x7f12a006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:59.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.099+0000 7f12a4dff700 1 -- 172.21.15.112:0/2422541526 shutdown_connections 2023-09-12T16:07:59.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.099+0000 7f12a4dff700 1 -- 172.21.15.112:0/2422541526 wait complete. 2023-09-12T16:07:59.118 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-12T16:07:59.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.319+0000 7f63d51ff700 1 -- 172.21.15.112:0/368556372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63d015bca0 msgr2=0x7f63d015cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:59.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.319+0000 7f63d51ff700 1 --2- 172.21.15.112:0/368556372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63d015bca0 0x7f63d015cb90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f63c00098c0 tx=0x7f63c0009bd0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.319+0000 7f63d51ff700 1 -- 172.21.15.112:0/368556372 shutdown_connections 2023-09-12T16:07:59.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.319+0000 7f63d51ff700 1 --2- 172.21.15.112:0/368556372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63d015bca0 0x7f63d015cb90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.319+0000 7f63d51ff700 1 --2- 172.21.15.112:0/368556372 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63d00cf5b0 0x7f63d00cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.319+0000 7f63d51ff700 1 -- 172.21.15.112:0/368556372 >> 172.21.15.112:0/368556372 conn(0x7f63d00d17d0 msgr2=0x7f63d00d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:59.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.319+0000 7f63d51ff700 1 -- 172.21.15.112:0/368556372 shutdown_connections 2023-09-12T16:07:59.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.319+0000 7f63d51ff700 1 -- 172.21.15.112:0/368556372 wait complete. 2023-09-12T16:07:59.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.321+0000 7f63d51ff700 1 Processor -- start 2023-09-12T16:07:59.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.322+0000 7f63d51ff700 1 -- start start 2023-09-12T16:07:59.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.323+0000 7f63d51ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63d00cfdb0 0x7f63d01f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:59.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.323+0000 7f63d51ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63d015bca0 0x7f63d01f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:59.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.323+0000 7f63d51ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63d015da70 0x7f63d015f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:59.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.323+0000 7f63d51ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d014e6b0 con 0x7f63d015da70 2023-09-12T16:07:59.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.323+0000 7f63d51ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d01f50b0 con 0x7f63d015bca0 2023-09-12T16:07:59.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.323+0000 7f63d51ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d014e080 con 0x7f63d00cfdb0 2023-09-12T16:07:59.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.323+0000 7f63cf59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63d015da70 0x7f63d015f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:59.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.323+0000 7f63cf59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63d015da70 0x7f63d015f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53910/0 (socket says 172.21.15.112:53910) 2023-09-12T16:07:59.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.323+0000 7f63cf59e700 1 -- 172.21.15.112:0/3556317324 learned_addr learned my addr 172.21.15.112:0/3556317324 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:59.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.323+0000 7f63ced9d700 1 --2- 172.21.15.112:0/3556317324 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63d00cfdb0 0x7f63d01f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:59.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.323+0000 7f63ce59c700 1 --2- 172.21.15.112:0/3556317324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63d015bca0 0x7f63d01f1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:59.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.324+0000 7f63cf59e700 1 -- 172.21.15.112:0/3556317324 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63d00cfdb0 msgr2=0x7f63d01f4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:59.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.324+0000 7f63cf59e700 1 --2- 172.21.15.112:0/3556317324 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63d00cfdb0 0x7f63d01f4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.324+0000 7f63cf59e700 1 -- 172.21.15.112:0/3556317324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63d015bca0 msgr2=0x7f63d01f1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:59.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.324+0000 7f63cf59e700 1 --2- 172.21.15.112:0/3556317324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63d015bca0 0x7f63d01f1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.324+0000 7f63cf59e700 1 -- 172.21.15.112:0/3556317324 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c40095f0 con 0x7f63d015da70 2023-09-12T16:07:59.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.324+0000 7f63cf59e700 1 --2- 172.21.15.112:0/3556317324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63d015da70 0x7f63d015f660 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f63c800cc50 tx=0x7f63c800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:59.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.324+0000 7f63b77fe700 1 -- 172.21.15.112:0/3556317324 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c8003c00 con 0x7f63d015da70 2023-09-12T16:07:59.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.324+0000 7f63b77fe700 1 -- 172.21.15.112:0/3556317324 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f63c8003d60 con 0x7f63d015da70 2023-09-12T16:07:59.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.324+0000 7f63b77fe700 1 -- 172.21.15.112:0/3556317324 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c800aad0 con 0x7f63d015da70 2023-09-12T16:07:59.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.324+0000 7f63d51ff700 1 -- 172.21.15.112:0/3556317324 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c0009520 con 0x7f63d015da70 2023-09-12T16:07:59.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.324+0000 7f63d51ff700 1 -- 172.21.15.112:0/3556317324 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d00c8510 con 0x7f63d015da70 2023-09-12T16:07:59.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.325+0000 7f63d51ff700 1 -- 172.21.15.112:0/3556317324 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d014e860 con 0x7f63d015da70 2023-09-12T16:07:59.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.326+0000 7f63b77fe700 1 -- 172.21.15.112:0/3556317324 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f63c800ac30 con 0x7f63d015da70 2023-09-12T16:07:59.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.327+0000 7f63b77fe700 1 --2- 172.21.15.112:0/3556317324 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f63bc06a580 0x7f63bc06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:59.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.328+0000 7f63b77fe700 1 -- 172.21.15.112:0/3556317324 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f63c8088ee0 con 0x7f63d015da70 2023-09-12T16:07:59.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.328+0000 7f63ced9d700 1 --2- 172.21.15.112:0/3556317324 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f63bc06a580 0x7f63bc06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:59.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.328+0000 7f63ced9d700 1 --2- 172.21.15.112:0/3556317324 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f63bc06a580 0x7f63bc06ca40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f63c0000c00 tx=0x7f63c001a040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:59.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.332+0000 7f63b77fe700 1 -- 172.21.15.112:0/3556317324 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f63d014e860 con 0x7f63d015da70 2023-09-12T16:07:59.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.532+0000 7f63d51ff700 1 -- 172.21.15.112:0/3556317324 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f63d0073ea0 con 0x7f63d015da70 2023-09-12T16:07:59.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.532+0000 7f63b77fe700 1 -- 172.21.15.112:0/3556317324 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f63c8054080 con 0x7f63d015da70 2023-09-12T16:07:59.534 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:07:59.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.534+0000 7f63d51ff700 1 -- 172.21.15.112:0/3556317324 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f63bc06a580 msgr2=0x7f63bc06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:59.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.534+0000 7f63d51ff700 1 --2- 172.21.15.112:0/3556317324 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f63bc06a580 0x7f63bc06ca40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f63c0000c00 tx=0x7f63c001a040 comp rx=0 tx=0).stop 2023-09-12T16:07:59.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.534+0000 7f63d51ff700 1 -- 172.21.15.112:0/3556317324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63d015da70 msgr2=0x7f63d015f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:59.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.534+0000 7f63d51ff700 1 --2- 172.21.15.112:0/3556317324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63d015da70 0x7f63d015f660 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f63c800cc50 tx=0x7f63c800cf60 comp rx=0 tx=0).stop 2023-09-12T16:07:59.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.535+0000 7f63d51ff700 1 -- 172.21.15.112:0/3556317324 shutdown_connections 2023-09-12T16:07:59.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.535+0000 7f63d51ff700 1 --2- 172.21.15.112:0/3556317324 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f63bc06a580 0x7f63bc06ca40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.535+0000 7f63d51ff700 1 --2- 172.21.15.112:0/3556317324 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63d00cfdb0 0x7f63d01f4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.535+0000 7f63d51ff700 1 --2- 172.21.15.112:0/3556317324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63d015da70 0x7f63d015f660 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.535+0000 7f63d51ff700 1 --2- 172.21.15.112:0/3556317324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63d015bca0 0x7f63d01f1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.535+0000 7f63d51ff700 1 -- 172.21.15.112:0/3556317324 >> 172.21.15.112:0/3556317324 conn(0x7f63d00d17d0 msgr2=0x7f63d00b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:59.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.535+0000 7f63d51ff700 1 -- 172.21.15.112:0/3556317324 shutdown_connections 2023-09-12T16:07:59.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.535+0000 7f63d51ff700 1 -- 172.21.15.112:0/3556317324 wait complete. 2023-09-12T16:07:59.554 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-12T16:07:59.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.754+0000 7f87d0dff700 1 -- 172.21.15.112:0/1170201506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87cc0cdda0 msgr2=0x7f87cc15a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:59.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.754+0000 7f87d0dff700 1 --2- 172.21.15.112:0/1170201506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87cc0cdda0 0x7f87cc15a040 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f87cc0c9c30 tx=0x7f87c400b380 comp rx=0 tx=0).stop 2023-09-12T16:07:59.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.754+0000 7f87d0dff700 1 -- 172.21.15.112:0/1170201506 shutdown_connections 2023-09-12T16:07:59.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.754+0000 7f87d0dff700 1 --2- 172.21.15.112:0/1170201506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87cc0cdda0 0x7f87cc15a040 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.754+0000 7f87d0dff700 1 --2- 172.21.15.112:0/1170201506 >> v2:172.21.15.144:3300/0 conn(0x7f87cc142d80 0x7f87cc15dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.754+0000 7f87d0dff700 1 -- 172.21.15.112:0/1170201506 >> 172.21.15.112:0/1170201506 conn(0x7f87cc06a200 msgr2=0x7f87cc06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:59.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.754+0000 7f87d0dff700 1 -- 172.21.15.112:0/1170201506 shutdown_connections 2023-09-12T16:07:59.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.754+0000 7f87d0dff700 1 -- 172.21.15.112:0/1170201506 wait complete. 2023-09-12T16:07:59.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.756+0000 7f87d0dff700 1 Processor -- start 2023-09-12T16:07:59.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.756+0000 7f87d0dff700 1 -- start start 2023-09-12T16:07:59.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.757+0000 7f87d0dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87cc0cdda0 0x7f87cc1e3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:59.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.757+0000 7f87d0dff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87cc142d80 0x7f87cc159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:59.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.757+0000 7f87d0dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87cc159bb0 0x7f87cc0c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:59.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.757+0000 7f87d0dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc1e3090 con 0x7f87cc159bb0 2023-09-12T16:07:59.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.757+0000 7f87d0dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc1e3370 con 0x7f87cc0cdda0 2023-09-12T16:07:59.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.757+0000 7f87d0dff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc1e3650 con 0x7f87cc142d80 2023-09-12T16:07:59.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.757+0000 7f87cad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87cc159bb0 0x7f87cc0c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:59.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.757+0000 7f87cad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87cc159bb0 0x7f87cc0c82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53928/0 (socket says 172.21.15.112:53928) 2023-09-12T16:07:59.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.757+0000 7f87cad9d700 1 -- 172.21.15.112:0/373222375 learned_addr learned my addr 172.21.15.112:0/373222375 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:07:59.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.757+0000 7f87ca59c700 1 --2- 172.21.15.112:0/373222375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87cc0cdda0 0x7f87cc1e3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:59.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.757+0000 7f87c3fff700 1 --2- 172.21.15.112:0/373222375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87cc142d80 0x7f87cc159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:59.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.757+0000 7f87cad9d700 1 -- 172.21.15.112:0/373222375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87cc142d80 msgr2=0x7f87cc159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:59.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.757+0000 7f87cad9d700 1 --2- 172.21.15.112:0/373222375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87cc142d80 0x7f87cc159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.757+0000 7f87cad9d700 1 -- 172.21.15.112:0/373222375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87cc0cdda0 msgr2=0x7f87cc1e3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:59.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.757+0000 7f87cad9d700 1 --2- 172.21.15.112:0/373222375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87cc0cdda0 0x7f87cc1e3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.757+0000 7f87cad9d700 1 -- 172.21.15.112:0/373222375 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c4009d00 con 0x7f87cc159bb0 2023-09-12T16:07:59.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.757+0000 7f87c3fff700 1 --2- 172.21.15.112:0/373222375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87cc142d80 0x7f87cc159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:07:59.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.758+0000 7f87cad9d700 1 --2- 172.21.15.112:0/373222375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87cc159bb0 0x7f87cc0c82e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f87c400b070 tx=0x7f87c4007b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:59.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.758+0000 7f87c2ffd700 1 -- 172.21.15.112:0/373222375 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c400e040 con 0x7f87cc159bb0 2023-09-12T16:07:59.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.758+0000 7f87c2ffd700 1 -- 172.21.15.112:0/373222375 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f87c401d890 con 0x7f87cc159bb0 2023-09-12T16:07:59.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.758+0000 7f87d0dff700 1 -- 172.21.15.112:0/373222375 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87cc1e3930 con 0x7f87cc159bb0 2023-09-12T16:07:59.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.758+0000 7f87c2ffd700 1 -- 172.21.15.112:0/373222375 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c400bea0 con 0x7f87cc159bb0 2023-09-12T16:07:59.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.758+0000 7f87d0dff700 1 -- 172.21.15.112:0/373222375 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87cc0b0c80 con 0x7f87cc159bb0 2023-09-12T16:07:59.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.759+0000 7f87d0dff700 1 -- 172.21.15.112:0/373222375 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87cc1e31d0 con 0x7f87cc159bb0 2023-09-12T16:07:59.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.760+0000 7f87c2ffd700 1 -- 172.21.15.112:0/373222375 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f87c401dca0 con 0x7f87cc159bb0 2023-09-12T16:07:59.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.761+0000 7f87c2ffd700 1 --2- 172.21.15.112:0/373222375 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f87ac06a580 0x7f87ac06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:07:59.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.762+0000 7f87c2ffd700 1 -- 172.21.15.112:0/373222375 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f87c408ad60 con 0x7f87cc159bb0 2023-09-12T16:07:59.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.762+0000 7f87ca59c700 1 --2- 172.21.15.112:0/373222375 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f87ac06a580 0x7f87ac06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:07:59.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.762+0000 7f87ca59c700 1 --2- 172.21.15.112:0/373222375 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f87ac06a580 0x7f87ac06ca40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f87bc009c60 tx=0x7f87bc009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:07:59.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.766+0000 7f87c2ffd700 1 -- 172.21.15.112:0/373222375 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f87cc1e31d0 con 0x7f87cc159bb0 2023-09-12T16:07:59.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.962+0000 7f87d0dff700 1 -- 172.21.15.112:0/373222375 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87cc1e31d0 con 0x7f87cc159bb0 2023-09-12T16:07:59.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.962+0000 7f87c2ffd700 1 -- 172.21.15.112:0/373222375 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87cc1e31d0 con 0x7f87cc159bb0 2023-09-12T16:07:59.964 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-09-12T16:07:59.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.965+0000 7f87d0dff700 1 -- 172.21.15.112:0/373222375 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f87ac06a580 msgr2=0x7f87ac06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:59.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.965+0000 7f87d0dff700 1 --2- 172.21.15.112:0/373222375 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f87ac06a580 0x7f87ac06ca40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f87bc009c60 tx=0x7f87bc009260 comp rx=0 tx=0).stop 2023-09-12T16:07:59.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.965+0000 7f87d0dff700 1 -- 172.21.15.112:0/373222375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87cc159bb0 msgr2=0x7f87cc0c82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:07:59.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.965+0000 7f87d0dff700 1 --2- 172.21.15.112:0/373222375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87cc159bb0 0x7f87cc0c82e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f87c400b070 tx=0x7f87c4007b80 comp rx=0 tx=0).stop 2023-09-12T16:07:59.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.965+0000 7f87d0dff700 1 -- 172.21.15.112:0/373222375 shutdown_connections 2023-09-12T16:07:59.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.965+0000 7f87d0dff700 1 --2- 172.21.15.112:0/373222375 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f87ac06a580 0x7f87ac06ca40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.965+0000 7f87d0dff700 1 --2- 172.21.15.112:0/373222375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87cc159bb0 0x7f87cc0c82e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.965+0000 7f87d0dff700 1 --2- 172.21.15.112:0/373222375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87cc0cdda0 0x7f87cc1e3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.965+0000 7f87d0dff700 1 --2- 172.21.15.112:0/373222375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87cc142d80 0x7f87cc159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:07:59.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.965+0000 7f87d0dff700 1 -- 172.21.15.112:0/373222375 >> 172.21.15.112:0/373222375 conn(0x7f87cc06a200 msgr2=0x7f87cc141ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:07:59.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.965+0000 7f87d0dff700 1 -- 172.21.15.112:0/373222375 shutdown_connections 2023-09-12T16:07:59.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:07:59.965+0000 7f87d0dff700 1 -- 172.21.15.112:0/373222375 wait complete. 2023-09-12T16:07:59.984 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-12T16:08:00.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.184+0000 7fe22b9ff700 1 -- 172.21.15.112:0/1375830951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2240cd6d0 msgr2=0x7fe2240cdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:00.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.184+0000 7fe22b9ff700 1 --2- 172.21.15.112:0/1375830951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2240cd6d0 0x7fe2240cdb80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009f60 tx=0x7fe21c009f90 comp rx=0 tx=0).stop 2023-09-12T16:08:00.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.184+0000 7fe22b9ff700 1 -- 172.21.15.112:0/1375830951 shutdown_connections 2023-09-12T16:08:00.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.184+0000 7fe22b9ff700 1 --2- 172.21.15.112:0/1375830951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2240cd6d0 0x7fe2240cdb80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:00.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.184+0000 7fe22b9ff700 1 --2- 172.21.15.112:0/1375830951 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe224143080 0x7fe22415dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:00.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.184+0000 7fe22b9ff700 1 -- 172.21.15.112:0/1375830951 >> 172.21.15.112:0/1375830951 conn(0x7fe22406a200 msgr2=0x7fe22406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:00.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.184+0000 7fe22b9ff700 1 -- 172.21.15.112:0/1375830951 shutdown_connections 2023-09-12T16:08:00.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.185+0000 7fe22b9ff700 1 -- 172.21.15.112:0/1375830951 wait complete. 2023-09-12T16:08:00.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.186+0000 7fe22b9ff700 1 Processor -- start 2023-09-12T16:08:00.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.186+0000 7fe22b9ff700 1 -- start start 2023-09-12T16:08:00.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.187+0000 7fe22b9ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2240cd6d0 0x7fe22413b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:00.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.187+0000 7fe22b9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe224142ca0 0x7fe22415bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:00.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.187+0000 7fe22b9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe224143080 0x7fe2240c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:00.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.187+0000 7fe22b9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22415d060 con 0x7fe224143080 2023-09-12T16:08:00.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.187+0000 7fe22b9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22415c7c0 con 0x7fe224142ca0 2023-09-12T16:08:00.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.187+0000 7fe22b9ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22415caa0 con 0x7fe2240cd6d0 2023-09-12T16:08:00.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.188+0000 7fe229f9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe224143080 0x7fe2240c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:00.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.188+0000 7fe229f9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe224143080 0x7fe2240c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53960/0 (socket says 172.21.15.112:53960) 2023-09-12T16:08:00.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.188+0000 7fe229f9c700 1 -- 172.21.15.112:0/511589377 learned_addr learned my addr 172.21.15.112:0/511589377 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:00.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.188+0000 7fe228f9a700 1 --2- 172.21.15.112:0/511589377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe224142ca0 0x7fe22415bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:00.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.188+0000 7fe22979b700 1 --2- 172.21.15.112:0/511589377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2240cd6d0 0x7fe22413b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:00.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.188+0000 7fe229f9c700 1 -- 172.21.15.112:0/511589377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2240cd6d0 msgr2=0x7fe22413b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:00.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.188+0000 7fe229f9c700 1 --2- 172.21.15.112:0/511589377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2240cd6d0 0x7fe22413b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:00.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.188+0000 7fe229f9c700 1 -- 172.21.15.112:0/511589377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe224142ca0 msgr2=0x7fe22415bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:00.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.188+0000 7fe229f9c700 1 --2- 172.21.15.112:0/511589377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe224142ca0 0x7fe22415bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:00.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.188+0000 7fe229f9c700 1 -- 172.21.15.112:0/511589377 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c009c40 con 0x7fe224143080 2023-09-12T16:08:00.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.188+0000 7fe229f9c700 1 --2- 172.21.15.112:0/511589377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe224143080 0x7fe2240c66c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00b610 tx=0x7fe21c007aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:00.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.188+0000 7fe219ffb700 1 -- 172.21.15.112:0/511589377 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c00e040 con 0x7fe224143080 2023-09-12T16:08:00.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.189+0000 7fe219ffb700 1 -- 172.21.15.112:0/511589377 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe21c01d680 con 0x7fe224143080 2023-09-12T16:08:00.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.189+0000 7fe219ffb700 1 -- 172.21.15.112:0/511589377 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c01da90 con 0x7fe224143080 2023-09-12T16:08:00.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.189+0000 7fe22b9ff700 1 -- 172.21.15.112:0/511589377 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22415cd80 con 0x7fe224143080 2023-09-12T16:08:00.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.189+0000 7fe22b9ff700 1 -- 172.21.15.112:0/511589377 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe224140890 con 0x7fe224143080 2023-09-12T16:08:00.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.190+0000 7fe22b9ff700 1 -- 172.21.15.112:0/511589377 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2240c7930 con 0x7fe224143080 2023-09-12T16:08:00.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.191+0000 7fe219ffb700 1 -- 172.21.15.112:0/511589377 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe21c01dbf0 con 0x7fe224143080 2023-09-12T16:08:00.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.192+0000 7fe219ffb700 1 --2- 172.21.15.112:0/511589377 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe20806a580 0x7fe20806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:00.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.192+0000 7fe219ffb700 1 -- 172.21.15.112:0/511589377 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe21c08ae10 con 0x7fe224143080 2023-09-12T16:08:00.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.192+0000 7fe22979b700 1 --2- 172.21.15.112:0/511589377 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe20806a580 0x7fe20806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:00.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.192+0000 7fe22979b700 1 --2- 172.21.15.112:0/511589377 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe20806a580 0x7fe20806ca40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe2200011e0 tx=0x7fe220007db0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:00.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.196+0000 7fe219ffb700 1 -- 172.21.15.112:0/511589377 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe2240c7930 con 0x7fe224143080 2023-09-12T16:08:00.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.395+0000 7fe22b9ff700 1 -- 172.21.15.112:0/511589377 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe2240c7d10 con 0x7fe224143080 2023-09-12T16:08:00.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.396+0000 7fe219ffb700 1 -- 172.21.15.112:0/511589377 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe2240c7d10 con 0x7fe224143080 2023-09-12T16:08:00.397 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:08:00.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.398+0000 7fe22b9ff700 1 -- 172.21.15.112:0/511589377 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe20806a580 msgr2=0x7fe20806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:00.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.398+0000 7fe22b9ff700 1 --2- 172.21.15.112:0/511589377 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe20806a580 0x7fe20806ca40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe2200011e0 tx=0x7fe220007db0 comp rx=0 tx=0).stop 2023-09-12T16:08:00.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.398+0000 7fe22b9ff700 1 -- 172.21.15.112:0/511589377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe224143080 msgr2=0x7fe2240c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:00.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.398+0000 7fe22b9ff700 1 --2- 172.21.15.112:0/511589377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe224143080 0x7fe2240c66c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00b610 tx=0x7fe21c007aa0 comp rx=0 tx=0).stop 2023-09-12T16:08:00.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.398+0000 7fe22b9ff700 1 -- 172.21.15.112:0/511589377 shutdown_connections 2023-09-12T16:08:00.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.398+0000 7fe22b9ff700 1 --2- 172.21.15.112:0/511589377 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe20806a580 0x7fe20806ca40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:00.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.398+0000 7fe22b9ff700 1 --2- 172.21.15.112:0/511589377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2240cd6d0 0x7fe22413b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:00.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.398+0000 7fe22b9ff700 1 --2- 172.21.15.112:0/511589377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe224143080 0x7fe2240c66c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:00.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.398+0000 7fe22b9ff700 1 --2- 172.21.15.112:0/511589377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe224142ca0 0x7fe22415bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:00.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.398+0000 7fe22b9ff700 1 -- 172.21.15.112:0/511589377 >> 172.21.15.112:0/511589377 conn(0x7fe22406a200 msgr2=0x7fe2240acfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:00.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.398+0000 7fe22b9ff700 1 -- 172.21.15.112:0/511589377 shutdown_connections 2023-09-12T16:08:00.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.398+0000 7fe22b9ff700 1 -- 172.21.15.112:0/511589377 wait complete. 2023-09-12T16:08:00.417 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-09-12T16:08:00.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.616+0000 7fdc03fff700 1 -- 172.21.15.112:0/1331859577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbfc0b28f0 msgr2=0x7fdbfc0cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:00.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.616+0000 7fdc03fff700 1 --2- 172.21.15.112:0/1331859577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbfc0b28f0 0x7fdbfc0cd3c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009f60 tx=0x7fdbf4009f90 comp rx=0 tx=0).stop 2023-09-12T16:08:00.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.616+0000 7fdc03fff700 1 -- 172.21.15.112:0/1331859577 shutdown_connections 2023-09-12T16:08:00.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.616+0000 7fdc03fff700 1 --2- 172.21.15.112:0/1331859577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbfc0b28f0 0x7fdbfc0cd3c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:00.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.616+0000 7fdc03fff700 1 --2- 172.21.15.112:0/1331859577 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdbfc15f480 0x7fdbfc0cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:00.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.616+0000 7fdc03fff700 1 -- 172.21.15.112:0/1331859577 >> 172.21.15.112:0/1331859577 conn(0x7fdbfc0d1930 msgr2=0x7fdbfc0d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:00.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.616+0000 7fdc03fff700 1 -- 172.21.15.112:0/1331859577 shutdown_connections 2023-09-12T16:08:00.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.616+0000 7fdc03fff700 1 -- 172.21.15.112:0/1331859577 wait complete. 2023-09-12T16:08:00.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.619+0000 7fdc03fff700 1 Processor -- start 2023-09-12T16:08:00.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.619+0000 7fdc03fff700 1 -- start start 2023-09-12T16:08:00.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.620+0000 7fdc03fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbfc0b28f0 0x7fdbfc0b6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:00.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.620+0000 7fdc03fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbfc0cdfb0 0x7fdbfc0b6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:00.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.620+0000 7fdc03fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdbfc15f480 0x7fdbfc1e46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:00.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.620+0000 7fdc03fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc0b7810 con 0x7fdbfc0b28f0 2023-09-12T16:08:00.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.620+0000 7fdc03fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc0b6f70 con 0x7fdbfc0cdfb0 2023-09-12T16:08:00.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.620+0000 7fdc03fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc0b7250 con 0x7fdbfc15f480 2023-09-12T16:08:00.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.621+0000 7fdc01d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbfc0b28f0 0x7fdbfc0b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:00.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.621+0000 7fdc01d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbfc0b28f0 0x7fdbfc0b6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53980/0 (socket says 172.21.15.112:53980) 2023-09-12T16:08:00.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.621+0000 7fdc01d9b700 1 -- 172.21.15.112:0/2618107170 learned_addr learned my addr 172.21.15.112:0/2618107170 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:00.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.621+0000 7fdc0259c700 1 --2- 172.21.15.112:0/2618107170 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdbfc15f480 0x7fdbfc1e46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:00.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.621+0000 7fdc0159a700 1 --2- 172.21.15.112:0/2618107170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbfc0cdfb0 0x7fdbfc0b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:00.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.621+0000 7fdc01d9b700 1 -- 172.21.15.112:0/2618107170 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdbfc15f480 msgr2=0x7fdbfc1e46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:00.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.621+0000 7fdc01d9b700 1 --2- 172.21.15.112:0/2618107170 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdbfc15f480 0x7fdbfc1e46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:00.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.621+0000 7fdc01d9b700 1 -- 172.21.15.112:0/2618107170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbfc0cdfb0 msgr2=0x7fdbfc0b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:00.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.621+0000 7fdc01d9b700 1 --2- 172.21.15.112:0/2618107170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbfc0cdfb0 0x7fdbfc0b6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:00.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.621+0000 7fdc01d9b700 1 -- 172.21.15.112:0/2618107170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf4009c40 con 0x7fdbfc0b28f0 2023-09-12T16:08:00.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.622+0000 7fdc01d9b700 1 --2- 172.21.15.112:0/2618107170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbfc0b28f0 0x7fdbfc0b6140 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800d950 tx=0x7fdbf800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:00.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.622+0000 7fdbf27fc700 1 -- 172.21.15.112:0/2618107170 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8009930 con 0x7fdbfc0b28f0 2023-09-12T16:08:00.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.622+0000 7fdbf27fc700 1 -- 172.21.15.112:0/2618107170 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdbf8009b80 con 0x7fdbfc0b28f0 2023-09-12T16:08:00.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.622+0000 7fdbf27fc700 1 -- 172.21.15.112:0/2618107170 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8010460 con 0x7fdbfc0b28f0 2023-09-12T16:08:00.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.622+0000 7fdc03fff700 1 -- 172.21.15.112:0/2618107170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbfc0b7530 con 0x7fdbfc0b28f0 2023-09-12T16:08:00.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.622+0000 7fdc03fff700 1 -- 172.21.15.112:0/2618107170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbfc0b6bc0 con 0x7fdbfc0b28f0 2023-09-12T16:08:00.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.623+0000 7fdc03fff700 1 -- 172.21.15.112:0/2618107170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbfc0c8970 con 0x7fdbfc0b28f0 2023-09-12T16:08:00.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.624+0000 7fdbf27fc700 1 -- 172.21.15.112:0/2618107170 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fdbf80105c0 con 0x7fdbfc0b28f0 2023-09-12T16:08:00.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.625+0000 7fdbf27fc700 1 --2- 172.21.15.112:0/2618107170 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdbe006a580 0x7fdbe006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:00.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.625+0000 7fdbf27fc700 1 -- 172.21.15.112:0/2618107170 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fdbf8089250 con 0x7fdbfc0b28f0 2023-09-12T16:08:00.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.626+0000 7fdc0159a700 1 --2- 172.21.15.112:0/2618107170 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdbe006a580 0x7fdbe006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:00.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.626+0000 7fdc0159a700 1 --2- 172.21.15.112:0/2618107170 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdbe006a580 0x7fdbe006ca40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc09f810 tx=0x7fdbec009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:00.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.630+0000 7fdbf27fc700 1 -- 172.21.15.112:0/2618107170 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fdbfc0c8970 con 0x7fdbfc0b28f0 2023-09-12T16:08:00.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:00.910+0000 7fdc03fff700 1 -- 172.21.15.112:0/2618107170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fdbfc0c8d50 con 0x7fdbfc0b28f0 2023-09-12T16:08:01.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.518+0000 7fdbf27fc700 1 -- 172.21.15.112:0/2618107170 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v82) v1 ==== 147+0+0 (secure 0 0 0) 0x7fdbfc0c8d50 con 0x7fdbfc0b28f0 2023-09-12T16:08:01.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.521+0000 7fdc03fff700 1 -- 172.21.15.112:0/2618107170 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdbe006a580 msgr2=0x7fdbe006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:01.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.521+0000 7fdc03fff700 1 --2- 172.21.15.112:0/2618107170 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdbe006a580 0x7fdbe006ca40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc09f810 tx=0x7fdbec009040 comp rx=0 tx=0).stop 2023-09-12T16:08:01.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.521+0000 7fdc03fff700 1 -- 172.21.15.112:0/2618107170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbfc0b28f0 msgr2=0x7fdbfc0b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:01.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.521+0000 7fdc03fff700 1 --2- 172.21.15.112:0/2618107170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbfc0b28f0 0x7fdbfc0b6140 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800d950 tx=0x7fdbf800dc60 comp rx=0 tx=0).stop 2023-09-12T16:08:01.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.521+0000 7fdc03fff700 1 -- 172.21.15.112:0/2618107170 shutdown_connections 2023-09-12T16:08:01.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.521+0000 7fdc03fff700 1 --2- 172.21.15.112:0/2618107170 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdbe006a580 0x7fdbe006ca40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:01.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.521+0000 7fdc03fff700 1 --2- 172.21.15.112:0/2618107170 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdbfc15f480 0x7fdbfc1e46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:01.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.521+0000 7fdc03fff700 1 --2- 172.21.15.112:0/2618107170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbfc0b28f0 0x7fdbfc0b6140 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:01.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.521+0000 7fdc03fff700 1 --2- 172.21.15.112:0/2618107170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbfc0cdfb0 0x7fdbfc0b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:01.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.521+0000 7fdc03fff700 1 -- 172.21.15.112:0/2618107170 >> 172.21.15.112:0/2618107170 conn(0x7fdbfc0d1930 msgr2=0x7fdbfc15da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:01.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.521+0000 7fdc03fff700 1 -- 172.21.15.112:0/2618107170 shutdown_connections 2023-09-12T16:08:01.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.521+0000 7fdc03fff700 1 -- 172.21.15.112:0/2618107170 wait complete. 2023-09-12T16:08:01.543 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2023-09-12T16:08:01.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.744+0000 7fa0931ff700 1 -- 172.21.15.112:0/3008256685 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08c0cdfb0 msgr2=0x7fa08c0d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:01.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.744+0000 7fa0931ff700 1 --2- 172.21.15.112:0/3008256685 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08c0cdfb0 0x7fa08c0d03c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0cf400 tx=0x7fa078009c70 comp rx=0 tx=0).stop 2023-09-12T16:08:01.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.744+0000 7fa0931ff700 1 -- 172.21.15.112:0/3008256685 shutdown_connections 2023-09-12T16:08:01.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.744+0000 7fa0931ff700 1 --2- 172.21.15.112:0/3008256685 >> v2:172.21.15.144:3300/0 conn(0x7fa08c15f480 0x7fa08c0cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:01.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.744+0000 7fa0931ff700 1 --2- 172.21.15.112:0/3008256685 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08c0cdfb0 0x7fa08c0d03c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:01.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.744+0000 7fa0931ff700 1 -- 172.21.15.112:0/3008256685 >> 172.21.15.112:0/3008256685 conn(0x7fa08c0d1930 msgr2=0x7fa08c0d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:01.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.744+0000 7fa0931ff700 1 -- 172.21.15.112:0/3008256685 shutdown_connections 2023-09-12T16:08:01.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.744+0000 7fa0931ff700 1 -- 172.21.15.112:0/3008256685 wait complete. 2023-09-12T16:08:01.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.746+0000 7fa0931ff700 1 Processor -- start 2023-09-12T16:08:01.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.746+0000 7fa0931ff700 1 -- start start 2023-09-12T16:08:01.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.747+0000 7fa0931ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa08c0b28f0 0x7fa08c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:01.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.747+0000 7fa0931ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08c0cdfb0 0x7fa08c15b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:01.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.747+0000 7fa0931ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa08c15f480 0x7fa08c15ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:01.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.747+0000 7fa0931ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c0afde0 con 0x7fa08c0cdfb0 2023-09-12T16:08:01.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.747+0000 7fa0931ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c0cb3d0 con 0x7fa08c15f480 2023-09-12T16:08:01.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.747+0000 7fa0931ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c0cb620 con 0x7fa08c0b28f0 2023-09-12T16:08:01.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.747+0000 7fa08bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08c0cdfb0 0x7fa08c15b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:01.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.747+0000 7fa08bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08c0cdfb0 0x7fa08c15b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54002/0 (socket says 172.21.15.112:54002) 2023-09-12T16:08:01.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.747+0000 7fa08bfff700 1 -- 172.21.15.112:0/3109495375 learned_addr learned my addr 172.21.15.112:0/3109495375 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:01.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.747+0000 7fa09179c700 1 --2- 172.21.15.112:0/3109495375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa08c15f480 0x7fa08c15ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:01.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.747+0000 7fa090f9b700 1 --2- 172.21.15.112:0/3109495375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa08c0b28f0 0x7fa08c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:01.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.747+0000 7fa08bfff700 1 -- 172.21.15.112:0/3109495375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa08c0b28f0 msgr2=0x7fa08c0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:01.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.747+0000 7fa08bfff700 1 --2- 172.21.15.112:0/3109495375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa08c0b28f0 0x7fa08c0b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:01.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.747+0000 7fa08bfff700 1 -- 172.21.15.112:0/3109495375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa08c15f480 msgr2=0x7fa08c15ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:01.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.747+0000 7fa08bfff700 1 --2- 172.21.15.112:0/3109495375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa08c15f480 0x7fa08c15ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:01.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.747+0000 7fa08bfff700 1 -- 172.21.15.112:0/3109495375 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0780095f0 con 0x7fa08c0cdfb0 2023-09-12T16:08:01.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.747+0000 7fa090f9b700 1 --2- 172.21.15.112:0/3109495375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa08c0b28f0 0x7fa08c0b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:08:01.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.748+0000 7fa08bfff700 1 --2- 172.21.15.112:0/3109495375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08c0cdfb0 0x7fa08c15b6f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa08c08b1f0 tx=0x7fa078005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:01.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.748+0000 7fa0897fa700 1 -- 172.21.15.112:0/3109495375 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07801d070 con 0x7fa08c0cdfb0 2023-09-12T16:08:01.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.748+0000 7fa0897fa700 1 -- 172.21.15.112:0/3109495375 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa078005e10 con 0x7fa08c0cdfb0 2023-09-12T16:08:01.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.748+0000 7fa0931ff700 1 -- 172.21.15.112:0/3109495375 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08c0af720 con 0x7fa08c0cdfb0 2023-09-12T16:08:01.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.748+0000 7fa0897fa700 1 -- 172.21.15.112:0/3109495375 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0780044c0 con 0x7fa08c0cdfb0 2023-09-12T16:08:01.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.748+0000 7fa0931ff700 1 -- 172.21.15.112:0/3109495375 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08c15b380 con 0x7fa08c0cdfb0 2023-09-12T16:08:01.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.749+0000 7fa0931ff700 1 -- 172.21.15.112:0/3109495375 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa08c15b510 con 0x7fa08c0cdfb0 2023-09-12T16:08:01.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.750+0000 7fa0897fa700 1 -- 172.21.15.112:0/3109495375 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fa07800b760 con 0x7fa08c0cdfb0 2023-09-12T16:08:01.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.751+0000 7fa0897fa700 1 --2- 172.21.15.112:0/3109495375 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa07006a580 0x7fa07006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:01.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.751+0000 7fa0897fa700 1 -- 172.21.15.112:0/3109495375 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fa07808a360 con 0x7fa08c0cdfb0 2023-09-12T16:08:01.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.751+0000 7fa090f9b700 1 --2- 172.21.15.112:0/3109495375 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa07006a580 0x7fa07006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:01.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.752+0000 7fa090f9b700 1 --2- 172.21.15.112:0/3109495375 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa07006a580 0x7fa07006ca40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa080005ec0 tx=0x7fa080005e50 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:01.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.755+0000 7fa0897fa700 1 -- 172.21.15.112:0/3109495375 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fa0780554f0 con 0x7fa08c0cdfb0 2023-09-12T16:08:01.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.952+0000 7fa0931ff700 1 -- 172.21.15.112:0/3109495375 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config dump"} v 0) v1 -- 0x7fa08c0aff20 con 0x7fa08c0cdfb0 2023-09-12T16:08:02.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.952+0000 7fa0897fa700 1 -- 172.21.15.112:0/3109495375 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v30) v1 ==== 59+0+2220 (secure 0 0 0) 0x7fa08c0aff20 con 0x7fa08c0cdfb0 2023-09-12T16:08:02.087 INFO:teuthology.orchestra.run.smithi112.stdout:WHO MASK LEVEL OPTION VALUE RO 2023-09-12T16:08:02.087 INFO:teuthology.orchestra.run.smithi112.stdout:mon advanced mon_op_complaint_time 120 2023-09-12T16:08:02.087 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced osd_op_complaint_time 180.000000 2023-09-12T16:08:02.087 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4853.209227 2023-09-12T16:08:02.087 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5109.230233 2023-09-12T16:08:02.088 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5012.149526 2023-09-12T16:08:02.088 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4725.508677 2023-09-12T16:08:02.088 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4753.737998 2023-09-12T16:08:02.088 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 5191.802822 2023-09-12T16:08:02.088 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5164.424855 2023-09-12T16:08:02.089 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 2460.222830 2023-09-12T16:08:02.089 INFO:teuthology.orchestra.run.smithi112.stdout:mds advanced debug_mds 20/20 2023-09-12T16:08:02.089 INFO:teuthology.orchestra.run.smithi112.stdout:mds advanced debug_mds_balancer 20/20 2023-09-12T16:08:02.089 INFO:teuthology.orchestra.run.smithi112.stdout:mds advanced debug_ms 1/1 2023-09-12T16:08:02.089 INFO:teuthology.orchestra.run.smithi112.stdout:mds advanced mds_bal_fragment_size_max 10000 2023-09-12T16:08:02.090 INFO:teuthology.orchestra.run.smithi112.stdout:mds advanced mds_bal_merge_size 5 2023-09-12T16:08:02.090 INFO:teuthology.orchestra.run.smithi112.stdout:mds advanced mds_bal_split_bits 3 2023-09-12T16:08:02.090 INFO:teuthology.orchestra.run.smithi112.stdout:mds advanced mds_bal_split_size 100 2023-09-12T16:08:02.090 INFO:teuthology.orchestra.run.smithi112.stdout:mds dev mds_debug_frag true 2023-09-12T16:08:02.090 INFO:teuthology.orchestra.run.smithi112.stdout:mds dev mds_debug_scatterstat true 2023-09-12T16:08:02.090 INFO:teuthology.orchestra.run.smithi112.stdout:mds advanced mds_op_complaint_time 180.000000 2023-09-12T16:08:02.091 INFO:teuthology.orchestra.run.smithi112.stdout:mds dev mds_verify_scatter true 2023-09-12T16:08:02.091 INFO:teuthology.orchestra.run.smithi112.stdout:mds advanced osd_op_complaint_time 180.000000 2023-09-12T16:08:02.091 INFO:teuthology.orchestra.run.smithi112.stdout:mds advanced rados_mon_op_timeout 900 2023-09-12T16:08:02.091 INFO:teuthology.orchestra.run.smithi112.stdout:mds advanced rados_osd_op_timeout 900 2023-09-12T16:08:02.091 INFO:teuthology.orchestra.run.smithi112.stdout:client advanced client_mount_timeout 600 2023-09-12T16:08:02.092 INFO:teuthology.orchestra.run.smithi112.stdout:client advanced debug_client 20/20 2023-09-12T16:08:02.092 INFO:teuthology.orchestra.run.smithi112.stdout:client advanced debug_ms 1/1 2023-09-12T16:08:02.092 INFO:teuthology.orchestra.run.smithi112.stdout:client advanced rados_mon_op_timeout 900 2023-09-12T16:08:02.092 INFO:teuthology.orchestra.run.smithi112.stdout:client advanced rados_osd_op_timeout 900 2023-09-12T16:08:02.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.955+0000 7fa0931ff700 1 -- 172.21.15.112:0/3109495375 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa07006a580 msgr2=0x7fa07006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:02.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.955+0000 7fa0931ff700 1 --2- 172.21.15.112:0/3109495375 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa07006a580 0x7fa07006ca40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa080005ec0 tx=0x7fa080005e50 comp rx=0 tx=0).stop 2023-09-12T16:08:02.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.955+0000 7fa0931ff700 1 -- 172.21.15.112:0/3109495375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08c0cdfb0 msgr2=0x7fa08c15b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:02.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.955+0000 7fa0931ff700 1 --2- 172.21.15.112:0/3109495375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08c0cdfb0 0x7fa08c15b6f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa08c08b1f0 tx=0x7fa078005020 comp rx=0 tx=0).stop 2023-09-12T16:08:02.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.955+0000 7fa0931ff700 1 -- 172.21.15.112:0/3109495375 shutdown_connections 2023-09-12T16:08:02.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.955+0000 7fa0931ff700 1 --2- 172.21.15.112:0/3109495375 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa07006a580 0x7fa07006ca40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:02.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.955+0000 7fa0931ff700 1 --2- 172.21.15.112:0/3109495375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa08c0b28f0 0x7fa08c0b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:02.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.955+0000 7fa0931ff700 1 --2- 172.21.15.112:0/3109495375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa08c15f480 0x7fa08c15ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:02.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.955+0000 7fa0931ff700 1 --2- 172.21.15.112:0/3109495375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08c0cdfb0 0x7fa08c15b6f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:02.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.955+0000 7fa0931ff700 1 -- 172.21.15.112:0/3109495375 >> 172.21.15.112:0/3109495375 conn(0x7fa08c0d1930 msgr2=0x7fa08c15e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:02.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.955+0000 7fa0931ff700 1 -- 172.21.15.112:0/3109495375 shutdown_connections 2023-09-12T16:08:02.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:01.955+0000 7fa0931ff700 1 -- 172.21.15.112:0/3109495375 wait complete. 2023-09-12T16:08:02.101 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-12T16:08:02.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.309+0000 7f72ad1ff700 1 -- 172.21.15.112:0/3233048341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72a80cfdb0 msgr2=0x7f72a80d0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:02.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.309+0000 7f72ad1ff700 1 --2- 172.21.15.112:0/3233048341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72a80cfdb0 0x7f72a80d0200 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009fd0 tx=0x7f72a000b380 comp rx=0 tx=0).stop 2023-09-12T16:08:02.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.309+0000 7f72ad1ff700 1 -- 172.21.15.112:0/3233048341 shutdown_connections 2023-09-12T16:08:02.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.309+0000 7f72ad1ff700 1 --2- 172.21.15.112:0/3233048341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72a80cfdb0 0x7f72a80d0200 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:02.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.309+0000 7f72ad1ff700 1 --2- 172.21.15.112:0/3233048341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72a815bca0 0x7f72a815cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:02.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.309+0000 7f72ad1ff700 1 -- 172.21.15.112:0/3233048341 >> 172.21.15.112:0/3233048341 conn(0x7f72a80d17d0 msgr2=0x7f72a80d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:02.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.309+0000 7f72ad1ff700 1 -- 172.21.15.112:0/3233048341 shutdown_connections 2023-09-12T16:08:02.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.309+0000 7f72ad1ff700 1 -- 172.21.15.112:0/3233048341 wait complete. 2023-09-12T16:08:02.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.311+0000 7f72ad1ff700 1 Processor -- start 2023-09-12T16:08:02.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.312+0000 7f72ad1ff700 1 -- start start 2023-09-12T16:08:02.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.313+0000 7f72ad1ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72a80cfdb0 0x7f72a80c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:02.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.313+0000 7f72ad1ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72a815bca0 0x7f72a81e6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:02.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.313+0000 7f72ad1ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72a80cb250 0x7f72a81f5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:02.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.313+0000 7f72ad1ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a81e74b0 con 0x7f72a80cb250 2023-09-12T16:08:02.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.313+0000 7f72ad1ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a80c8950 con 0x7f72a815bca0 2023-09-12T16:08:02.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.313+0000 7f72ad1ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a80c97b0 con 0x7f72a80cfdb0 2023-09-12T16:08:02.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.313+0000 7f72a759e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72a80cb250 0x7f72a81f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:02.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.313+0000 7f72a759e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72a80cb250 0x7f72a81f5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54030/0 (socket says 172.21.15.112:54030) 2023-09-12T16:08:02.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.313+0000 7f72a759e700 1 -- 172.21.15.112:0/3567743406 learned_addr learned my addr 172.21.15.112:0/3567743406 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:02.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.313+0000 7f72a759e700 1 -- 172.21.15.112:0/3567743406 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72a80cfdb0 msgr2=0x7f72a80c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:02.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.313+0000 7f72a759e700 1 --2- 172.21.15.112:0/3567743406 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72a80cfdb0 0x7f72a80c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:02.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.313+0000 7f72a759e700 1 -- 172.21.15.112:0/3567743406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72a815bca0 msgr2=0x7f72a81e6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:02.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.313+0000 7f72a659c700 1 --2- 172.21.15.112:0/3567743406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72a815bca0 0x7f72a81e6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:02.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.313+0000 7f72a759e700 1 --2- 172.21.15.112:0/3567743406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72a815bca0 0x7f72a81e6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:02.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.313+0000 7f72a759e700 1 -- 172.21.15.112:0/3567743406 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a0009d00 con 0x7f72a80cb250 2023-09-12T16:08:02.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.314+0000 7f72a659c700 1 --2- 172.21.15.112:0/3567743406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72a815bca0 0x7f72a81e6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:02.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.314+0000 7f72a759e700 1 --2- 172.21.15.112:0/3567743406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72a80cb250 0x7f72a81f5620 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f72a000b070 tx=0x7f72a0007b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:02.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.314+0000 7f728f7fe700 1 -- 172.21.15.112:0/3567743406 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a000e040 con 0x7f72a80cb250 2023-09-12T16:08:02.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.314+0000 7f728f7fe700 1 -- 172.21.15.112:0/3567743406 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f72a001d890 con 0x7f72a80cb250 2023-09-12T16:08:02.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.314+0000 7f728f7fe700 1 -- 172.21.15.112:0/3567743406 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a001dca0 con 0x7f72a80cb250 2023-09-12T16:08:02.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.314+0000 7f72ad1ff700 1 -- 172.21.15.112:0/3567743406 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a80c8ba0 con 0x7f72a80cb250 2023-09-12T16:08:02.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.314+0000 7f72ad1ff700 1 -- 172.21.15.112:0/3567743406 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a80c9160 con 0x7f72a80cb250 2023-09-12T16:08:02.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.315+0000 7f72ad1ff700 1 -- 172.21.15.112:0/3567743406 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a80ca180 con 0x7f72a80cb250 2023-09-12T16:08:02.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.316+0000 7f728f7fe700 1 -- 172.21.15.112:0/3567743406 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f72a001b450 con 0x7f72a80cb250 2023-09-12T16:08:02.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.317+0000 7f728f7fe700 1 --2- 172.21.15.112:0/3567743406 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f729406a580 0x7f729406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:02.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.317+0000 7f728f7fe700 1 -- 172.21.15.112:0/3567743406 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f72a008aba0 con 0x7f72a80cb250 2023-09-12T16:08:02.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.317+0000 7f72a6d9d700 1 --2- 172.21.15.112:0/3567743406 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f729406a580 0x7f729406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:02.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.318+0000 7f72a6d9d700 1 --2- 172.21.15.112:0/3567743406 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f729406a580 0x7f729406ca40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7298005950 tx=0x7f72980058e0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:02.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.322+0000 7f728f7fe700 1 -- 172.21.15.112:0/3567743406 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f72a0055d40 con 0x7f72a80cb250 2023-09-12T16:08:02.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.516+0000 7f72ad1ff700 1 -- 172.21.15.112:0/3567743406 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f72a80c98f0 con 0x7f72a80cb250 2023-09-12T16:08:02.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.520+0000 7f728f7fe700 1 -- 172.21.15.112:0/3567743406 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v31)=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7f72a80c98f0 con 0x7f72a80cb250 2023-09-12T16:08:02.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.523+0000 7f72ad1ff700 1 -- 172.21.15.112:0/3567743406 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f729406a580 msgr2=0x7f729406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:02.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.523+0000 7f72ad1ff700 1 --2- 172.21.15.112:0/3567743406 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f729406a580 0x7f729406ca40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7298005950 tx=0x7f72980058e0 comp rx=0 tx=0).stop 2023-09-12T16:08:02.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.523+0000 7f72ad1ff700 1 -- 172.21.15.112:0/3567743406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72a80cb250 msgr2=0x7f72a81f5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:02.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.523+0000 7f72ad1ff700 1 --2- 172.21.15.112:0/3567743406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72a80cb250 0x7f72a81f5620 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f72a000b070 tx=0x7f72a0007b80 comp rx=0 tx=0).stop 2023-09-12T16:08:02.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.523+0000 7f72ad1ff700 1 -- 172.21.15.112:0/3567743406 shutdown_connections 2023-09-12T16:08:02.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.523+0000 7f72ad1ff700 1 --2- 172.21.15.112:0/3567743406 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f729406a580 0x7f729406ca40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:02.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.523+0000 7f72ad1ff700 1 --2- 172.21.15.112:0/3567743406 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72a80cfdb0 0x7f72a80c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:02.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.523+0000 7f72ad1ff700 1 --2- 172.21.15.112:0/3567743406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72a80cb250 0x7f72a81f5620 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:02.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.523+0000 7f72ad1ff700 1 --2- 172.21.15.112:0/3567743406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72a815bca0 0x7f72a81e6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:02.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.523+0000 7f72ad1ff700 1 -- 172.21.15.112:0/3567743406 >> 172.21.15.112:0/3567743406 conn(0x7f72a80d17d0 msgr2=0x7f72a80b6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:02.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.523+0000 7f72ad1ff700 1 -- 172.21.15.112:0/3567743406 shutdown_connections 2023-09-12T16:08:02.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:02.523+0000 7f72ad1ff700 1 -- 172.21.15.112:0/3567743406 wait complete. 2023-09-12T16:08:02.542 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-12T16:08:02.542 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-12T16:08:02.638 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-12T16:08:02.746 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-12T16:08:02.747 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:08:02.747 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T16:08:02.795 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:08:02.795 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T16:08:02.881 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:08:02.882 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T16:08:02.968 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:08:03.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.221+0000 7fcbfc7ff700 1 -- 172.21.15.112:0/3000604248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbf40886c0 msgr2=0x7fcbf40cd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:03.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.221+0000 7fcbfc7ff700 1 --2- 172.21.15.112:0/3000604248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbf40886c0 0x7fcbf40cd440 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40aff30 tx=0x7fcbec00b380 comp rx=0 tx=0).stop 2023-09-12T16:08:03.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.221+0000 7fcbfc7ff700 1 -- 172.21.15.112:0/3000604248 shutdown_connections 2023-09-12T16:08:03.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.221+0000 7fcbfc7ff700 1 --2- 172.21.15.112:0/3000604248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbf40886c0 0x7fcbf40cd440 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:03.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.221+0000 7fcbfc7ff700 1 --2- 172.21.15.112:0/3000604248 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbf40af310 0x7fcbf40cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:03.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.221+0000 7fcbfc7ff700 1 --2- 172.21.15.112:0/3000604248 >> v2:172.21.15.144:3300/0 conn(0x7fcbf40cc980 0x7fcbf40af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:03.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.221+0000 7fcbfc7ff700 1 -- 172.21.15.112:0/3000604248 >> 172.21.15.112:0/3000604248 conn(0x7fcbf406a200 msgr2=0x7fcbf406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:03.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.221+0000 7fcbfc7ff700 1 -- 172.21.15.112:0/3000604248 shutdown_connections 2023-09-12T16:08:03.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.221+0000 7fcbfc7ff700 1 -- 172.21.15.112:0/3000604248 wait complete. 2023-09-12T16:08:03.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.223+0000 7fcbfc7ff700 1 Processor -- start 2023-09-12T16:08:03.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.223+0000 7fcbfc7ff700 1 -- start start 2023-09-12T16:08:03.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.224+0000 7fcbfc7ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbf40886c0 0x7fcbf41f4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:03.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.224+0000 7fcbfc7ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbf40af310 0x7fcbf40c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:03.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.224+0000 7fcbfc7ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbf40cc980 0x7fcbf40c3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:03.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.224+0000 7fcbfc7ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf41f1d00 con 0x7fcbf40886c0 2023-09-12T16:08:03.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.224+0000 7fcbfc7ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf41f1fe0 con 0x7fcbf40cc980 2023-09-12T16:08:03.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.224+0000 7fcbfc7ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf41f22c0 con 0x7fcbf40af310 2023-09-12T16:08:03.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.224+0000 7fcbfa59b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbf40886c0 0x7fcbf41f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:03.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.224+0000 7fcbfa59b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbf40886c0 0x7fcbf41f4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54044/0 (socket says 172.21.15.112:54044) 2023-09-12T16:08:03.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.224+0000 7fcbfa59b700 1 -- 172.21.15.112:0/549209394 learned_addr learned my addr 172.21.15.112:0/549209394 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:03.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.224+0000 7fcbf9d9a700 1 --2- 172.21.15.112:0/549209394 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbf40af310 0x7fcbf40c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:03.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.224+0000 7fcbfad9c700 1 --2- 172.21.15.112:0/549209394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbf40cc980 0x7fcbf40c3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:03.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.225+0000 7fcbfa59b700 1 -- 172.21.15.112:0/549209394 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbf40af310 msgr2=0x7fcbf40c2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:03.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.225+0000 7fcbfa59b700 1 --2- 172.21.15.112:0/549209394 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbf40af310 0x7fcbf40c2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:03.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.225+0000 7fcbfa59b700 1 -- 172.21.15.112:0/549209394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbf40cc980 msgr2=0x7fcbf40c3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:03.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.225+0000 7fcbfa59b700 1 --2- 172.21.15.112:0/549209394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbf40cc980 0x7fcbf40c3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:03.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.225+0000 7fcbfa59b700 1 -- 172.21.15.112:0/549209394 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec009d00 con 0x7fcbf40886c0 2023-09-12T16:08:03.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.225+0000 7fcbfa59b700 1 --2- 172.21.15.112:0/549209394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbf40886c0 0x7fcbf41f4660 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000abe0 tx=0x7fcbf00071c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:03.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.225+0000 7fcbeaffd700 1 -- 172.21.15.112:0/549209394 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0010070 con 0x7fcbf40886c0 2023-09-12T16:08:03.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.225+0000 7fcbeaffd700 1 -- 172.21.15.112:0/549209394 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcbf0007aa0 con 0x7fcbf40886c0 2023-09-12T16:08:03.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.225+0000 7fcbfc7ff700 1 -- 172.21.15.112:0/549209394 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf41f25a0 con 0x7fcbf40886c0 2023-09-12T16:08:03.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.225+0000 7fcbeaffd700 1 -- 172.21.15.112:0/549209394 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0014410 con 0x7fcbf40886c0 2023-09-12T16:08:03.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.225+0000 7fcbfc7ff700 1 -- 172.21.15.112:0/549209394 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf41f4ba0 con 0x7fcbf40886c0 2023-09-12T16:08:03.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.226+0000 7fcbfc7ff700 1 -- 172.21.15.112:0/549209394 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf40cd2b0 con 0x7fcbf40886c0 2023-09-12T16:08:03.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.227+0000 7fcbeaffd700 1 -- 172.21.15.112:0/549209394 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fcbf0014570 con 0x7fcbf40886c0 2023-09-12T16:08:03.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.228+0000 7fcbeaffd700 1 --2- 172.21.15.112:0/549209394 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcbd806a580 0x7fcbd806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:03.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.228+0000 7fcbeaffd700 1 -- 172.21.15.112:0/549209394 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fcbf0088a50 con 0x7fcbf40886c0 2023-09-12T16:08:03.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.228+0000 7fcbf9d9a700 1 --2- 172.21.15.112:0/549209394 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcbd806a580 0x7fcbd806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:03.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.229+0000 7fcbf9d9a700 1 --2- 172.21.15.112:0/549209394 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcbd806a580 0x7fcbd806ca40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcbf41f1520 tx=0x7fcbe4005d20 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:03.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.232+0000 7fcbeaffd700 1 -- 172.21.15.112:0/549209394 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fcbf0053c00 con 0x7fcbf40886c0 2023-09-12T16:08:03.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.430+0000 7fcbfc7ff700 1 -- 172.21.15.112:0/549209394 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbf404e300 con 0x7fcbf40886c0 2023-09-12T16:08:03.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.431+0000 7fcbeaffd700 1 -- 172.21.15.112:0/549209394 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18816 (secure 0 0 0) 0x7fcbf0019090 con 0x7fcbf40886c0 2023-09-12T16:08:03.431 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:03.432 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:44.445226+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:08:03.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.433+0000 7fcbfc7ff700 1 -- 172.21.15.112:0/549209394 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcbd806a580 msgr2=0x7fcbd806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:03.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.433+0000 7fcbfc7ff700 1 --2- 172.21.15.112:0/549209394 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcbd806a580 0x7fcbd806ca40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcbf41f1520 tx=0x7fcbe4005d20 comp rx=0 tx=0).stop 2023-09-12T16:08:03.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.433+0000 7fcbfc7ff700 1 -- 172.21.15.112:0/549209394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbf40886c0 msgr2=0x7fcbf41f4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:03.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.433+0000 7fcbfc7ff700 1 --2- 172.21.15.112:0/549209394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbf40886c0 0x7fcbf41f4660 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000abe0 tx=0x7fcbf00071c0 comp rx=0 tx=0).stop 2023-09-12T16:08:03.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.433+0000 7fcbfc7ff700 1 -- 172.21.15.112:0/549209394 shutdown_connections 2023-09-12T16:08:03.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.433+0000 7fcbfc7ff700 1 --2- 172.21.15.112:0/549209394 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcbd806a580 0x7fcbd806ca40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:03.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.433+0000 7fcbfc7ff700 1 --2- 172.21.15.112:0/549209394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbf40cc980 0x7fcbf40c3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:03.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.433+0000 7fcbfc7ff700 1 --2- 172.21.15.112:0/549209394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbf40886c0 0x7fcbf41f4660 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:03.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.433+0000 7fcbfc7ff700 1 --2- 172.21.15.112:0/549209394 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbf40af310 0x7fcbf40c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:03.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.433+0000 7fcbfc7ff700 1 -- 172.21.15.112:0/549209394 >> 172.21.15.112:0/549209394 conn(0x7fcbf406a200 msgr2=0x7fcbf40b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:03.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.433+0000 7fcbfc7ff700 1 -- 172.21.15.112:0/549209394 shutdown_connections 2023-09-12T16:08:03.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.433+0000 7fcbfc7ff700 1 -- 172.21.15.112:0/549209394 wait complete. 2023-09-12T16:08:03.452 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-12T16:06:48.871680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-12T16:06:58.137223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-12T16:06:58.684034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-12T16:07:02.283459+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-12T16:08:03.453 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-12T16:08:03.655 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.655+0000 7fcfb99ff700 1 -- 172.21.15.112:0/2097303467 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcfb40cf5b0 msgr2=0x7fcfb40cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:03.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.655+0000 7fcfb99ff700 1 --2- 172.21.15.112:0/2097303467 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcfb40cf5b0 0x7fcfb40cebc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80098c0 tx=0x7fcfa8009bd0 comp rx=0 tx=0).stop 2023-09-12T16:08:03.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.655+0000 7fcfb99ff700 1 -- 172.21.15.112:0/2097303467 shutdown_connections 2023-09-12T16:08:03.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.655+0000 7fcfb99ff700 1 --2- 172.21.15.112:0/2097303467 >> v2:172.21.15.144:3300/0 conn(0x7fcfb415bca0 0x7fcfb415cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:03.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.655+0000 7fcfb99ff700 1 --2- 172.21.15.112:0/2097303467 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcfb40cf5b0 0x7fcfb40cebc0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:03.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.655+0000 7fcfb99ff700 1 -- 172.21.15.112:0/2097303467 >> 172.21.15.112:0/2097303467 conn(0x7fcfb40d17d0 msgr2=0x7fcfb40d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:03.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.655+0000 7fcfb99ff700 1 -- 172.21.15.112:0/2097303467 shutdown_connections 2023-09-12T16:08:03.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.655+0000 7fcfb99ff700 1 -- 172.21.15.112:0/2097303467 wait complete. 2023-09-12T16:08:03.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.657+0000 7fcfb99ff700 1 Processor -- start 2023-09-12T16:08:03.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.658+0000 7fcfb99ff700 1 -- start start 2023-09-12T16:08:03.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.659+0000 7fcfb99ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfb40cfdb0 0x7fcfb4156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:03.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.659+0000 7fcfb99ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfb415bca0 0x7fcfb40c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:03.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.659+0000 7fcfb99ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcfb40c6450 0x7fcfb40c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:03.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.659+0000 7fcfb99ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb4157100 con 0x7fcfb415bca0 2023-09-12T16:08:03.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.659+0000 7fcfb99ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40b3ae0 con 0x7fcfb40cfdb0 2023-09-12T16:08:03.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.659+0000 7fcfb99ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40b3800 con 0x7fcfb40c6450 2023-09-12T16:08:03.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.659+0000 7fcfb27fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfb415bca0 0x7fcfb40c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:03.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.659+0000 7fcfb27fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfb415bca0 0x7fcfb40c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54052/0 (socket says 172.21.15.112:54052) 2023-09-12T16:08:03.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.659+0000 7fcfb27fc700 1 -- 172.21.15.112:0/2984279224 learned_addr learned my addr 172.21.15.112:0/2984279224 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:03.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.659+0000 7fcfb2ffd700 1 --2- 172.21.15.112:0/2984279224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfb40cfdb0 0x7fcfb4156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:03.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.659+0000 7fcfb37fe700 1 --2- 172.21.15.112:0/2984279224 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcfb40c6450 0x7fcfb40c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:03.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.660+0000 7fcfb27fc700 1 -- 172.21.15.112:0/2984279224 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcfb40c6450 msgr2=0x7fcfb40c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:03.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.660+0000 7fcfb27fc700 1 --2- 172.21.15.112:0/2984279224 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcfb40c6450 0x7fcfb40c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:03.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.660+0000 7fcfb27fc700 1 -- 172.21.15.112:0/2984279224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfb40cfdb0 msgr2=0x7fcfb4156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:03.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.660+0000 7fcfb27fc700 1 --2- 172.21.15.112:0/2984279224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfb40cfdb0 0x7fcfb4156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:03.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.660+0000 7fcfb27fc700 1 -- 172.21.15.112:0/2984279224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa8009520 con 0x7fcfb415bca0 2023-09-12T16:08:03.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.660+0000 7fcfb27fc700 1 --2- 172.21.15.112:0/2984279224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfb415bca0 0x7fcfb40c5f10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8009230 tx=0x7fcfa800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:03.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.660+0000 7fcf9bfff700 1 -- 172.21.15.112:0/2984279224 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8025070 con 0x7fcfb415bca0 2023-09-12T16:08:03.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.660+0000 7fcfb99ff700 1 -- 172.21.15.112:0/2984279224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb40c5430 con 0x7fcfb415bca0 2023-09-12T16:08:03.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.660+0000 7fcf9bfff700 1 -- 172.21.15.112:0/2984279224 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcfa800fb40 con 0x7fcfb415bca0 2023-09-12T16:08:03.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.660+0000 7fcf9bfff700 1 -- 172.21.15.112:0/2984279224 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa801b040 con 0x7fcfb415bca0 2023-09-12T16:08:03.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.660+0000 7fcfb99ff700 1 -- 172.21.15.112:0/2984279224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb40c59f0 con 0x7fcfb415bca0 2023-09-12T16:08:03.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.661+0000 7fcfb99ff700 1 -- 172.21.15.112:0/2984279224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb40d2110 con 0x7fcfb415bca0 2023-09-12T16:08:03.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.662+0000 7fcf9bfff700 1 -- 172.21.15.112:0/2984279224 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fcfa8004830 con 0x7fcfb415bca0 2023-09-12T16:08:03.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.663+0000 7fcf9bfff700 1 --2- 172.21.15.112:0/2984279224 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcfa006a580 0x7fcfa006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:03.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.663+0000 7fcf9bfff700 1 -- 172.21.15.112:0/2984279224 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fcfa808aba0 con 0x7fcfb415bca0 2023-09-12T16:08:03.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.664+0000 7fcfb2ffd700 1 --2- 172.21.15.112:0/2984279224 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcfa006a580 0x7fcfa006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:03.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.664+0000 7fcfb2ffd700 1 --2- 172.21.15.112:0/2984279224 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcfa006a580 0x7fcfa006ca40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40cb390 tx=0x7fcfa4009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:03.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.667+0000 7fcf9bfff700 1 -- 172.21.15.112:0/2984279224 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fcfa8055cb0 con 0x7fcfb415bca0 2023-09-12T16:08:03.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.864+0000 7fcfb99ff700 1 -- 172.21.15.112:0/2984279224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcfb40c5be0 con 0x7fcfb415bca0 2023-09-12T16:08:03.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.864+0000 7fcf9bfff700 1 -- 172.21.15.112:0/2984279224 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcfa80592d0 con 0x7fcfb415bca0 2023-09-12T16:08:03.865 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-09-12T16:08:03.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.867+0000 7fcfb99ff700 1 -- 172.21.15.112:0/2984279224 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcfa006a580 msgr2=0x7fcfa006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:03.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.867+0000 7fcfb99ff700 1 --2- 172.21.15.112:0/2984279224 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcfa006a580 0x7fcfa006ca40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40cb390 tx=0x7fcfa4009260 comp rx=0 tx=0).stop 2023-09-12T16:08:03.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.867+0000 7fcfb99ff700 1 -- 172.21.15.112:0/2984279224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfb415bca0 msgr2=0x7fcfb40c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:03.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.867+0000 7fcfb99ff700 1 --2- 172.21.15.112:0/2984279224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfb415bca0 0x7fcfb40c5f10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8009230 tx=0x7fcfa800f690 comp rx=0 tx=0).stop 2023-09-12T16:08:03.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.867+0000 7fcfb99ff700 1 -- 172.21.15.112:0/2984279224 shutdown_connections 2023-09-12T16:08:03.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.867+0000 7fcfb99ff700 1 --2- 172.21.15.112:0/2984279224 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcfa006a580 0x7fcfa006ca40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:03.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.867+0000 7fcfb99ff700 1 --2- 172.21.15.112:0/2984279224 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcfb40c6450 0x7fcfb40c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:03.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.867+0000 7fcfb99ff700 1 --2- 172.21.15.112:0/2984279224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfb40cfdb0 0x7fcfb4156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:03.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.867+0000 7fcfb99ff700 1 --2- 172.21.15.112:0/2984279224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfb415bca0 0x7fcfb40c5f10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:03.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.867+0000 7fcfb99ff700 1 -- 172.21.15.112:0/2984279224 >> 172.21.15.112:0/2984279224 conn(0x7fcfb40d17d0 msgr2=0x7fcfb40b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:03.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.867+0000 7fcfb99ff700 1 -- 172.21.15.112:0/2984279224 shutdown_connections 2023-09-12T16:08:03.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:03.867+0000 7fcfb99ff700 1 -- 172.21.15.112:0/2984279224 wait complete. 2023-09-12T16:08:03.885 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-12T16:08:04.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.088+0000 7f59bcfff700 1 -- 172.21.15.112:0/3929581649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59b80cf5b0 msgr2=0x7f59b80cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:04.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.088+0000 7f59bcfff700 1 --2- 172.21.15.112:0/3929581649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59b80cf5b0 0x7f59b80cebc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f59b808bf50 tx=0x7f59ac009c70 comp rx=0 tx=0).stop 2023-09-12T16:08:04.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.088+0000 7f59bcfff700 1 -- 172.21.15.112:0/3929581649 shutdown_connections 2023-09-12T16:08:04.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.088+0000 7f59bcfff700 1 --2- 172.21.15.112:0/3929581649 >> v2:172.21.15.144:3300/0 conn(0x7f59b815bca0 0x7f59b815cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:04.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.088+0000 7f59bcfff700 1 --2- 172.21.15.112:0/3929581649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59b80cf5b0 0x7f59b80cebc0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:04.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.088+0000 7f59bcfff700 1 -- 172.21.15.112:0/3929581649 >> 172.21.15.112:0/3929581649 conn(0x7f59b80d17d0 msgr2=0x7f59b80d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:04.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.088+0000 7f59bcfff700 1 -- 172.21.15.112:0/3929581649 shutdown_connections 2023-09-12T16:08:04.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.088+0000 7f59bcfff700 1 -- 172.21.15.112:0/3929581649 wait complete. 2023-09-12T16:08:04.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.089+0000 7f59bcfff700 1 Processor -- start 2023-09-12T16:08:04.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.090+0000 7f59bcfff700 1 -- start start 2023-09-12T16:08:04.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.091+0000 7f59bcfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59b80cfdb0 0x7f59b80c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:04.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.091+0000 7f59bcfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59b815bca0 0x7f59b815d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:04.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.091+0000 7f59bcfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59b81f2880 0x7f59b8158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:04.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.091+0000 7f59bcfff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b815e240 con 0x7f59b81f2880 2023-09-12T16:08:04.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.091+0000 7f59bcfff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b81f2d10 con 0x7f59b80cfdb0 2023-09-12T16:08:04.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.091+0000 7f59bcfff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b815d9a0 con 0x7f59b815bca0 2023-09-12T16:08:04.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.091+0000 7f59b6d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59b81f2880 0x7f59b8158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:04.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.091+0000 7f59b6d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59b81f2880 0x7f59b8158660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54064/0 (socket says 172.21.15.112:54064) 2023-09-12T16:08:04.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.091+0000 7f59b6d9d700 1 -- 172.21.15.112:0/3592045275 learned_addr learned my addr 172.21.15.112:0/3592045275 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:04.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.091+0000 7f59b6d9d700 1 -- 172.21.15.112:0/3592045275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59b815bca0 msgr2=0x7f59b815d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:04.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.091+0000 7f59b659c700 1 --2- 172.21.15.112:0/3592045275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59b80cfdb0 0x7f59b80c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:04.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.091+0000 7f59b6d9d700 1 --2- 172.21.15.112:0/3592045275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59b815bca0 0x7f59b815d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:04.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.091+0000 7f59b6d9d700 1 -- 172.21.15.112:0/3592045275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59b80cfdb0 msgr2=0x7f59b80c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:04.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.091+0000 7f59b6d9d700 1 --2- 172.21.15.112:0/3592045275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59b80cfdb0 0x7f59b80c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:04.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.091+0000 7f59b6d9d700 1 -- 172.21.15.112:0/3592045275 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ac0095f0 con 0x7f59b81f2880 2023-09-12T16:08:04.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.091+0000 7f59b659c700 1 --2- 172.21.15.112:0/3592045275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59b80cfdb0 0x7f59b80c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:04.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.092+0000 7f59b6d9d700 1 --2- 172.21.15.112:0/3592045275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59b81f2880 0x7f59b8158660 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f59b000c7a0 tx=0x7f59b000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:04.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.092+0000 7f59a6ffd700 1 -- 172.21.15.112:0/3592045275 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b0003e10 con 0x7f59b81f2880 2023-09-12T16:08:04.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.092+0000 7f59a6ffd700 1 -- 172.21.15.112:0/3592045275 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f59b0005180 con 0x7f59b81f2880 2023-09-12T16:08:04.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.092+0000 7f59bcfff700 1 -- 172.21.15.112:0/3592045275 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b815dc80 con 0x7f59b81f2880 2023-09-12T16:08:04.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.092+0000 7f59a6ffd700 1 -- 172.21.15.112:0/3592045275 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b0005590 con 0x7f59b81f2880 2023-09-12T16:08:04.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.092+0000 7f59bcfff700 1 -- 172.21.15.112:0/3592045275 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b815eeb0 con 0x7f59b81f2880 2023-09-12T16:08:04.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.093+0000 7f59bcfff700 1 -- 172.21.15.112:0/3592045275 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b815f0a0 con 0x7f59b81f2880 2023-09-12T16:08:04.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.094+0000 7f59a6ffd700 1 -- 172.21.15.112:0/3592045275 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f59b00056f0 con 0x7f59b81f2880 2023-09-12T16:08:04.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.095+0000 7f59a6ffd700 1 --2- 172.21.15.112:0/3592045275 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f599806a580 0x7f599806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:04.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.095+0000 7f59a6ffd700 1 -- 172.21.15.112:0/3592045275 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f59b0088830 con 0x7f59b81f2880 2023-09-12T16:08:04.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.095+0000 7f59b659c700 1 --2- 172.21.15.112:0/3592045275 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f599806a580 0x7f599806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:04.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.096+0000 7f59b659c700 1 --2- 172.21.15.112:0/3592045275 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f599806a580 0x7f599806ca40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f59a800a8f0 tx=0x7f59a8008040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:04.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.099+0000 7f59a6ffd700 1 -- 172.21.15.112:0/3592045275 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f59b00539c0 con 0x7f59b81f2880 2023-09-12T16:08:04.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.299+0000 7f59bcfff700 1 -- 172.21.15.112:0/3592045275 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f59b8073ea0 con 0x7f59b81f2880 2023-09-12T16:08:04.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.299+0000 7f59a6ffd700 1 -- 172.21.15.112:0/3592045275 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f59b0017020 con 0x7f59b81f2880 2023-09-12T16:08:04.300 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:08:04.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.301+0000 7f59bcfff700 1 -- 172.21.15.112:0/3592045275 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f599806a580 msgr2=0x7f599806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:04.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.301+0000 7f59bcfff700 1 --2- 172.21.15.112:0/3592045275 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f599806a580 0x7f599806ca40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f59a800a8f0 tx=0x7f59a8008040 comp rx=0 tx=0).stop 2023-09-12T16:08:04.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.301+0000 7f59bcfff700 1 -- 172.21.15.112:0/3592045275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59b81f2880 msgr2=0x7f59b8158660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:04.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.301+0000 7f59bcfff700 1 --2- 172.21.15.112:0/3592045275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59b81f2880 0x7f59b8158660 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f59b000c7a0 tx=0x7f59b000cb60 comp rx=0 tx=0).stop 2023-09-12T16:08:04.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.301+0000 7f59bcfff700 1 -- 172.21.15.112:0/3592045275 shutdown_connections 2023-09-12T16:08:04.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.301+0000 7f59bcfff700 1 --2- 172.21.15.112:0/3592045275 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f599806a580 0x7f599806ca40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:04.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.301+0000 7f59bcfff700 1 --2- 172.21.15.112:0/3592045275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59b81f2880 0x7f59b8158660 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:04.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.301+0000 7f59bcfff700 1 --2- 172.21.15.112:0/3592045275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59b80cfdb0 0x7f59b80c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:04.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.301+0000 7f59bcfff700 1 --2- 172.21.15.112:0/3592045275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59b815bca0 0x7f59b815d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:04.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.301+0000 7f59bcfff700 1 -- 172.21.15.112:0/3592045275 >> 172.21.15.112:0/3592045275 conn(0x7f59b80d17d0 msgr2=0x7f59b80afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:04.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.302+0000 7f59bcfff700 1 -- 172.21.15.112:0/3592045275 shutdown_connections 2023-09-12T16:08:04.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.302+0000 7f59bcfff700 1 -- 172.21.15.112:0/3592045275 wait complete. 2023-09-12T16:08:04.320 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-12T16:08:04.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.523+0000 7fc9f19ff700 1 -- 172.21.15.112:0/492993441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9d80051d0 msgr2=0x7fc9d800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:04.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.523+0000 7fc9f19ff700 1 --2- 172.21.15.112:0/492993441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9d80051d0 0x7fc9d800ba10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400e350 tx=0x7fc9d8005880 comp rx=0 tx=0).stop 2023-09-12T16:08:04.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.523+0000 7fc9eb7fe700 1 -- 172.21.15.112:0/492993441 reap_dead start 2023-09-12T16:08:04.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.523+0000 7fc9f19ff700 1 -- 172.21.15.112:0/492993441 shutdown_connections 2023-09-12T16:08:04.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.523+0000 7fc9f19ff700 1 -- 172.21.15.112:0/492993441 >> 172.21.15.112:0/492993441 conn(0x7fc9ec0d17d0 msgr2=0x7fc9ec0d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:04.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.523+0000 7fc9f19ff700 1 -- 172.21.15.112:0/492993441 shutdown_connections 2023-09-12T16:08:04.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.523+0000 7fc9f19ff700 1 -- 172.21.15.112:0/492993441 wait complete. 2023-09-12T16:08:04.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.524+0000 7fc9f19ff700 1 Processor -- start 2023-09-12T16:08:04.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.525+0000 7fc9f19ff700 1 -- start start 2023-09-12T16:08:04.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.525+0000 7fc9f19ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9d80051d0 0x7fc9ec14a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:04.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.525+0000 7fc9f19ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9ec09edb0 0x7fc9ec0cab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:04.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.526+0000 7fc9f19ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9ec0cb070 0x7fc9ec15e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:04.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.526+0000 7fc9f19ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec15ae10 con 0x7fc9ec0cb070 2023-09-12T16:08:04.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.526+0000 7fc9f19ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec0cb4f0 con 0x7fc9ec09edb0 2023-09-12T16:08:04.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.526+0000 7fc9f19ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec1e5dc0 con 0x7fc9d80051d0 2023-09-12T16:08:04.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.526+0000 7fc9eb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9ec0cb070 0x7fc9ec15e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:04.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.526+0000 7fc9eb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9ec0cb070 0x7fc9ec15e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54070/0 (socket says 172.21.15.112:54070) 2023-09-12T16:08:04.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.526+0000 7fc9eb7fe700 1 -- 172.21.15.112:0/2252316282 learned_addr learned my addr 172.21.15.112:0/2252316282 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:04.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.526+0000 7fc9e3fff700 1 --2- 172.21.15.112:0/2252316282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9ec09edb0 0x7fc9ec0cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:04.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.526+0000 7fc9eaffd700 1 --2- 172.21.15.112:0/2252316282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9d80051d0 0x7fc9ec14a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:04.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.526+0000 7fc9eb7fe700 1 -- 172.21.15.112:0/2252316282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9d80051d0 msgr2=0x7fc9ec14a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:04.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.526+0000 7fc9eb7fe700 1 --2- 172.21.15.112:0/2252316282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9d80051d0 0x7fc9ec14a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:04.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.526+0000 7fc9eb7fe700 1 -- 172.21.15.112:0/2252316282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9ec09edb0 msgr2=0x7fc9ec0cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:04.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.526+0000 7fc9eb7fe700 1 --2- 172.21.15.112:0/2252316282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9ec09edb0 0x7fc9ec0cab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:04.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.526+0000 7fc9eb7fe700 1 -- 172.21.15.112:0/2252316282 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ec15f0d0 con 0x7fc9ec0cb070 2023-09-12T16:08:04.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.526+0000 7fc9eaffd700 1 --2- 172.21.15.112:0/2252316282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9d80051d0 0x7fc9ec14a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:08:04.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.527+0000 7fc9eb7fe700 1 --2- 172.21.15.112:0/2252316282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9ec0cb070 0x7fc9ec15e470 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4009040 tx=0x7fc9e40093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:04.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.527+0000 7fc9e8ff9700 1 -- 172.21.15.112:0/2252316282 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4022070 con 0x7fc9ec0cb070 2023-09-12T16:08:04.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.527+0000 7fc9e8ff9700 1 -- 172.21.15.112:0/2252316282 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc9e4019040 con 0x7fc9ec0cb070 2023-09-12T16:08:04.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.527+0000 7fc9f19ff700 1 -- 172.21.15.112:0/2252316282 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ec1e5490 con 0x7fc9ec0cb070 2023-09-12T16:08:04.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.527+0000 7fc9e8ff9700 1 -- 172.21.15.112:0/2252316282 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4018070 con 0x7fc9ec0cb070 2023-09-12T16:08:04.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.527+0000 7fc9f19ff700 1 -- 172.21.15.112:0/2252316282 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ec1e5a50 con 0x7fc9ec0cb070 2023-09-12T16:08:04.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.528+0000 7fc9f19ff700 1 -- 172.21.15.112:0/2252316282 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ec073ea0 con 0x7fc9ec0cb070 2023-09-12T16:08:04.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.529+0000 7fc9e8ff9700 1 -- 172.21.15.112:0/2252316282 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fc9e4007500 con 0x7fc9ec0cb070 2023-09-12T16:08:04.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.530+0000 7fc9e8ff9700 1 --2- 172.21.15.112:0/2252316282 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc9cc06a580 0x7fc9cc06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:04.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.530+0000 7fc9e8ff9700 1 -- 172.21.15.112:0/2252316282 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc9e4089950 con 0x7fc9ec0cb070 2023-09-12T16:08:04.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.530+0000 7fc9eaffd700 1 --2- 172.21.15.112:0/2252316282 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc9cc06a580 0x7fc9cc06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:04.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.531+0000 7fc9eaffd700 1 --2- 172.21.15.112:0/2252316282 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc9cc06a580 0x7fc9cc06ca40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc000c00 tx=0x7fc9dc001e70 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:04.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.536+0000 7fc9e8ff9700 1 -- 172.21.15.112:0/2252316282 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fc9e4054ae0 con 0x7fc9ec0cb070 2023-09-12T16:08:04.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.733+0000 7fc9f19ff700 1 -- 172.21.15.112:0/2252316282 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc9ec1e5f00 con 0x7fc9ec0cb070 2023-09-12T16:08:04.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.733+0000 7fc9e8ff9700 1 -- 172.21.15.112:0/2252316282 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc9e4058100 con 0x7fc9ec0cb070 2023-09-12T16:08:04.734 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-09-12T16:08:04.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.736+0000 7fc9f19ff700 1 -- 172.21.15.112:0/2252316282 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc9cc06a580 msgr2=0x7fc9cc06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:04.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.736+0000 7fc9f19ff700 1 --2- 172.21.15.112:0/2252316282 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc9cc06a580 0x7fc9cc06ca40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc000c00 tx=0x7fc9dc001e70 comp rx=0 tx=0).stop 2023-09-12T16:08:04.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.736+0000 7fc9f19ff700 1 -- 172.21.15.112:0/2252316282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9ec0cb070 msgr2=0x7fc9ec15e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:04.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.736+0000 7fc9f19ff700 1 --2- 172.21.15.112:0/2252316282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9ec0cb070 0x7fc9ec15e470 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4009040 tx=0x7fc9e40093b0 comp rx=0 tx=0).stop 2023-09-12T16:08:04.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.736+0000 7fc9f19ff700 1 -- 172.21.15.112:0/2252316282 shutdown_connections 2023-09-12T16:08:04.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.736+0000 7fc9f19ff700 1 --2- 172.21.15.112:0/2252316282 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc9cc06a580 0x7fc9cc06ca40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:04.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.736+0000 7fc9f19ff700 1 --2- 172.21.15.112:0/2252316282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9d80051d0 0x7fc9ec14a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:04.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.736+0000 7fc9f19ff700 1 --2- 172.21.15.112:0/2252316282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9ec0cb070 0x7fc9ec15e470 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:04.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.736+0000 7fc9f19ff700 1 --2- 172.21.15.112:0/2252316282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9ec09edb0 0x7fc9ec0cab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:04.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.736+0000 7fc9f19ff700 1 -- 172.21.15.112:0/2252316282 >> 172.21.15.112:0/2252316282 conn(0x7fc9ec0d17d0 msgr2=0x7fc9ec0ae3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:04.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.736+0000 7fc9f19ff700 1 -- 172.21.15.112:0/2252316282 shutdown_connections 2023-09-12T16:08:04.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.736+0000 7fc9f19ff700 1 -- 172.21.15.112:0/2252316282 wait complete. 2023-09-12T16:08:04.754 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-12T16:08:04.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.955+0000 7fe45a7ff700 1 -- 172.21.15.112:0/3767301324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe45415f530 msgr2=0x7fe45415f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:04.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.955+0000 7fe45a7ff700 1 --2- 172.21.15.112:0/3767301324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe45415f530 0x7fe45415f9b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe454072710 tx=0x7fe448009c70 comp rx=0 tx=0).stop 2023-09-12T16:08:04.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.956+0000 7fe45a7ff700 1 -- 172.21.15.112:0/3767301324 shutdown_connections 2023-09-12T16:08:04.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.956+0000 7fe45a7ff700 1 --2- 172.21.15.112:0/3767301324 >> v2:172.21.15.144:3300/0 conn(0x7fe4540b4dd0 0x7fe4540b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:04.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.956+0000 7fe45a7ff700 1 --2- 172.21.15.112:0/3767301324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe45415f530 0x7fe45415f9b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:04.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.956+0000 7fe45a7ff700 1 -- 172.21.15.112:0/3767301324 >> 172.21.15.112:0/3767301324 conn(0x7fe45409aa90 msgr2=0x7fe4540d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:04.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.956+0000 7fe45a7ff700 1 -- 172.21.15.112:0/3767301324 shutdown_connections 2023-09-12T16:08:04.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.956+0000 7fe45a7ff700 1 -- 172.21.15.112:0/3767301324 wait complete. 2023-09-12T16:08:04.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.958+0000 7fe45a7ff700 1 Processor -- start 2023-09-12T16:08:04.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.958+0000 7fe45a7ff700 1 -- start start 2023-09-12T16:08:04.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.959+0000 7fe45a7ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4540b4dd0 0x7fe454146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:04.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.959+0000 7fe45a7ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe45415bb40 0x7fe4541e66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:04.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.959+0000 7fe45a7ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe45415f530 0x7fe4540cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:04.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.959+0000 7fe45a7ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4541e5350 con 0x7fe45415f530 2023-09-12T16:08:04.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.959+0000 7fe45a7ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4541e5630 con 0x7fe45415bb40 2023-09-12T16:08:04.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.959+0000 7fe45a7ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4541e5910 con 0x7fe4540b4dd0 2023-09-12T16:08:04.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.960+0000 7fe458d9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe45415f530 0x7fe4540cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:04.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.960+0000 7fe458d9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe45415f530 0x7fe4540cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54090/0 (socket says 172.21.15.112:54090) 2023-09-12T16:08:04.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.960+0000 7fe458d9c700 1 -- 172.21.15.112:0/2203850441 learned_addr learned my addr 172.21.15.112:0/2203850441 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:04.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.960+0000 7fe453fff700 1 --2- 172.21.15.112:0/2203850441 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4540b4dd0 0x7fe454146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:04.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.960+0000 7fe4537fe700 1 --2- 172.21.15.112:0/2203850441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe45415bb40 0x7fe4541e66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:04.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.960+0000 7fe458d9c700 1 -- 172.21.15.112:0/2203850441 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4540b4dd0 msgr2=0x7fe454146530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:04.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.960+0000 7fe458d9c700 1 --2- 172.21.15.112:0/2203850441 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4540b4dd0 0x7fe454146530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:04.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.960+0000 7fe458d9c700 1 -- 172.21.15.112:0/2203850441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe45415bb40 msgr2=0x7fe4541e66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:04.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.960+0000 7fe458d9c700 1 --2- 172.21.15.112:0/2203850441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe45415bb40 0x7fe4541e66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:04.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.960+0000 7fe458d9c700 1 -- 172.21.15.112:0/2203850441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4480095f0 con 0x7fe45415f530 2023-09-12T16:08:04.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.960+0000 7fe458d9c700 1 --2- 172.21.15.112:0/2203850441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe45415f530 0x7fe4540cb290 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe44c007ee0 tx=0x7fe44c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:04.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.960+0000 7fe450ff9700 1 -- 172.21.15.112:0/2203850441 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c017070 con 0x7fe45415f530 2023-09-12T16:08:04.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.961+0000 7fe450ff9700 1 -- 172.21.15.112:0/2203850441 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe44c00f040 con 0x7fe45415f530 2023-09-12T16:08:04.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.961+0000 7fe45a7ff700 1 -- 172.21.15.112:0/2203850441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4540cfe40 con 0x7fe45415f530 2023-09-12T16:08:04.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.961+0000 7fe450ff9700 1 -- 172.21.15.112:0/2203850441 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c004df0 con 0x7fe45415f530 2023-09-12T16:08:04.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.961+0000 7fe45a7ff700 1 -- 172.21.15.112:0/2203850441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4541e5ed0 con 0x7fe45415f530 2023-09-12T16:08:04.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.962+0000 7fe45a7ff700 1 -- 172.21.15.112:0/2203850441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe454073ea0 con 0x7fe45415f530 2023-09-12T16:08:04.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.963+0000 7fe450ff9700 1 -- 172.21.15.112:0/2203850441 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe44c00db20 con 0x7fe45415f530 2023-09-12T16:08:04.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.964+0000 7fe450ff9700 1 --2- 172.21.15.112:0/2203850441 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe44006a580 0x7fe44006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:04.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.964+0000 7fe450ff9700 1 -- 172.21.15.112:0/2203850441 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe44c088c90 con 0x7fe45415f530 2023-09-12T16:08:04.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.964+0000 7fe453fff700 1 --2- 172.21.15.112:0/2203850441 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe44006a580 0x7fe44006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:04.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.965+0000 7fe453fff700 1 --2- 172.21.15.112:0/2203850441 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe44006a580 0x7fe44006ca40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe444007fd0 tx=0x7fe444007ec0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:04.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:04.968+0000 7fe450ff9700 1 -- 172.21.15.112:0/2203850441 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe44c053e20 con 0x7fe45415f530 2023-09-12T16:08:05.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.164+0000 7fe45a7ff700 1 -- 172.21.15.112:0/2203850441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe4540b3e40 con 0x7fe45415f530 2023-09-12T16:08:05.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.164+0000 7fe450ff9700 1 -- 172.21.15.112:0/2203850441 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe44c057440 con 0x7fe45415f530 2023-09-12T16:08:05.165 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:08:05.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.166+0000 7fe45a7ff700 1 -- 172.21.15.112:0/2203850441 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe44006a580 msgr2=0x7fe44006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:05.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.166+0000 7fe45a7ff700 1 --2- 172.21.15.112:0/2203850441 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe44006a580 0x7fe44006ca40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe444007fd0 tx=0x7fe444007ec0 comp rx=0 tx=0).stop 2023-09-12T16:08:05.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.166+0000 7fe45a7ff700 1 -- 172.21.15.112:0/2203850441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe45415f530 msgr2=0x7fe4540cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:05.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.166+0000 7fe45a7ff700 1 --2- 172.21.15.112:0/2203850441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe45415f530 0x7fe4540cb290 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe44c007ee0 tx=0x7fe44c00d3b0 comp rx=0 tx=0).stop 2023-09-12T16:08:05.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.167+0000 7fe45a7ff700 1 -- 172.21.15.112:0/2203850441 shutdown_connections 2023-09-12T16:08:05.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.167+0000 7fe45a7ff700 1 --2- 172.21.15.112:0/2203850441 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe44006a580 0x7fe44006ca40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:05.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.167+0000 7fe45a7ff700 1 --2- 172.21.15.112:0/2203850441 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4540b4dd0 0x7fe454146530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:05.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.167+0000 7fe45a7ff700 1 --2- 172.21.15.112:0/2203850441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe45415f530 0x7fe4540cb290 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:05.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.167+0000 7fe45a7ff700 1 --2- 172.21.15.112:0/2203850441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe45415bb40 0x7fe4541e66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:05.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.167+0000 7fe45a7ff700 1 -- 172.21.15.112:0/2203850441 >> 172.21.15.112:0/2203850441 conn(0x7fe45409aa90 msgr2=0x7fe45406b340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:05.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.167+0000 7fe45a7ff700 1 -- 172.21.15.112:0/2203850441 shutdown_connections 2023-09-12T16:08:05.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.167+0000 7fe45a7ff700 1 -- 172.21.15.112:0/2203850441 wait complete. 2023-09-12T16:08:05.185 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-12T16:08:05.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.386+0000 7fcdbebff700 1 -- 172.21.15.112:0/3218543371 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcdb815ba80 msgr2=0x7fcdb80cf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:05.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.386+0000 7fcdbebff700 1 --2- 172.21.15.112:0/3218543371 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcdb815ba80 0x7fcdb80cf4d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcdac0098b0 tx=0x7fcdac009bc0 comp rx=0 tx=0).stop 2023-09-12T16:08:05.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.386+0000 7fcdbebff700 1 -- 172.21.15.112:0/3218543371 shutdown_connections 2023-09-12T16:08:05.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.386+0000 7fcdbebff700 1 --2- 172.21.15.112:0/3218543371 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcdb815ba80 0x7fcdb80cf4d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:05.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.386+0000 7fcdbebff700 1 --2- 172.21.15.112:0/3218543371 >> v2:172.21.15.144:3300/0 conn(0x7fcdb80cfa10 0x7fcdb80cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:05.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.386+0000 7fcdbebff700 1 -- 172.21.15.112:0/3218543371 >> 172.21.15.112:0/3218543371 conn(0x7fcdb8088ff0 msgr2=0x7fcdb80d1900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:05.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.386+0000 7fcdbebff700 1 -- 172.21.15.112:0/3218543371 shutdown_connections 2023-09-12T16:08:05.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.386+0000 7fcdbebff700 1 -- 172.21.15.112:0/3218543371 wait complete. 2023-09-12T16:08:05.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.388+0000 7fcdbebff700 1 Processor -- start 2023-09-12T16:08:05.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.388+0000 7fcdbebff700 1 -- start start 2023-09-12T16:08:05.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.389+0000 7fcdbebff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcdb80cfa10 0x7fcdb80cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:05.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.389+0000 7fcdbebff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdb80d0400 0x7fcdb8150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:05.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.389+0000 7fcdbebff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdb815ba80 0x7fcdb815cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:05.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.389+0000 7fcdbebff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb81511a0 con 0x7fcdb80d0400 2023-09-12T16:08:05.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.389+0000 7fcdbebff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb80cae20 con 0x7fcdb815ba80 2023-09-12T16:08:05.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.389+0000 7fcdbebff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb80c9fb0 con 0x7fcdb80cfa10 2023-09-12T16:08:05.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.389+0000 7fcdb7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdb80d0400 0x7fcdb8150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:05.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.389+0000 7fcdb7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdb80d0400 0x7fcdb8150c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54102/0 (socket says 172.21.15.112:54102) 2023-09-12T16:08:05.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.389+0000 7fcdbc99b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcdb80cfa10 0x7fcdb80cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:05.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.389+0000 7fcdb7fff700 1 -- 172.21.15.112:0/3765522836 learned_addr learned my addr 172.21.15.112:0/3765522836 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:05.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.389+0000 7fcdbd19c700 1 --2- 172.21.15.112:0/3765522836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdb815ba80 0x7fcdb815cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:05.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.390+0000 7fcdb7fff700 1 -- 172.21.15.112:0/3765522836 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcdb80cfa10 msgr2=0x7fcdb80cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:05.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.390+0000 7fcdb7fff700 1 --2- 172.21.15.112:0/3765522836 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcdb80cfa10 0x7fcdb80cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:05.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.390+0000 7fcdb7fff700 1 -- 172.21.15.112:0/3765522836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdb815ba80 msgr2=0x7fcdb815cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:05.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.390+0000 7fcdb7fff700 1 --2- 172.21.15.112:0/3765522836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdb815ba80 0x7fcdb815cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:05.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.390+0000 7fcdb7fff700 1 -- 172.21.15.112:0/3765522836 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac0094c0 con 0x7fcdb80d0400 2023-09-12T16:08:05.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.390+0000 7fcdb7fff700 1 --2- 172.21.15.112:0/3765522836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdb80d0400 0x7fcdb8150c60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcda400e970 tx=0x7fcda400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:05.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.390+0000 7fcdb57fa700 1 -- 172.21.15.112:0/3765522836 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4009790 con 0x7fcdb80d0400 2023-09-12T16:08:05.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.390+0000 7fcdb57fa700 1 -- 172.21.15.112:0/3765522836 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcda4004a30 con 0x7fcdb80d0400 2023-09-12T16:08:05.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.390+0000 7fcdb57fa700 1 -- 172.21.15.112:0/3765522836 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4004e40 con 0x7fcdb80d0400 2023-09-12T16:08:05.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.390+0000 7fcdbebff700 1 -- 172.21.15.112:0/3765522836 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb80ca230 con 0x7fcdb80d0400 2023-09-12T16:08:05.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.390+0000 7fcdbebff700 1 -- 172.21.15.112:0/3765522836 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb80ca7d0 con 0x7fcdb80d0400 2023-09-12T16:08:05.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.391+0000 7fcdbebff700 1 -- 172.21.15.112:0/3765522836 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb804e300 con 0x7fcdb80d0400 2023-09-12T16:08:05.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.392+0000 7fcdb57fa700 1 -- 172.21.15.112:0/3765522836 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fcda400c780 con 0x7fcdb80d0400 2023-09-12T16:08:05.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.393+0000 7fcdb57fa700 1 --2- 172.21.15.112:0/3765522836 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcd9c06a580 0x7fcd9c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:05.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.393+0000 7fcdb57fa700 1 -- 172.21.15.112:0/3765522836 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fcda4014070 con 0x7fcdb80d0400 2023-09-12T16:08:05.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.394+0000 7fcdbc99b700 1 --2- 172.21.15.112:0/3765522836 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcd9c06a580 0x7fcd9c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:05.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.394+0000 7fcdbc99b700 1 --2- 172.21.15.112:0/3765522836 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcd9c06a580 0x7fcd9c06ca40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009800 tx=0x7fcdac019040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:05.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.397+0000 7fcdb57fa700 1 -- 172.21.15.112:0/3765522836 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fcda4054820 con 0x7fcdb80d0400 2023-09-12T16:08:05.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.612+0000 7fcdbebff700 1 -- 172.21.15.112:0/3765522836 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcdb80caf60 con 0x7fcdb80d0400 2023-09-12T16:08:05.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.613+0000 7fcdb57fa700 1 -- 172.21.15.112:0/3765522836 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcdb80caf60 con 0x7fcdb80d0400 2023-09-12T16:08:05.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.615+0000 7fcdbebff700 1 -- 172.21.15.112:0/3765522836 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcd9c06a580 msgr2=0x7fcd9c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:05.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.615+0000 7fcdbebff700 1 --2- 172.21.15.112:0/3765522836 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcd9c06a580 0x7fcd9c06ca40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009800 tx=0x7fcdac019040 comp rx=0 tx=0).stop 2023-09-12T16:08:05.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.615+0000 7fcdbebff700 1 -- 172.21.15.112:0/3765522836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdb80d0400 msgr2=0x7fcdb8150c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:05.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.615+0000 7fcdbebff700 1 --2- 172.21.15.112:0/3765522836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdb80d0400 0x7fcdb8150c60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcda400e970 tx=0x7fcda400ec80 comp rx=0 tx=0).stop 2023-09-12T16:08:05.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.615+0000 7fcdbebff700 1 -- 172.21.15.112:0/3765522836 shutdown_connections 2023-09-12T16:08:05.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.615+0000 7fcdbebff700 1 --2- 172.21.15.112:0/3765522836 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcd9c06a580 0x7fcd9c06ca40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:05.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.615+0000 7fcdbebff700 1 --2- 172.21.15.112:0/3765522836 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcdb80cfa10 0x7fcdb80cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:05.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.615+0000 7fcdbebff700 1 --2- 172.21.15.112:0/3765522836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdb815ba80 0x7fcdb815cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:05.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.615+0000 7fcdbebff700 1 --2- 172.21.15.112:0/3765522836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdb80d0400 0x7fcdb8150c60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:05.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.615+0000 7fcdbebff700 1 -- 172.21.15.112:0/3765522836 >> 172.21.15.112:0/3765522836 conn(0x7fcdb8088ff0 msgr2=0x7fcdb80b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:05.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.615+0000 7fcdbebff700 1 -- 172.21.15.112:0/3765522836 shutdown_connections 2023-09-12T16:08:05.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:05.616+0000 7fcdbebff700 1 -- 172.21.15.112:0/3765522836 wait complete. 2023-09-12T16:08:05.618 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2023-09-12T16:08:05.633 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-12T16:08:05.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:08:05.634 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-09-12T16:08:05.722 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-09-12T16:08:05.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:08:05.723 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-12T16:08:05.770 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:08:05.771 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T16:08:05.822 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:08:05.823 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T16:08:05.871 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:08:05.872 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T16:08:05.959 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:08:06.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.157+0000 7f08acfff700 1 -- 172.21.15.112:0/2023929942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08a815f0d0 msgr2=0x7f08a80cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:06.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.157+0000 7f08acfff700 1 --2- 172.21.15.112:0/2023929942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08a815f0d0 0x7f08a80cfe20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f08980098b0 tx=0x7f0898009bc0 comp rx=0 tx=0).stop 2023-09-12T16:08:06.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.157+0000 7f08acfff700 1 -- 172.21.15.112:0/2023929942 shutdown_connections 2023-09-12T16:08:06.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.157+0000 7f08acfff700 1 --2- 172.21.15.112:0/2023929942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08a815f0d0 0x7f08a80cfe20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:06.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.157+0000 7f08acfff700 1 --2- 172.21.15.112:0/2023929942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08a80d21f0 0x7f08a80b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:06.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.157+0000 7f08acfff700 1 -- 172.21.15.112:0/2023929942 >> 172.21.15.112:0/2023929942 conn(0x7f08a809abe0 msgr2=0x7f08a80d18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:06.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.157+0000 7f08acfff700 1 -- 172.21.15.112:0/2023929942 shutdown_connections 2023-09-12T16:08:06.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.157+0000 7f08acfff700 1 -- 172.21.15.112:0/2023929942 wait complete. 2023-09-12T16:08:06.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.158+0000 7f08acfff700 1 Processor -- start 2023-09-12T16:08:06.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.159+0000 7f08acfff700 1 -- start start 2023-09-12T16:08:06.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.159+0000 7f08acfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08a80b3890 0x7f08a80c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:06.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.159+0000 7f08acfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08a80d21f0 0x7f08a80c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:06.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.159+0000 7f08acfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08a815f0d0 0x7f08a8158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:06.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.159+0000 7f08acfff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a80c6630 con 0x7f08a815f0d0 2023-09-12T16:08:06.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.160+0000 7f08acfff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a80c7000 con 0x7f08a80b3890 2023-09-12T16:08:06.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.160+0000 7f08acfff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a80c5770 con 0x7f08a80d21f0 2023-09-12T16:08:06.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.160+0000 7f08a6d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08a815f0d0 0x7f08a8158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:06.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.160+0000 7f08a6d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08a815f0d0 0x7f08a8158420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58756/0 (socket says 172.21.15.112:58756) 2023-09-12T16:08:06.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.160+0000 7f08a6d9d700 1 -- 172.21.15.112:0/3561105454 learned_addr learned my addr 172.21.15.112:0/3561105454 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:06.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.160+0000 7f089ffff700 1 --2- 172.21.15.112:0/3561105454 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08a80d21f0 0x7f08a80c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:06.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.160+0000 7f08a659c700 1 --2- 172.21.15.112:0/3561105454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08a80b3890 0x7f08a80c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:06.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.160+0000 7f08a6d9d700 1 -- 172.21.15.112:0/3561105454 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08a80d21f0 msgr2=0x7f08a80c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:06.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.160+0000 7f08a6d9d700 1 --2- 172.21.15.112:0/3561105454 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08a80d21f0 0x7f08a80c5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:06.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.160+0000 7f08a6d9d700 1 -- 172.21.15.112:0/3561105454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08a80b3890 msgr2=0x7f08a80c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:06.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.160+0000 7f08a6d9d700 1 --2- 172.21.15.112:0/3561105454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08a80b3890 0x7f08a80c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:06.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.160+0000 7f08a6d9d700 1 -- 172.21.15.112:0/3561105454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0890009520 con 0x7f08a815f0d0 2023-09-12T16:08:06.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.160+0000 7f08a6d9d700 1 --2- 172.21.15.112:0/3561105454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08a815f0d0 0x7f08a8158420 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f08a000cac0 tx=0x7f08a000ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:06.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.161+0000 7f089effd700 1 -- 172.21.15.112:0/3561105454 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a0003e10 con 0x7f08a815f0d0 2023-09-12T16:08:06.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.161+0000 7f089effd700 1 -- 172.21.15.112:0/3561105454 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f08a0005070 con 0x7f08a815f0d0 2023-09-12T16:08:06.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.161+0000 7f089effd700 1 -- 172.21.15.112:0/3561105454 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a0005480 con 0x7f08a815f0d0 2023-09-12T16:08:06.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.161+0000 7f08acfff700 1 -- 172.21.15.112:0/3561105454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08980094c0 con 0x7f08a815f0d0 2023-09-12T16:08:06.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.161+0000 7f08acfff700 1 -- 172.21.15.112:0/3561105454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a80c5d00 con 0x7f08a815f0d0 2023-09-12T16:08:06.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.162+0000 7f08acfff700 1 -- 172.21.15.112:0/3561105454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a804e300 con 0x7f08a815f0d0 2023-09-12T16:08:06.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.163+0000 7f089effd700 1 -- 172.21.15.112:0/3561105454 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f08a00055e0 con 0x7f08a815f0d0 2023-09-12T16:08:06.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.164+0000 7f089effd700 1 --2- 172.21.15.112:0/3561105454 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f088806a580 0x7f088806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:06.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.164+0000 7f089effd700 1 -- 172.21.15.112:0/3561105454 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f08a00887e0 con 0x7f08a815f0d0 2023-09-12T16:08:06.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.164+0000 7f08a659c700 1 --2- 172.21.15.112:0/3561105454 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f088806a580 0x7f088806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:06.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.165+0000 7f08a659c700 1 --2- 172.21.15.112:0/3561105454 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f088806a580 0x7f088806ca40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0898009800 tx=0x7f0898011040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:06.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.169+0000 7f089effd700 1 -- 172.21.15.112:0/3561105454 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f08a0053970 con 0x7f08a815f0d0 2023-09-12T16:08:06.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.364+0000 7f08acfff700 1 -- 172.21.15.112:0/3561105454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08a815df30 con 0x7f08a815f0d0 2023-09-12T16:08:06.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.366+0000 7f089effd700 1 -- 172.21.15.112:0/3561105454 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18816 (secure 0 0 0) 0x7f08a0056f90 con 0x7f08a815f0d0 2023-09-12T16:08:06.366 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:06.366 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:44.445226+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:08:06.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.368+0000 7f08acfff700 1 -- 172.21.15.112:0/3561105454 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f088806a580 msgr2=0x7f088806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:06.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.368+0000 7f08acfff700 1 --2- 172.21.15.112:0/3561105454 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f088806a580 0x7f088806ca40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0898009800 tx=0x7f0898011040 comp rx=0 tx=0).stop 2023-09-12T16:08:06.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.368+0000 7f08acfff700 1 -- 172.21.15.112:0/3561105454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08a815f0d0 msgr2=0x7f08a8158420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:06.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.368+0000 7f08acfff700 1 --2- 172.21.15.112:0/3561105454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08a815f0d0 0x7f08a8158420 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f08a000cac0 tx=0x7f08a000ce80 comp rx=0 tx=0).stop 2023-09-12T16:08:06.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.368+0000 7f08acfff700 1 -- 172.21.15.112:0/3561105454 shutdown_connections 2023-09-12T16:08:06.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.368+0000 7f08acfff700 1 --2- 172.21.15.112:0/3561105454 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f088806a580 0x7f088806ca40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.368+0000 7f08acfff700 1 --2- 172.21.15.112:0/3561105454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08a815f0d0 0x7f08a8158420 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.368+0000 7f08acfff700 1 --2- 172.21.15.112:0/3561105454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08a80b3890 0x7f08a80c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.368+0000 7f08acfff700 1 --2- 172.21.15.112:0/3561105454 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08a80d21f0 0x7f08a80c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.368+0000 7f08acfff700 1 -- 172.21.15.112:0/3561105454 >> 172.21.15.112:0/3561105454 conn(0x7f08a809abe0 msgr2=0x7f08a806bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.368+0000 7f08acfff700 1 -- 172.21.15.112:0/3561105454 shutdown_connections 2023-09-12T16:08:06.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.368+0000 7f08acfff700 1 -- 172.21.15.112:0/3561105454 wait complete. 2023-09-12T16:08:06.386 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-12T16:06:48.871680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-12T16:06:58.137223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-12T16:06:58.684034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-12T16:07:02.283459+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-12T16:08:06.387 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-12T16:08:06.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.588+0000 7f5d081ff700 1 -- 172.21.15.112:0/2093498614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d000b4dd0 msgr2=0x7f5d000b5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:06.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.588+0000 7f5d081ff700 1 --2- 172.21.15.112:0/2093498614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d000b4dd0 0x7f5d000b5240 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5d0008a8d0 tx=0x7f5cf800b330 comp rx=0 tx=0).stop 2023-09-12T16:08:06.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.589+0000 7f5d081ff700 1 -- 172.21.15.112:0/2093498614 shutdown_connections 2023-09-12T16:08:06.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.589+0000 7f5d081ff700 1 --2- 172.21.15.112:0/2093498614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d000b4dd0 0x7f5d000b5240 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:06.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.589+0000 7f5d081ff700 1 --2- 172.21.15.112:0/2093498614 >> v2:172.21.15.144:3300/0 conn(0x7f5d0015f530 0x7f5d0015f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:06.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.589+0000 7f5d081ff700 1 -- 172.21.15.112:0/2093498614 >> 172.21.15.112:0/2093498614 conn(0x7f5d0009aa90 msgr2=0x7f5d000d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:06.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.589+0000 7f5d081ff700 1 -- 172.21.15.112:0/2093498614 shutdown_connections 2023-09-12T16:08:06.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.589+0000 7f5d081ff700 1 -- 172.21.15.112:0/2093498614 wait complete. 2023-09-12T16:08:06.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.590+0000 7f5d081ff700 1 Processor -- start 2023-09-12T16:08:06.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.591+0000 7f5d081ff700 1 -- start start 2023-09-12T16:08:06.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.591+0000 7f5d081ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d000b4dd0 0x7f5d00154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:06.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.591+0000 7f5d081ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d0015bb40 0x7f5d000c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:06.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.592+0000 7f5d081ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d0015f530 0x7f5d0015db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:06.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.592+0000 7f5d081ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d00154ea0 con 0x7f5d0015bb40 2023-09-12T16:08:06.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.592+0000 7f5d081ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000c5950 con 0x7f5d000b4dd0 2023-09-12T16:08:06.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.592+0000 7f5d081ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000cb2d0 con 0x7f5d0015f530 2023-09-12T16:08:06.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.592+0000 7f5d0579a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d0015bb40 0x7f5d000c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:06.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.592+0000 7f5d0579a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d0015bb40 0x7f5d000c5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58762/0 (socket says 172.21.15.112:58762) 2023-09-12T16:08:06.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.592+0000 7f5d0579a700 1 -- 172.21.15.112:0/408606606 learned_addr learned my addr 172.21.15.112:0/408606606 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:06.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.592+0000 7f5d0679c700 1 --2- 172.21.15.112:0/408606606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d0015f530 0x7f5d0015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:06.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.592+0000 7f5d05f9b700 1 --2- 172.21.15.112:0/408606606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d000b4dd0 0x7f5d00154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:06.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.592+0000 7f5d0579a700 1 -- 172.21.15.112:0/408606606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d0015f530 msgr2=0x7f5d0015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:06.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.592+0000 7f5d0579a700 1 --2- 172.21.15.112:0/408606606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d0015f530 0x7f5d0015db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:06.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.592+0000 7f5d0579a700 1 -- 172.21.15.112:0/408606606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d000b4dd0 msgr2=0x7f5d00154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:06.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.592+0000 7f5d0579a700 1 --2- 172.21.15.112:0/408606606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d000b4dd0 0x7f5d00154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:06.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.592+0000 7f5d0579a700 1 -- 172.21.15.112:0/408606606 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf8009c40 con 0x7f5d0015bb40 2023-09-12T16:08:06.597 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.592+0000 7f5d05f9b700 1 --2- 172.21.15.112:0/408606606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d000b4dd0 0x7f5d00154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:08:06.597 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.592+0000 7f5d0579a700 1 --2- 172.21.15.112:0/408606606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d0015bb40 0x7f5d000c5de0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000d950 tx=0x7f5cf000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:06.597 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.593+0000 7f5cf67fc700 1 -- 172.21.15.112:0/408606606 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0009930 con 0x7f5d0015bb40 2023-09-12T16:08:06.597 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.593+0000 7f5cf67fc700 1 -- 172.21.15.112:0/408606606 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5cf0009b80 con 0x7f5d0015bb40 2023-09-12T16:08:06.597 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.593+0000 7f5cf67fc700 1 -- 172.21.15.112:0/408606606 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0010460 con 0x7f5d0015bb40 2023-09-12T16:08:06.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.593+0000 7f5d081ff700 1 -- 172.21.15.112:0/408606606 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d000cb5b0 con 0x7f5d0015bb40 2023-09-12T16:08:06.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.593+0000 7f5d081ff700 1 -- 172.21.15.112:0/408606606 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d000c55e0 con 0x7f5d0015bb40 2023-09-12T16:08:06.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.594+0000 7f5d081ff700 1 -- 172.21.15.112:0/408606606 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d000c5c30 con 0x7f5d0015bb40 2023-09-12T16:08:06.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.595+0000 7f5cf67fc700 1 -- 172.21.15.112:0/408606606 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f5cf00105c0 con 0x7f5d0015bb40 2023-09-12T16:08:06.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.596+0000 7f5cf67fc700 1 --2- 172.21.15.112:0/408606606 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5ce406a580 0x7f5ce406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:06.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.596+0000 7f5cf67fc700 1 -- 172.21.15.112:0/408606606 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5cf00892b0 con 0x7f5d0015bb40 2023-09-12T16:08:06.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.596+0000 7f5d05f9b700 1 --2- 172.21.15.112:0/408606606 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5ce406a580 0x7f5ce406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:06.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.596+0000 7f5d05f9b700 1 --2- 172.21.15.112:0/408606606 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5ce406a580 0x7f5ce406ca40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc000f60 tx=0x7f5cfc009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:06.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.600+0000 7f5cf67fc700 1 -- 172.21.15.112:0/408606606 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5cf0057e40 con 0x7f5d0015bb40 2023-09-12T16:08:06.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.794+0000 7f5d081ff700 1 -- 172.21.15.112:0/408606606 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5d000c5a90 con 0x7f5d0015bb40 2023-09-12T16:08:06.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.795+0000 7f5cf67fc700 1 -- 172.21.15.112:0/408606606 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5d000c5a90 con 0x7f5d0015bb40 2023-09-12T16:08:06.795 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-09-12T16:08:06.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.797+0000 7f5d081ff700 1 -- 172.21.15.112:0/408606606 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5ce406a580 msgr2=0x7f5ce406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:06.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.797+0000 7f5d081ff700 1 --2- 172.21.15.112:0/408606606 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5ce406a580 0x7f5ce406ca40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc000f60 tx=0x7f5cfc009040 comp rx=0 tx=0).stop 2023-09-12T16:08:06.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.797+0000 7f5d081ff700 1 -- 172.21.15.112:0/408606606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d0015bb40 msgr2=0x7f5d000c5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:06.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.797+0000 7f5d081ff700 1 --2- 172.21.15.112:0/408606606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d0015bb40 0x7f5d000c5de0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000d950 tx=0x7f5cf000dd10 comp rx=0 tx=0).stop 2023-09-12T16:08:06.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.797+0000 7f5d081ff700 1 -- 172.21.15.112:0/408606606 shutdown_connections 2023-09-12T16:08:06.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.797+0000 7f5d081ff700 1 --2- 172.21.15.112:0/408606606 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f5ce406a580 0x7f5ce406ca40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:06.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.797+0000 7f5d081ff700 1 --2- 172.21.15.112:0/408606606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d0015f530 0x7f5d0015db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:06.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.797+0000 7f5d081ff700 1 --2- 172.21.15.112:0/408606606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d000b4dd0 0x7f5d00154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:06.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.797+0000 7f5d081ff700 1 --2- 172.21.15.112:0/408606606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d0015bb40 0x7f5d000c5de0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:06.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.797+0000 7f5d081ff700 1 -- 172.21.15.112:0/408606606 >> 172.21.15.112:0/408606606 conn(0x7f5d0009aa90 msgr2=0x7f5d0006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:06.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.797+0000 7f5d081ff700 1 -- 172.21.15.112:0/408606606 shutdown_connections 2023-09-12T16:08:06.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:06.797+0000 7f5d081ff700 1 -- 172.21.15.112:0/408606606 wait complete. 2023-09-12T16:08:06.815 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-12T16:08:07.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.017+0000 7f3cfa3ff700 1 -- 172.21.15.112:0/41806459 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf40b4ab0 msgr2=0x7f3cf40b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:07.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.017+0000 7f3cfa3ff700 1 --2- 172.21.15.112:0/41806459 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf40b4ab0 0x7f3cf40b4ee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009fd0 tx=0x7f3cec00b380 comp rx=0 tx=0).stop 2023-09-12T16:08:07.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.018+0000 7f3cfa3ff700 1 -- 172.21.15.112:0/41806459 shutdown_connections 2023-09-12T16:08:07.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.018+0000 7f3cfa3ff700 1 --2- 172.21.15.112:0/41806459 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf40b4ab0 0x7f3cf40b4ee0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:07.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.018+0000 7f3cfa3ff700 1 --2- 172.21.15.112:0/41806459 >> v2:172.21.15.144:3300/0 conn(0x7f3cf40d16a0 0x7f3cf40d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:07.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.018+0000 7f3cfa3ff700 1 -- 172.21.15.112:0/41806459 >> 172.21.15.112:0/41806459 conn(0x7f3cf4071b70 msgr2=0x7f3cf4071f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:07.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.018+0000 7f3cfa3ff700 1 -- 172.21.15.112:0/41806459 shutdown_connections 2023-09-12T16:08:07.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.018+0000 7f3cfa3ff700 1 -- 172.21.15.112:0/41806459 wait complete. 2023-09-12T16:08:07.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.019+0000 7f3cfa3ff700 1 Processor -- start 2023-09-12T16:08:07.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.020+0000 7f3cfa3ff700 1 -- start start 2023-09-12T16:08:07.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.021+0000 7f3cfa3ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf40b4ab0 0x7f3cf41f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:07.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.021+0000 7f3cfa3ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf40cc050 0x7f3cf414b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:07.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.021+0000 7f3cfa3ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf40d16a0 0x7f3cf40a8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:07.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.021+0000 7f3cfa3ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf414b410 con 0x7f3cf40cc050 2023-09-12T16:08:07.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.021+0000 7f3cfa3ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf41f2e30 con 0x7f3cf40d16a0 2023-09-12T16:08:07.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.021+0000 7f3cfa3ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf415cfd0 con 0x7f3cf40b4ab0 2023-09-12T16:08:07.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.021+0000 7f3cebfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf40cc050 0x7f3cf414b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:07.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.021+0000 7f3cebfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf40cc050 0x7f3cf414b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58766/0 (socket says 172.21.15.112:58766) 2023-09-12T16:08:07.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.021+0000 7f3cebfff700 1 -- 172.21.15.112:0/2934483210 learned_addr learned my addr 172.21.15.112:0/2934483210 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:07.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.021+0000 7f3cf3fff700 1 --2- 172.21.15.112:0/2934483210 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf40b4ab0 0x7f3cf41f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:07.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.021+0000 7f3cf899c700 1 --2- 172.21.15.112:0/2934483210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf40d16a0 0x7f3cf40a8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:07.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.021+0000 7f3cebfff700 1 -- 172.21.15.112:0/2934483210 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf40b4ab0 msgr2=0x7f3cf41f5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:07.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.021+0000 7f3cebfff700 1 --2- 172.21.15.112:0/2934483210 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf40b4ab0 0x7f3cf41f5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:07.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.021+0000 7f3cebfff700 1 -- 172.21.15.112:0/2934483210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf40d16a0 msgr2=0x7f3cf40a8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:07.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.021+0000 7f3cebfff700 1 --2- 172.21.15.112:0/2934483210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf40d16a0 0x7f3cf40a8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:07.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.021+0000 7f3cebfff700 1 -- 172.21.15.112:0/2934483210 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce4009520 con 0x7f3cf40cc050 2023-09-12T16:08:07.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.022+0000 7f3cebfff700 1 --2- 172.21.15.112:0/2934483210 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf40cc050 0x7f3cf414b6b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00c4b0 tx=0x7f3cdc00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:07.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.022+0000 7f3cf17fa700 1 -- 172.21.15.112:0/2934483210 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc0052d0 con 0x7f3cf40cc050 2023-09-12T16:08:07.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.022+0000 7f3cf17fa700 1 -- 172.21.15.112:0/2934483210 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3cdc005520 con 0x7f3cf40cc050 2023-09-12T16:08:07.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.022+0000 7f3cf17fa700 1 -- 172.21.15.112:0/2934483210 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc0038e0 con 0x7f3cf40cc050 2023-09-12T16:08:07.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.022+0000 7f3cfa3ff700 1 -- 172.21.15.112:0/2934483210 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cec009d00 con 0x7f3cf40cc050 2023-09-12T16:08:07.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.022+0000 7f3cfa3ff700 1 -- 172.21.15.112:0/2934483210 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf415d590 con 0x7f3cf40cc050 2023-09-12T16:08:07.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.023+0000 7f3cfa3ff700 1 -- 172.21.15.112:0/2934483210 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf404eb50 con 0x7f3cf40cc050 2023-09-12T16:08:07.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.024+0000 7f3cf17fa700 1 -- 172.21.15.112:0/2934483210 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f3cdc003a40 con 0x7f3cf40cc050 2023-09-12T16:08:07.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.025+0000 7f3cf17fa700 1 --2- 172.21.15.112:0/2934483210 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3cd406a580 0x7f3cd406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:07.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.025+0000 7f3cf17fa700 1 -- 172.21.15.112:0/2934483210 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3cdc0884e0 con 0x7f3cf40cc050 2023-09-12T16:08:07.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.025+0000 7f3cf3fff700 1 --2- 172.21.15.112:0/2934483210 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3cd406a580 0x7f3cd406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:07.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.026+0000 7f3cf3fff700 1 --2- 172.21.15.112:0/2934483210 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3cd406a580 0x7f3cd406ca40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3cf414e800 tx=0x7f3ce4009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:07.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.029+0000 7f3cf17fa700 1 -- 172.21.15.112:0/2934483210 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f3cdc0535e0 con 0x7f3cf40cc050 2023-09-12T16:08:07.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.226+0000 7f3cfa3ff700 1 -- 172.21.15.112:0/2934483210 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3cf40cc550 con 0x7f3cf40cc050 2023-09-12T16:08:07.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.226+0000 7f3cf17fa700 1 -- 172.21.15.112:0/2934483210 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3cdc056c00 con 0x7f3cf40cc050 2023-09-12T16:08:07.227 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:08:07.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.229+0000 7f3cfa3ff700 1 -- 172.21.15.112:0/2934483210 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3cd406a580 msgr2=0x7f3cd406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:07.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.229+0000 7f3cfa3ff700 1 --2- 172.21.15.112:0/2934483210 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3cd406a580 0x7f3cd406ca40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3cf414e800 tx=0x7f3ce4009260 comp rx=0 tx=0).stop 2023-09-12T16:08:07.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.229+0000 7f3cfa3ff700 1 -- 172.21.15.112:0/2934483210 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf40cc050 msgr2=0x7f3cf414b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:07.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.229+0000 7f3cfa3ff700 1 --2- 172.21.15.112:0/2934483210 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf40cc050 0x7f3cf414b6b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00c4b0 tx=0x7f3cdc00c7c0 comp rx=0 tx=0).stop 2023-09-12T16:08:07.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.229+0000 7f3cfa3ff700 1 -- 172.21.15.112:0/2934483210 shutdown_connections 2023-09-12T16:08:07.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.229+0000 7f3cfa3ff700 1 --2- 172.21.15.112:0/2934483210 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3cd406a580 0x7f3cd406ca40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:07.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.229+0000 7f3cfa3ff700 1 --2- 172.21.15.112:0/2934483210 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf40b4ab0 0x7f3cf41f5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:07.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.229+0000 7f3cfa3ff700 1 --2- 172.21.15.112:0/2934483210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf40d16a0 0x7f3cf40a8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:07.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.229+0000 7f3cfa3ff700 1 --2- 172.21.15.112:0/2934483210 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cf40cc050 0x7f3cf414b6b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:07.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.229+0000 7f3cfa3ff700 1 -- 172.21.15.112:0/2934483210 >> 172.21.15.112:0/2934483210 conn(0x7f3cf4071b70 msgr2=0x7f3cf415ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:07.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.229+0000 7f3cfa3ff700 1 -- 172.21.15.112:0/2934483210 shutdown_connections 2023-09-12T16:08:07.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.229+0000 7f3cfa3ff700 1 -- 172.21.15.112:0/2934483210 wait complete. 2023-09-12T16:08:07.247 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-12T16:08:07.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.448+0000 7fb5b55ff700 1 -- 172.21.15.112:0/1670265414 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5b006c150 msgr2=0x7fb5b00ca820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:07.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.448+0000 7fb5b55ff700 1 --2- 172.21.15.112:0/1670265414 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5b006c150 0x7fb5b00ca820 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009f60 tx=0x7fb5a8009f90 comp rx=0 tx=0).stop 2023-09-12T16:08:07.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.449+0000 7fb5b55ff700 1 -- 172.21.15.112:0/1670265414 shutdown_connections 2023-09-12T16:08:07.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.449+0000 7fb5b55ff700 1 --2- 172.21.15.112:0/1670265414 >> v2:172.21.15.144:3300/0 conn(0x7fb5b015bb90 0x7fb5b00ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:07.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.449+0000 7fb5b55ff700 1 --2- 172.21.15.112:0/1670265414 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5b006c150 0x7fb5b00ca820 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:07.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.449+0000 7fb5b55ff700 1 -- 172.21.15.112:0/1670265414 >> 172.21.15.112:0/1670265414 conn(0x7fb5b00cf5c0 msgr2=0x7fb5b00cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:07.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.449+0000 7fb5b55ff700 1 -- 172.21.15.112:0/1670265414 shutdown_connections 2023-09-12T16:08:07.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.449+0000 7fb5b55ff700 1 -- 172.21.15.112:0/1670265414 wait complete. 2023-09-12T16:08:07.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.450+0000 7fb5b55ff700 1 Processor -- start 2023-09-12T16:08:07.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.451+0000 7fb5b55ff700 1 -- start start 2023-09-12T16:08:07.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.451+0000 7fb5b55ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5b006b340 0x7fb5b01f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:07.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.451+0000 7fb5b55ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5b006c150 0x7fb5b00cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:07.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.452+0000 7fb5b55ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5b015bb90 0x7fb5b0158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:07.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.452+0000 7fb5b55ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b015d450 con 0x7fb5b015bb90 2023-09-12T16:08:07.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.452+0000 7fb5b55ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b015d730 con 0x7fb5b006b340 2023-09-12T16:08:07.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.452+0000 7fb5b55ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b015da10 con 0x7fb5b006c150 2023-09-12T16:08:07.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.452+0000 7fb5af7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5b015bb90 0x7fb5b0158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:07.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.452+0000 7fb5aeffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5b006b340 0x7fb5b01f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:07.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.452+0000 7fb5ae7fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5b006c150 0x7fb5b00cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:07.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.452+0000 7fb5af7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5b015bb90 0x7fb5b0158860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58774/0 (socket says 172.21.15.112:58774) 2023-09-12T16:08:07.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.452+0000 7fb5af7fe700 1 -- 172.21.15.112:0/1686805281 learned_addr learned my addr 172.21.15.112:0/1686805281 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:07.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.452+0000 7fb5af7fe700 1 -- 172.21.15.112:0/1686805281 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5b006c150 msgr2=0x7fb5b00cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:07.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.452+0000 7fb5af7fe700 1 --2- 172.21.15.112:0/1686805281 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5b006c150 0x7fb5b00cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:07.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.452+0000 7fb5af7fe700 1 -- 172.21.15.112:0/1686805281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5b006b340 msgr2=0x7fb5b01f18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:07.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.452+0000 7fb5af7fe700 1 --2- 172.21.15.112:0/1686805281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5b006b340 0x7fb5b01f18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:07.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.452+0000 7fb5af7fe700 1 -- 172.21.15.112:0/1686805281 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a8009c40 con 0x7fb5b015bb90 2023-09-12T16:08:07.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.452+0000 7fb5aeffd700 1 --2- 172.21.15.112:0/1686805281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5b006b340 0x7fb5b01f18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-12T16:08:07.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.453+0000 7fb5af7fe700 1 --2- 172.21.15.112:0/1686805281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5b015bb90 0x7fb5b0158860 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb5b015c0b0 tx=0x7fb5a8007f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:07.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.453+0000 7fb5977fe700 1 -- 172.21.15.112:0/1686805281 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a800e040 con 0x7fb5b015bb90 2023-09-12T16:08:07.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.453+0000 7fb5977fe700 1 -- 172.21.15.112:0/1686805281 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb5a8003c00 con 0x7fb5b015bb90 2023-09-12T16:08:07.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.453+0000 7fb5b55ff700 1 -- 172.21.15.112:0/1686805281 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b015dcf0 con 0x7fb5b015bb90 2023-09-12T16:08:07.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.453+0000 7fb5977fe700 1 -- 172.21.15.112:0/1686805281 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a800bbd0 con 0x7fb5b015bb90 2023-09-12T16:08:07.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.453+0000 7fb5b55ff700 1 -- 172.21.15.112:0/1686805281 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b00ccd40 con 0x7fb5b015bb90 2023-09-12T16:08:07.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.454+0000 7fb5b55ff700 1 -- 172.21.15.112:0/1686805281 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b015d590 con 0x7fb5b015bb90 2023-09-12T16:08:07.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.455+0000 7fb5977fe700 1 -- 172.21.15.112:0/1686805281 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fb5a8004030 con 0x7fb5b015bb90 2023-09-12T16:08:07.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.456+0000 7fb5977fe700 1 --2- 172.21.15.112:0/1686805281 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb59c06a570 0x7fb59c06ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:07.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.456+0000 7fb5977fe700 1 -- 172.21.15.112:0/1686805281 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb5a808aa50 con 0x7fb5b015bb90 2023-09-12T16:08:07.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.456+0000 7fb5aeffd700 1 --2- 172.21.15.112:0/1686805281 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb59c06a570 0x7fb59c06ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:07.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.457+0000 7fb5aeffd700 1 --2- 172.21.15.112:0/1686805281 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb59c06a570 0x7fb59c06ca30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0011550 tx=0x7fb5a00091e0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:07.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.460+0000 7fb5977fe700 1 -- 172.21.15.112:0/1686805281 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb5b015d590 con 0x7fb5b015bb90 2023-09-12T16:08:07.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.659+0000 7fb5b55ff700 1 -- 172.21.15.112:0/1686805281 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb5b015d590 con 0x7fb5b015bb90 2023-09-12T16:08:07.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.659+0000 7fb5977fe700 1 -- 172.21.15.112:0/1686805281 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb5b015d590 con 0x7fb5b015bb90 2023-09-12T16:08:07.660 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-09-12T16:08:07.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.661+0000 7fb5b55ff700 1 -- 172.21.15.112:0/1686805281 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb59c06a570 msgr2=0x7fb59c06ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:07.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.661+0000 7fb5b55ff700 1 --2- 172.21.15.112:0/1686805281 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb59c06a570 0x7fb59c06ca30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0011550 tx=0x7fb5a00091e0 comp rx=0 tx=0).stop 2023-09-12T16:08:07.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.661+0000 7fb5b55ff700 1 -- 172.21.15.112:0/1686805281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5b015bb90 msgr2=0x7fb5b0158860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:07.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.661+0000 7fb5b55ff700 1 --2- 172.21.15.112:0/1686805281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5b015bb90 0x7fb5b0158860 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb5b015c0b0 tx=0x7fb5a8007f80 comp rx=0 tx=0).stop 2023-09-12T16:08:07.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.661+0000 7fb5b55ff700 1 -- 172.21.15.112:0/1686805281 shutdown_connections 2023-09-12T16:08:07.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.661+0000 7fb5b55ff700 1 --2- 172.21.15.112:0/1686805281 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb59c06a570 0x7fb59c06ca30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:07.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.661+0000 7fb5b55ff700 1 --2- 172.21.15.112:0/1686805281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5b015bb90 0x7fb5b0158860 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:07.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.661+0000 7fb5b55ff700 1 --2- 172.21.15.112:0/1686805281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5b006b340 0x7fb5b01f18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:07.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.661+0000 7fb5b55ff700 1 --2- 172.21.15.112:0/1686805281 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5b006c150 0x7fb5b00cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:07.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.661+0000 7fb5b55ff700 1 -- 172.21.15.112:0/1686805281 >> 172.21.15.112:0/1686805281 conn(0x7fb5b00cf5c0 msgr2=0x7fb5b00cf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:07.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.662+0000 7fb5b55ff700 1 -- 172.21.15.112:0/1686805281 shutdown_connections 2023-09-12T16:08:07.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.662+0000 7fb5b55ff700 1 -- 172.21.15.112:0/1686805281 wait complete. 2023-09-12T16:08:07.679 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-12T16:08:07.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.881+0000 7f29b8fff700 1 -- 172.21.15.112:0/506131643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29b415dc20 msgr2=0x7f29b40cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:07.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.881+0000 7f29b8fff700 1 --2- 172.21.15.112:0/506131643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29b415dc20 0x7f29b40cd690 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f29b406fed0 tx=0x7f29a8009c70 comp rx=0 tx=0).stop 2023-09-12T16:08:07.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.881+0000 7f29b8fff700 1 -- 172.21.15.112:0/506131643 shutdown_connections 2023-09-12T16:08:07.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.881+0000 7f29b8fff700 1 --2- 172.21.15.112:0/506131643 >> v2:172.21.15.144:3300/0 conn(0x7f29b40cdbd0 0x7f29b40cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:07.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.881+0000 7f29b8fff700 1 --2- 172.21.15.112:0/506131643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29b415dc20 0x7f29b40cd690 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:07.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.881+0000 7f29b8fff700 1 -- 172.21.15.112:0/506131643 >> 172.21.15.112:0/506131643 conn(0x7f29b406a200 msgr2=0x7f29b406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:07.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.881+0000 7f29b8fff700 1 -- 172.21.15.112:0/506131643 shutdown_connections 2023-09-12T16:08:07.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.881+0000 7f29b8fff700 1 -- 172.21.15.112:0/506131643 wait complete. 2023-09-12T16:08:07.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.883+0000 7f29b8fff700 1 Processor -- start 2023-09-12T16:08:07.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.883+0000 7f29b8fff700 1 -- start start 2023-09-12T16:08:07.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.884+0000 7f29b8fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29b40cdbd0 0x7f29b4158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:07.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.884+0000 7f29b8fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29b4142d80 0x7f29b40c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:07.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.884+0000 7f29b8fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29b415dc20 0x7f29b40c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:07.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.884+0000 7f29b8fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b41f5790 con 0x7f29b4142d80 2023-09-12T16:08:07.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.884+0000 7f29b8fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b41f5a70 con 0x7f29b40cdbd0 2023-09-12T16:08:07.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.884+0000 7f29b8fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b41f5d50 con 0x7f29b415dc20 2023-09-12T16:08:07.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.884+0000 7f29b1d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29b4142d80 0x7f29b40c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:07.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.884+0000 7f29b1d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29b4142d80 0x7f29b40c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58788/0 (socket says 172.21.15.112:58788) 2023-09-12T16:08:07.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.884+0000 7f29b1d9b700 1 -- 172.21.15.112:0/1344460739 learned_addr learned my addr 172.21.15.112:0/1344460739 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:07.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.885+0000 7f29b2d9d700 1 --2- 172.21.15.112:0/1344460739 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29b415dc20 0x7f29b40c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:07.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.885+0000 7f29b1d9b700 1 -- 172.21.15.112:0/1344460739 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29b415dc20 msgr2=0x7f29b40c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:07.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.885+0000 7f29b259c700 1 --2- 172.21.15.112:0/1344460739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29b40cdbd0 0x7f29b4158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:07.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.885+0000 7f29b1d9b700 1 --2- 172.21.15.112:0/1344460739 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29b415dc20 0x7f29b40c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:07.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.885+0000 7f29b1d9b700 1 -- 172.21.15.112:0/1344460739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29b40cdbd0 msgr2=0x7f29b4158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:07.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.885+0000 7f29b1d9b700 1 --2- 172.21.15.112:0/1344460739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29b40cdbd0 0x7f29b4158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:07.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.885+0000 7f29b1d9b700 1 -- 172.21.15.112:0/1344460739 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a80095f0 con 0x7f29b4142d80 2023-09-12T16:08:07.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.885+0000 7f29b2d9d700 1 --2- 172.21.15.112:0/1344460739 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29b415dc20 0x7f29b40c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:07.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.885+0000 7f29b259c700 1 --2- 172.21.15.112:0/1344460739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29b40cdbd0 0x7f29b4158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:07.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.885+0000 7f29b1d9b700 1 --2- 172.21.15.112:0/1344460739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29b4142d80 0x7f29b40c66c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f29b40c9d50 tx=0x7f29a80050d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:07.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.885+0000 7f29a2ffd700 1 -- 172.21.15.112:0/1344460739 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a801c070 con 0x7f29b4142d80 2023-09-12T16:08:07.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.885+0000 7f29a2ffd700 1 -- 172.21.15.112:0/1344460739 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f29a8004260 con 0x7f29b4142d80 2023-09-12T16:08:07.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.885+0000 7f29a2ffd700 1 -- 172.21.15.112:0/1344460739 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a800b760 con 0x7f29b4142d80 2023-09-12T16:08:07.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.885+0000 7f29b8fff700 1 -- 172.21.15.112:0/1344460739 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b41f6030 con 0x7f29b4142d80 2023-09-12T16:08:07.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.885+0000 7f29b8fff700 1 -- 172.21.15.112:0/1344460739 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b40c8960 con 0x7f29b4142d80 2023-09-12T16:08:07.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.886+0000 7f29b8fff700 1 -- 172.21.15.112:0/1344460739 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b41f6550 con 0x7f29b4142d80 2023-09-12T16:08:07.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.887+0000 7f29a2ffd700 1 -- 172.21.15.112:0/1344460739 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f29a800b8c0 con 0x7f29b4142d80 2023-09-12T16:08:07.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.888+0000 7f29a2ffd700 1 --2- 172.21.15.112:0/1344460739 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f299406a580 0x7f299406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:07.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.888+0000 7f29a2ffd700 1 -- 172.21.15.112:0/1344460739 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f29a808a420 con 0x7f29b4142d80 2023-09-12T16:08:07.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.888+0000 7f29b259c700 1 --2- 172.21.15.112:0/1344460739 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f299406a580 0x7f299406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:07.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.889+0000 7f29b259c700 1 --2- 172.21.15.112:0/1344460739 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f299406a580 0x7f299406ca40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f29a4003f40 tx=0x7f29a4009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:07.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:07.893+0000 7f29a2ffd700 1 -- 172.21.15.112:0/1344460739 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f29b41f6550 con 0x7f29b4142d80 2023-09-12T16:08:08.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.087+0000 7f29b8fff700 1 -- 172.21.15.112:0/1344460739 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f29b41f6550 con 0x7f29b4142d80 2023-09-12T16:08:08.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.088+0000 7f29a2ffd700 1 -- 172.21.15.112:0/1344460739 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f29b41f6550 con 0x7f29b4142d80 2023-09-12T16:08:08.088 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:08:08.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.090+0000 7f29b8fff700 1 -- 172.21.15.112:0/1344460739 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f299406a580 msgr2=0x7f299406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:08.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.090+0000 7f29b8fff700 1 --2- 172.21.15.112:0/1344460739 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f299406a580 0x7f299406ca40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f29a4003f40 tx=0x7f29a4009040 comp rx=0 tx=0).stop 2023-09-12T16:08:08.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.090+0000 7f29b8fff700 1 -- 172.21.15.112:0/1344460739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29b4142d80 msgr2=0x7f29b40c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:08.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.090+0000 7f29b8fff700 1 --2- 172.21.15.112:0/1344460739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29b4142d80 0x7f29b40c66c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f29b40c9d50 tx=0x7f29a80050d0 comp rx=0 tx=0).stop 2023-09-12T16:08:08.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.090+0000 7f29b8fff700 1 -- 172.21.15.112:0/1344460739 shutdown_connections 2023-09-12T16:08:08.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.090+0000 7f29b8fff700 1 --2- 172.21.15.112:0/1344460739 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f299406a580 0x7f299406ca40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:08.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.090+0000 7f29b8fff700 1 --2- 172.21.15.112:0/1344460739 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29b415dc20 0x7f29b40c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:08.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.090+0000 7f29b8fff700 1 --2- 172.21.15.112:0/1344460739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29b40cdbd0 0x7f29b4158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:08.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.090+0000 7f29b8fff700 1 --2- 172.21.15.112:0/1344460739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29b4142d80 0x7f29b40c66c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:08.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.090+0000 7f29b8fff700 1 -- 172.21.15.112:0/1344460739 >> 172.21.15.112:0/1344460739 conn(0x7f29b406a200 msgr2=0x7f29b406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:08.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.090+0000 7f29b8fff700 1 -- 172.21.15.112:0/1344460739 shutdown_connections 2023-09-12T16:08:08.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.090+0000 7f29b8fff700 1 -- 172.21.15.112:0/1344460739 wait complete. 2023-09-12T16:08:08.108 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-12T16:08:08.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.309+0000 7fc0ac3ff700 1 -- 172.21.15.112:0/385027440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a40d05d0 msgr2=0x7fc0a4165930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:08.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.309+0000 7fc0ac3ff700 1 --2- 172.21.15.112:0/385027440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a40d05d0 0x7fc0a4165930 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc0a409f880 tx=0x7fc09c00b380 comp rx=0 tx=0).stop 2023-09-12T16:08:08.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.309+0000 7fc0ac3ff700 1 -- 172.21.15.112:0/385027440 shutdown_connections 2023-09-12T16:08:08.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.309+0000 7fc0ac3ff700 1 --2- 172.21.15.112:0/385027440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a40d05d0 0x7fc0a4165930 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:08.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.309+0000 7fc0ac3ff700 1 --2- 172.21.15.112:0/385027440 >> v2:172.21.15.144:3300/0 conn(0x7fc0a415ba80 0x7fc0a40cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:08.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.309+0000 7fc0ac3ff700 1 -- 172.21.15.112:0/385027440 >> 172.21.15.112:0/385027440 conn(0x7fc0a4088ff0 msgr2=0x7fc0a40d1900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:08.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.309+0000 7fc0ac3ff700 1 -- 172.21.15.112:0/385027440 shutdown_connections 2023-09-12T16:08:08.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.309+0000 7fc0ac3ff700 1 -- 172.21.15.112:0/385027440 wait complete. 2023-09-12T16:08:08.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.311+0000 7fc0ac3ff700 1 Processor -- start 2023-09-12T16:08:08.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.311+0000 7fc0ac3ff700 1 -- start start 2023-09-12T16:08:08.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.312+0000 7fc0ac3ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a40cfa10 0x7fc0a415ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:08.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.312+0000 7fc0ac3ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0a40d05d0 0x7fc0a415a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:08.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.312+0000 7fc0ac3ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0a415ba80 0x7fc0a414dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:08.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.312+0000 7fc0ac3ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40c9ac0 con 0x7fc0a40cfa10 2023-09-12T16:08:08.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.312+0000 7fc0ac3ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a415c2a0 con 0x7fc0a40d05d0 2023-09-12T16:08:08.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.312+0000 7fc0ac3ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40c8f40 con 0x7fc0a415ba80 2023-09-12T16:08:08.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.312+0000 7fc0aa19b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a40cfa10 0x7fc0a415ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:08.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.312+0000 7fc0aa19b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a40cfa10 0x7fc0a415ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58796/0 (socket says 172.21.15.112:58796) 2023-09-12T16:08:08.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.312+0000 7fc0aa19b700 1 -- 172.21.15.112:0/448839913 learned_addr learned my addr 172.21.15.112:0/448839913 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:08.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.313+0000 7fc0aa99c700 1 --2- 172.21.15.112:0/448839913 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0a415ba80 0x7fc0a414dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:08.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.313+0000 7fc0aa19b700 1 -- 172.21.15.112:0/448839913 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0a415ba80 msgr2=0x7fc0a414dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:08.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.313+0000 7fc0a999a700 1 --2- 172.21.15.112:0/448839913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0a40d05d0 0x7fc0a415a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:08.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.313+0000 7fc0aa19b700 1 --2- 172.21.15.112:0/448839913 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0a415ba80 0x7fc0a414dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:08.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.313+0000 7fc0aa19b700 1 -- 172.21.15.112:0/448839913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0a40d05d0 msgr2=0x7fc0a415a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:08.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.313+0000 7fc0aa19b700 1 --2- 172.21.15.112:0/448839913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0a40d05d0 0x7fc0a415a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:08.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.313+0000 7fc0aa19b700 1 -- 172.21.15.112:0/448839913 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c009d00 con 0x7fc0a40cfa10 2023-09-12T16:08:08.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.313+0000 7fc0aa99c700 1 --2- 172.21.15.112:0/448839913 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0a415ba80 0x7fc0a414dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:08.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.313+0000 7fc0a999a700 1 --2- 172.21.15.112:0/448839913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0a40d05d0 0x7fc0a415a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:08.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.313+0000 7fc0aa19b700 1 --2- 172.21.15.112:0/448839913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a40cfa10 0x7fc0a415ecd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000d950 tx=0x7fc0a000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:08.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.313+0000 7fc09affd700 1 -- 172.21.15.112:0/448839913 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0009b40 con 0x7fc0a40cfa10 2023-09-12T16:08:08.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.313+0000 7fc09affd700 1 -- 172.21.15.112:0/448839913 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc0a0009d90 con 0x7fc0a40cfa10 2023-09-12T16:08:08.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.313+0000 7fc0ac3ff700 1 -- 172.21.15.112:0/448839913 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a40c9220 con 0x7fc0a40cfa10 2023-09-12T16:08:08.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.313+0000 7fc09affd700 1 -- 172.21.15.112:0/448839913 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a00106c0 con 0x7fc0a40cfa10 2023-09-12T16:08:08.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.313+0000 7fc0ac3ff700 1 -- 172.21.15.112:0/448839913 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a40c97e0 con 0x7fc0a40cfa10 2023-09-12T16:08:08.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.314+0000 7fc0ac3ff700 1 -- 172.21.15.112:0/448839913 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a4154cc0 con 0x7fc0a40cfa10 2023-09-12T16:08:08.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.315+0000 7fc09affd700 1 -- 172.21.15.112:0/448839913 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fc0a0010820 con 0x7fc0a40cfa10 2023-09-12T16:08:08.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.316+0000 7fc09affd700 1 --2- 172.21.15.112:0/448839913 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc08806a580 0x7fc08806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:08.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.316+0000 7fc09affd700 1 -- 172.21.15.112:0/448839913 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc0a0089650 con 0x7fc0a40cfa10 2023-09-12T16:08:08.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.316+0000 7fc0a999a700 1 --2- 172.21.15.112:0/448839913 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc08806a580 0x7fc08806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:08.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.317+0000 7fc0a999a700 1 --2- 172.21.15.112:0/448839913 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc08806a580 0x7fc08806ca40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc094006fd0 tx=0x7fc094008040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:08.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.320+0000 7fc09affd700 1 -- 172.21.15.112:0/448839913 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fc0a00546c0 con 0x7fc0a40cfa10 2023-09-12T16:08:08.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.533+0000 7fc0ac3ff700 1 -- 172.21.15.112:0/448839913 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc0a404e300 con 0x7fc0a40cfa10 2023-09-12T16:08:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.533+0000 7fc09affd700 1 -- 172.21.15.112:0/448839913 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc0a0016080 con 0x7fc0a40cfa10 2023-09-12T16:08:08.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.536+0000 7fc0ac3ff700 1 -- 172.21.15.112:0/448839913 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc08806a580 msgr2=0x7fc08806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:08.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.536+0000 7fc0ac3ff700 1 --2- 172.21.15.112:0/448839913 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc08806a580 0x7fc08806ca40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc094006fd0 tx=0x7fc094008040 comp rx=0 tx=0).stop 2023-09-12T16:08:08.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.536+0000 7fc0ac3ff700 1 -- 172.21.15.112:0/448839913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a40cfa10 msgr2=0x7fc0a415ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:08.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.536+0000 7fc0ac3ff700 1 --2- 172.21.15.112:0/448839913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a40cfa10 0x7fc0a415ecd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000d950 tx=0x7fc0a000dd10 comp rx=0 tx=0).stop 2023-09-12T16:08:08.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.536+0000 7fc0ac3ff700 1 -- 172.21.15.112:0/448839913 shutdown_connections 2023-09-12T16:08:08.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.536+0000 7fc0ac3ff700 1 --2- 172.21.15.112:0/448839913 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc08806a580 0x7fc08806ca40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:08.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.536+0000 7fc0ac3ff700 1 --2- 172.21.15.112:0/448839913 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0a415ba80 0x7fc0a414dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:08.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.536+0000 7fc0ac3ff700 1 --2- 172.21.15.112:0/448839913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a40cfa10 0x7fc0a415ecd0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:08.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.536+0000 7fc0ac3ff700 1 --2- 172.21.15.112:0/448839913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0a40d05d0 0x7fc0a415a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:08.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.536+0000 7fc0ac3ff700 1 -- 172.21.15.112:0/448839913 >> 172.21.15.112:0/448839913 conn(0x7fc0a4088ff0 msgr2=0x7fc0a40cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:08.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.536+0000 7fc0ac3ff700 1 -- 172.21.15.112:0/448839913 shutdown_connections 2023-09-12T16:08:08.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:08.536+0000 7fc0ac3ff700 1 -- 172.21.15.112:0/448839913 wait complete. 2023-09-12T16:08:08.539 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2023-09-12T16:08:08.556 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-12T16:08:08.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:08:08.557 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-09-12T16:08:08.654 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-09-12T16:08:08.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:08:08.655 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-12T16:08:08.713 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:08:08.714 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T16:08:08.761 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:08:08.761 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T16:08:08.848 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:08:08.849 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T16:08:08.936 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:08:09.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.175+0000 7fcf899ff700 1 -- 172.21.15.112:0/3555486747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf6c005210 msgr2=0x7fcf6c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:09.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.175+0000 7fcf899ff700 1 --2- 172.21.15.112:0/3555486747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf6c005210 0x7fcf6c00ba10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00c640 tx=0x7fcf6c005880 comp rx=0 tx=0).stop 2023-09-12T16:08:09.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.176+0000 7fcf899ff700 1 -- 172.21.15.112:0/3555486747 shutdown_connections 2023-09-12T16:08:09.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.176+0000 7fcf899ff700 1 --2- 172.21.15.112:0/3555486747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf6c005210 0x7fcf6c00ba10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:09.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.176+0000 7fcf899ff700 1 -- 172.21.15.112:0/3555486747 >> 172.21.15.112:0/3555486747 conn(0x7fcf8409abe0 msgr2=0x7fcf840d18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:09.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.176+0000 7fcf899ff700 1 -- 172.21.15.112:0/3555486747 shutdown_connections 2023-09-12T16:08:09.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.176+0000 7fcf899ff700 1 -- 172.21.15.112:0/3555486747 wait complete. 2023-09-12T16:08:09.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.177+0000 7fcf899ff700 1 Processor -- start 2023-09-12T16:08:09.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.177+0000 7fcf899ff700 1 -- start start 2023-09-12T16:08:09.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.178+0000 7fcf899ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf6c005210 0x7fcf840c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:09.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.178+0000 7fcf899ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf841f64d0 0x7fcf841f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:09.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.178+0000 7fcf899ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf840cb1c0 0x7fcf84158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:09.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.178+0000 7fcf899ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840c9b50 con 0x7fcf840cb1c0 2023-09-12T16:08:09.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.178+0000 7fcf899ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840ca400 con 0x7fcf6c005210 2023-09-12T16:08:09.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.178+0000 7fcf899ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840ca6e0 con 0x7fcf841f64d0 2023-09-12T16:08:09.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.179+0000 7fcf837fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf840cb1c0 0x7fcf84158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:09.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.179+0000 7fcf837fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf840cb1c0 0x7fcf84158720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58806/0 (socket says 172.21.15.112:58806) 2023-09-12T16:08:09.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.179+0000 7fcf837fe700 1 -- 172.21.15.112:0/4256877404 learned_addr learned my addr 172.21.15.112:0/4256877404 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:09.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.179+0000 7fcf837fe700 1 -- 172.21.15.112:0/4256877404 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf841f64d0 msgr2=0x7fcf841f5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:09.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.179+0000 7fcf837fe700 1 --2- 172.21.15.112:0/4256877404 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf841f64d0 0x7fcf841f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:09.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.179+0000 7fcf82ffd700 1 --2- 172.21.15.112:0/4256877404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf6c005210 0x7fcf840c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:09.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.179+0000 7fcf837fe700 1 -- 172.21.15.112:0/4256877404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf6c005210 msgr2=0x7fcf840c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:09.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.179+0000 7fcf837fe700 1 --2- 172.21.15.112:0/4256877404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf6c005210 0x7fcf840c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:09.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.179+0000 7fcf837fe700 1 -- 172.21.15.112:0/4256877404 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf840ca9c0 con 0x7fcf840cb1c0 2023-09-12T16:08:09.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.179+0000 7fcf82ffd700 1 --2- 172.21.15.112:0/4256877404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf6c005210 0x7fcf840c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:09.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.179+0000 7fcf837fe700 1 --2- 172.21.15.112:0/4256877404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf840cb1c0 0x7fcf84158720 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcf8408b9d0 tx=0x7fcf7c006fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:09.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.179+0000 7fcf6bfff700 1 -- 172.21.15.112:0/4256877404 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c01f070 con 0x7fcf840cb1c0 2023-09-12T16:08:09.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.180+0000 7fcf6bfff700 1 -- 172.21.15.112:0/4256877404 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcf7c003e00 con 0x7fcf840cb1c0 2023-09-12T16:08:09.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.180+0000 7fcf899ff700 1 -- 172.21.15.112:0/4256877404 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf840caca0 con 0x7fcf840cb1c0 2023-09-12T16:08:09.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.180+0000 7fcf6bfff700 1 -- 172.21.15.112:0/4256877404 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c006330 con 0x7fcf840cb1c0 2023-09-12T16:08:09.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.180+0000 7fcf899ff700 1 -- 172.21.15.112:0/4256877404 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf841f60e0 con 0x7fcf840cb1c0 2023-09-12T16:08:09.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.181+0000 7fcf899ff700 1 -- 172.21.15.112:0/4256877404 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf841f62d0 con 0x7fcf840cb1c0 2023-09-12T16:08:09.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.182+0000 7fcf6bfff700 1 -- 172.21.15.112:0/4256877404 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fcf7c006490 con 0x7fcf840cb1c0 2023-09-12T16:08:09.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.182+0000 7fcf6bfff700 1 --2- 172.21.15.112:0/4256877404 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcf7006a580 0x7fcf7006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:09.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.183+0000 7fcf6bfff700 1 -- 172.21.15.112:0/4256877404 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fcf7c089eb0 con 0x7fcf840cb1c0 2023-09-12T16:08:09.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.183+0000 7fcf82ffd700 1 --2- 172.21.15.112:0/4256877404 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcf7006a580 0x7fcf7006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:09.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.183+0000 7fcf82ffd700 1 --2- 172.21.15.112:0/4256877404 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcf7006a580 0x7fcf7006ca40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcf74005970 tx=0x7fcf740091e0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:09.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.187+0000 7fcf6bfff700 1 -- 172.21.15.112:0/4256877404 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fcf7c055040 con 0x7fcf840cb1c0 2023-09-12T16:08:09.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.387+0000 7fcf899ff700 1 -- 172.21.15.112:0/4256877404 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf8404e300 con 0x7fcf840cb1c0 2023-09-12T16:08:09.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.388+0000 7fcf6bfff700 1 -- 172.21.15.112:0/4256877404 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18816 (secure 0 0 0) 0x7fcf7c058660 con 0x7fcf840cb1c0 2023-09-12T16:08:09.388 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:09.389 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:44.445226+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:08:09.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.390+0000 7fcf899ff700 1 -- 172.21.15.112:0/4256877404 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcf7006a580 msgr2=0x7fcf7006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:09.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.390+0000 7fcf899ff700 1 --2- 172.21.15.112:0/4256877404 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcf7006a580 0x7fcf7006ca40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcf74005970 tx=0x7fcf740091e0 comp rx=0 tx=0).stop 2023-09-12T16:08:09.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.390+0000 7fcf899ff700 1 -- 172.21.15.112:0/4256877404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf840cb1c0 msgr2=0x7fcf84158720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:09.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.390+0000 7fcf899ff700 1 --2- 172.21.15.112:0/4256877404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf840cb1c0 0x7fcf84158720 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcf8408b9d0 tx=0x7fcf7c006fd0 comp rx=0 tx=0).stop 2023-09-12T16:08:09.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.390+0000 7fcf899ff700 1 -- 172.21.15.112:0/4256877404 shutdown_connections 2023-09-12T16:08:09.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.390+0000 7fcf899ff700 1 --2- 172.21.15.112:0/4256877404 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fcf7006a580 0x7fcf7006ca40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:09.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.390+0000 7fcf899ff700 1 --2- 172.21.15.112:0/4256877404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf840cb1c0 0x7fcf84158720 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:09.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.390+0000 7fcf899ff700 1 --2- 172.21.15.112:0/4256877404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf6c005210 0x7fcf840c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:09.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.390+0000 7fcf899ff700 1 --2- 172.21.15.112:0/4256877404 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf841f64d0 0x7fcf841f5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:09.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.390+0000 7fcf899ff700 1 -- 172.21.15.112:0/4256877404 >> 172.21.15.112:0/4256877404 conn(0x7fcf8409abe0 msgr2=0x7fcf840b5310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:09.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.391+0000 7fcf899ff700 1 -- 172.21.15.112:0/4256877404 shutdown_connections 2023-09-12T16:08:09.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.391+0000 7fcf899ff700 1 -- 172.21.15.112:0/4256877404 wait complete. 2023-09-12T16:08:09.408 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-12T16:06:48.871680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-12T16:06:58.137223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-12T16:06:58.684034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-12T16:07:02.283459+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-12T16:08:09.409 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-12T16:08:09.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.612+0000 7fe979bff700 1 -- 172.21.15.112:0/3528780438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe960005210 msgr2=0x7fe96000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:09.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.612+0000 7fe979bff700 1 --2- 172.21.15.112:0/3528780438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe960005210 0x7fe96000ba10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00e4c0 tx=0x7fe960005880 comp rx=0 tx=0).stop 2023-09-12T16:08:09.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.612+0000 7fe979bff700 1 -- 172.21.15.112:0/3528780438 shutdown_connections 2023-09-12T16:08:09.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.612+0000 7fe979bff700 1 --2- 172.21.15.112:0/3528780438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe960005210 0x7fe96000ba10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:09.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.612+0000 7fe979bff700 1 -- 172.21.15.112:0/3528780438 >> 172.21.15.112:0/3528780438 conn(0x7fe9740d17d0 msgr2=0x7fe9740d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:09.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.612+0000 7fe979bff700 1 -- 172.21.15.112:0/3528780438 shutdown_connections 2023-09-12T16:08:09.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.612+0000 7fe979bff700 1 -- 172.21.15.112:0/3528780438 wait complete. 2023-09-12T16:08:09.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.614+0000 7fe979bff700 1 Processor -- start 2023-09-12T16:08:09.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.614+0000 7fe979bff700 1 -- start start 2023-09-12T16:08:09.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.615+0000 7fe979bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe960005210 0x7fe974155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:09.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.615+0000 7fe979bff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9741e5870 0x7fe9741e5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:09.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.615+0000 7fe979bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe974158b60 0x7fe974159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:09.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.615+0000 7fe979bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9741e7040 con 0x7fe974158b60 2023-09-12T16:08:09.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.615+0000 7fe979bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe974159550 con 0x7fe960005210 2023-09-12T16:08:09.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.615+0000 7fe979bff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe974155b70 con 0x7fe9741e5870 2023-09-12T16:08:09.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.615+0000 7fe973fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe974158b60 0x7fe974159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:09.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.615+0000 7fe973fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe974158b60 0x7fe974159010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58816/0 (socket says 172.21.15.112:58816) 2023-09-12T16:08:09.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.615+0000 7fe973fff700 1 -- 172.21.15.112:0/1644280770 learned_addr learned my addr 172.21.15.112:0/1644280770 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:09.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.615+0000 7fe96bfff700 1 --2- 172.21.15.112:0/1644280770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9741e5870 0x7fe9741e5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:09.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.616+0000 7fe9737fe700 1 --2- 172.21.15.112:0/1644280770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe960005210 0x7fe974155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:09.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.616+0000 7fe973fff700 1 -- 172.21.15.112:0/1644280770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9741e5870 msgr2=0x7fe9741e5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:09.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.616+0000 7fe973fff700 1 --2- 172.21.15.112:0/1644280770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9741e5870 0x7fe9741e5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:09.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.616+0000 7fe973fff700 1 -- 172.21.15.112:0/1644280770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe960005210 msgr2=0x7fe974155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:09.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.616+0000 7fe973fff700 1 --2- 172.21.15.112:0/1644280770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe960005210 0x7fe974155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:09.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.616+0000 7fe973fff700 1 -- 172.21.15.112:0/1644280770 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9741e63c0 con 0x7fe974158b60 2023-09-12T16:08:09.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.616+0000 7fe96bfff700 1 --2- 172.21.15.112:0/1644280770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9741e5870 0x7fe9741e5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:08:09.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.616+0000 7fe973fff700 1 --2- 172.21.15.112:0/1644280770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe974158b60 0x7fe974159010 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe9740cda70 tx=0x7fe96c009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:09.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.616+0000 7fe970ff9700 1 -- 172.21.15.112:0/1644280770 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c022070 con 0x7fe974158b60 2023-09-12T16:08:09.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.616+0000 7fe970ff9700 1 -- 172.21.15.112:0/1644280770 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe96c003c10 con 0x7fe974158b60 2023-09-12T16:08:09.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.616+0000 7fe979bff700 1 -- 172.21.15.112:0/1644280770 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9741e66a0 con 0x7fe974158b60 2023-09-12T16:08:09.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.616+0000 7fe970ff9700 1 -- 172.21.15.112:0/1644280770 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c004030 con 0x7fe974158b60 2023-09-12T16:08:09.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.616+0000 7fe979bff700 1 -- 172.21.15.112:0/1644280770 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9741e6c60 con 0x7fe974158b60 2023-09-12T16:08:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.617+0000 7fe979bff700 1 -- 172.21.15.112:0/1644280770 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe974073ea0 con 0x7fe974158b60 2023-09-12T16:08:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.618+0000 7fe970ff9700 1 -- 172.21.15.112:0/1644280770 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe96c01b040 con 0x7fe974158b60 2023-09-12T16:08:09.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.619+0000 7fe970ff9700 1 --2- 172.21.15.112:0/1644280770 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe95406a580 0x7fe95406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:09.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.619+0000 7fe970ff9700 1 -- 172.21.15.112:0/1644280770 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe96c089960 con 0x7fe974158b60 2023-09-12T16:08:09.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.619+0000 7fe9737fe700 1 --2- 172.21.15.112:0/1644280770 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe95406a580 0x7fe95406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:09.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.620+0000 7fe9737fe700 1 --2- 172.21.15.112:0/1644280770 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe95406a580 0x7fe95406ca40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe9640068e0 tx=0x7fe964006870 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:09.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.624+0000 7fe970ff9700 1 -- 172.21.15.112:0/1644280770 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe96c054af0 con 0x7fe974158b60 2023-09-12T16:08:09.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.818+0000 7fe979bff700 1 -- 172.21.15.112:0/1644280770 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe97408b860 con 0x7fe974158b60 2023-09-12T16:08:09.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.818+0000 7fe970ff9700 1 -- 172.21.15.112:0/1644280770 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe96c058110 con 0x7fe974158b60 2023-09-12T16:08:09.819 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-09-12T16:08:09.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.821+0000 7fe979bff700 1 -- 172.21.15.112:0/1644280770 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe95406a580 msgr2=0x7fe95406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:09.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.821+0000 7fe979bff700 1 --2- 172.21.15.112:0/1644280770 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe95406a580 0x7fe95406ca40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe9640068e0 tx=0x7fe964006870 comp rx=0 tx=0).stop 2023-09-12T16:08:09.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.821+0000 7fe979bff700 1 -- 172.21.15.112:0/1644280770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe974158b60 msgr2=0x7fe974159010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:09.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.821+0000 7fe979bff700 1 --2- 172.21.15.112:0/1644280770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe974158b60 0x7fe974159010 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe9740cda70 tx=0x7fe96c009380 comp rx=0 tx=0).stop 2023-09-12T16:08:09.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.821+0000 7fe979bff700 1 -- 172.21.15.112:0/1644280770 shutdown_connections 2023-09-12T16:08:09.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.821+0000 7fe979bff700 1 --2- 172.21.15.112:0/1644280770 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fe95406a580 0x7fe95406ca40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:09.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.821+0000 7fe979bff700 1 --2- 172.21.15.112:0/1644280770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe974158b60 0x7fe974159010 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:09.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.821+0000 7fe979bff700 1 --2- 172.21.15.112:0/1644280770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe960005210 0x7fe974155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:09.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.821+0000 7fe979bff700 1 --2- 172.21.15.112:0/1644280770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9741e5870 0x7fe9741e5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:09.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.821+0000 7fe979bff700 1 -- 172.21.15.112:0/1644280770 >> 172.21.15.112:0/1644280770 conn(0x7fe9740d17d0 msgr2=0x7fe97415adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:09.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.821+0000 7fe979bff700 1 -- 172.21.15.112:0/1644280770 shutdown_connections 2023-09-12T16:08:09.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:09.821+0000 7fe979bff700 1 -- 172.21.15.112:0/1644280770 wait complete. 2023-09-12T16:08:09.839 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-12T16:08:10.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.041+0000 7f90cb1ff700 1 -- 172.21.15.112:0/649359298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90c40cfdb0 msgr2=0x7f90c40d0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:10.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.041+0000 7f90cb1ff700 1 --2- 172.21.15.112:0/649359298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90c40cfdb0 0x7f90c40d0220 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009fd0 tx=0x7f90bc00b380 comp rx=0 tx=0).stop 2023-09-12T16:08:10.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.041+0000 7f90cb1ff700 1 -- 172.21.15.112:0/649359298 shutdown_connections 2023-09-12T16:08:10.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.041+0000 7f90cb1ff700 1 --2- 172.21.15.112:0/649359298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90c40cfdb0 0x7f90c40d0220 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:10.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.041+0000 7f90cb1ff700 1 --2- 172.21.15.112:0/649359298 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90c40cf5b0 0x7f90c40cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:10.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.041+0000 7f90cb1ff700 1 -- 172.21.15.112:0/649359298 >> 172.21.15.112:0/649359298 conn(0x7f90c40d17d0 msgr2=0x7f90c40d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:10.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.041+0000 7f90cb1ff700 1 -- 172.21.15.112:0/649359298 shutdown_connections 2023-09-12T16:08:10.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.042+0000 7f90cb1ff700 1 -- 172.21.15.112:0/649359298 wait complete. 2023-09-12T16:08:10.045 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.043+0000 7f90cb1ff700 1 Processor -- start 2023-09-12T16:08:10.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.043+0000 7f90cb1ff700 1 -- start start 2023-09-12T16:08:10.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.044+0000 7f90cb1ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90c40cfdb0 0x7f90c40c5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:10.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.044+0000 7f90cb1ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90c415bca0 0x7f90c40c7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:10.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.044+0000 7f90cb1ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90c40c7580 0x7f90c41f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:10.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.044+0000 7f90cb1ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c40c8700 con 0x7f90c40cfdb0 2023-09-12T16:08:10.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.044+0000 7f90cb1ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c40cb5e0 con 0x7f90c40c7580 2023-09-12T16:08:10.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.044+0000 7f90cb1ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c40c5840 con 0x7f90c415bca0 2023-09-12T16:08:10.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.044+0000 7f90c8f9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90c40cfdb0 0x7f90c40c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:10.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.044+0000 7f90c8f9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90c40cfdb0 0x7f90c40c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58820/0 (socket says 172.21.15.112:58820) 2023-09-12T16:08:10.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.044+0000 7f90c8f9b700 1 -- 172.21.15.112:0/1638017659 learned_addr learned my addr 172.21.15.112:0/1638017659 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:10.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.044+0000 7f90c3fff700 1 --2- 172.21.15.112:0/1638017659 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90c415bca0 0x7f90c40c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:10.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.045+0000 7f90c979c700 1 --2- 172.21.15.112:0/1638017659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90c40c7580 0x7f90c41f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:10.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.045+0000 7f90c8f9b700 1 -- 172.21.15.112:0/1638017659 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90c415bca0 msgr2=0x7f90c40c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:10.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.045+0000 7f90c8f9b700 1 --2- 172.21.15.112:0/1638017659 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90c415bca0 0x7f90c40c7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:10.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.045+0000 7f90c8f9b700 1 -- 172.21.15.112:0/1638017659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90c40c7580 msgr2=0x7f90c41f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:10.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.045+0000 7f90c8f9b700 1 --2- 172.21.15.112:0/1638017659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90c40c7580 0x7f90c41f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:10.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.045+0000 7f90c8f9b700 1 -- 172.21.15.112:0/1638017659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc009d00 con 0x7f90c40cfdb0 2023-09-12T16:08:10.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.045+0000 7f90c979c700 1 --2- 172.21.15.112:0/1638017659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90c40c7580 0x7f90c41f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:08:10.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.045+0000 7f90c8f9b700 1 --2- 172.21.15.112:0/1638017659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90c40cfdb0 0x7f90c40c5300 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f90b800c550 tx=0x7f90b800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:10.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.045+0000 7f90c17fa700 1 -- 172.21.15.112:0/1638017659 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b80054e0 con 0x7f90c40cfdb0 2023-09-12T16:08:10.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.045+0000 7f90c17fa700 1 -- 172.21.15.112:0/1638017659 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f90b8003680 con 0x7f90c40cfdb0 2023-09-12T16:08:10.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.045+0000 7f90cb1ff700 1 -- 172.21.15.112:0/1638017659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c40c7b80 con 0x7f90c40cfdb0 2023-09-12T16:08:10.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.045+0000 7f90c17fa700 1 -- 172.21.15.112:0/1638017659 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b8003a90 con 0x7f90c40cfdb0 2023-09-12T16:08:10.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.045+0000 7f90cb1ff700 1 -- 172.21.15.112:0/1638017659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c40c8140 con 0x7f90c40cfdb0 2023-09-12T16:08:10.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.047+0000 7f90cb1ff700 1 -- 172.21.15.112:0/1638017659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c4073ea0 con 0x7f90c40cfdb0 2023-09-12T16:08:10.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.047+0000 7f90c17fa700 1 -- 172.21.15.112:0/1638017659 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f90b8003bf0 con 0x7f90c40cfdb0 2023-09-12T16:08:10.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.049+0000 7f90c17fa700 1 --2- 172.21.15.112:0/1638017659 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f90a806a580 0x7f90a806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:10.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.049+0000 7f90c17fa700 1 -- 172.21.15.112:0/1638017659 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f90b8088380 con 0x7f90c40cfdb0 2023-09-12T16:08:10.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.049+0000 7f90c3fff700 1 --2- 172.21.15.112:0/1638017659 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f90a806a580 0x7f90a806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:10.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.049+0000 7f90c3fff700 1 --2- 172.21.15.112:0/1638017659 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f90a806a580 0x7f90a806ca40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f90c406d210 tx=0x7f90b000b410 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:10.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.053+0000 7f90c17fa700 1 -- 172.21.15.112:0/1638017659 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f90b8053520 con 0x7f90c40cfdb0 2023-09-12T16:08:10.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.248+0000 7f90cb1ff700 1 -- 172.21.15.112:0/1638017659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f90c408b860 con 0x7f90c40cfdb0 2023-09-12T16:08:10.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.249+0000 7f90c17fa700 1 -- 172.21.15.112:0/1638017659 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f90b8056b40 con 0x7f90c40cfdb0 2023-09-12T16:08:10.249 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:08:10.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.251+0000 7f90cb1ff700 1 -- 172.21.15.112:0/1638017659 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f90a806a580 msgr2=0x7f90a806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:10.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.251+0000 7f90cb1ff700 1 --2- 172.21.15.112:0/1638017659 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f90a806a580 0x7f90a806ca40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f90c406d210 tx=0x7f90b000b410 comp rx=0 tx=0).stop 2023-09-12T16:08:10.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.251+0000 7f90cb1ff700 1 -- 172.21.15.112:0/1638017659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90c40cfdb0 msgr2=0x7f90c40c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:10.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.251+0000 7f90cb1ff700 1 --2- 172.21.15.112:0/1638017659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90c40cfdb0 0x7f90c40c5300 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f90b800c550 tx=0x7f90b800c860 comp rx=0 tx=0).stop 2023-09-12T16:08:10.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.251+0000 7f90cb1ff700 1 -- 172.21.15.112:0/1638017659 shutdown_connections 2023-09-12T16:08:10.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.251+0000 7f90cb1ff700 1 --2- 172.21.15.112:0/1638017659 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f90a806a580 0x7f90a806ca40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:10.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.251+0000 7f90cb1ff700 1 --2- 172.21.15.112:0/1638017659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90c40c7580 0x7f90c41f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:10.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.251+0000 7f90cb1ff700 1 --2- 172.21.15.112:0/1638017659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90c40cfdb0 0x7f90c40c5300 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:10.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.251+0000 7f90cb1ff700 1 --2- 172.21.15.112:0/1638017659 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90c415bca0 0x7f90c40c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:10.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.251+0000 7f90cb1ff700 1 -- 172.21.15.112:0/1638017659 >> 172.21.15.112:0/1638017659 conn(0x7f90c40d17d0 msgr2=0x7f90c40af110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:10.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.251+0000 7f90cb1ff700 1 -- 172.21.15.112:0/1638017659 shutdown_connections 2023-09-12T16:08:10.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.251+0000 7f90cb1ff700 1 -- 172.21.15.112:0/1638017659 wait complete. 2023-09-12T16:08:10.269 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-12T16:08:10.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.472+0000 7f71c1bff700 1 -- 172.21.15.112:0/4158723277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71a4003a30 msgr2=0x7f71a4003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:10.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.472+0000 7f71c1bff700 1 --2- 172.21.15.112:0/4158723277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71a4003a30 0x7f71a4003e50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f71ac00c310 tx=0x7f71a4005880 comp rx=0 tx=0).stop 2023-09-12T16:08:10.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.472+0000 7f71bbfff700 1 -- 172.21.15.112:0/4158723277 reap_dead start 2023-09-12T16:08:10.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.473+0000 7f71c1bff700 1 -- 172.21.15.112:0/4158723277 shutdown_connections 2023-09-12T16:08:10.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.473+0000 7f71c1bff700 1 -- 172.21.15.112:0/4158723277 >> 172.21.15.112:0/4158723277 conn(0x7f71bc0d17d0 msgr2=0x7f71bc0d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:10.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.473+0000 7f71c1bff700 1 -- 172.21.15.112:0/4158723277 shutdown_connections 2023-09-12T16:08:10.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.473+0000 7f71c1bff700 1 -- 172.21.15.112:0/4158723277 wait complete. 2023-09-12T16:08:10.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.474+0000 7f71c1bff700 1 Processor -- start 2023-09-12T16:08:10.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.475+0000 7f71c1bff700 1 -- start start 2023-09-12T16:08:10.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.475+0000 7f71c1bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71a4003a30 0x7f71bc159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:10.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.475+0000 7f71c1bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71bc0c7070 0x7f71bc1e6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:10.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.476+0000 7f71c1bff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71bc1e72a0 0x7f71bc0ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:10.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.476+0000 7f71c1bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc1e7820 con 0x7f71a4003a30 2023-09-12T16:08:10.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.476+0000 7f71c1bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc0c6590 con 0x7f71bc0c7070 2023-09-12T16:08:10.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.476+0000 7f71c1bff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc0c6870 con 0x7f71bc1e72a0 2023-09-12T16:08:10.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.476+0000 7f71bb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71a4003a30 0x7f71bc159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:10.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.476+0000 7f71bb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71a4003a30 0x7f71bc159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58844/0 (socket says 172.21.15.112:58844) 2023-09-12T16:08:10.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.476+0000 7f71bb7fe700 1 -- 172.21.15.112:0/3372205495 learned_addr learned my addr 172.21.15.112:0/3372205495 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:10.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.476+0000 7f71baffd700 1 --2- 172.21.15.112:0/3372205495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71bc0c7070 0x7f71bc1e6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:10.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.476+0000 7f71bbfff700 1 --2- 172.21.15.112:0/3372205495 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71bc1e72a0 0x7f71bc0ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:10.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.476+0000 7f71bb7fe700 1 -- 172.21.15.112:0/3372205495 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71bc1e72a0 msgr2=0x7f71bc0ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:10.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.476+0000 7f71bb7fe700 1 --2- 172.21.15.112:0/3372205495 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71bc1e72a0 0x7f71bc0ae3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:10.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.476+0000 7f71bb7fe700 1 -- 172.21.15.112:0/3372205495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71bc0c7070 msgr2=0x7f71bc1e6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:10.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.476+0000 7f71bb7fe700 1 --2- 172.21.15.112:0/3372205495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71bc0c7070 0x7f71bc1e6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:10.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.476+0000 7f71bb7fe700 1 -- 172.21.15.112:0/3372205495 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71bc0c6b50 con 0x7f71a4003a30 2023-09-12T16:08:10.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.476+0000 7f71baffd700 1 --2- 172.21.15.112:0/3372205495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71bc0c7070 0x7f71bc1e6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:08:10.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.476+0000 7f71bb7fe700 1 --2- 172.21.15.112:0/3372205495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71a4003a30 0x7f71bc159f80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f71ac001930 tx=0x7f71ac000f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:10.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.477+0000 7f71a3fff700 1 -- 172.21.15.112:0/3372205495 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac006650 con 0x7f71a4003a30 2023-09-12T16:08:10.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.477+0000 7f71a3fff700 1 -- 172.21.15.112:0/3372205495 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f71ac003770 con 0x7f71a4003a30 2023-09-12T16:08:10.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.477+0000 7f71a3fff700 1 -- 172.21.15.112:0/3372205495 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac003b80 con 0x7f71a4003a30 2023-09-12T16:08:10.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.477+0000 7f71c1bff700 1 -- 172.21.15.112:0/3372205495 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71bc1e7b00 con 0x7f71a4003a30 2023-09-12T16:08:10.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.477+0000 7f71c1bff700 1 -- 172.21.15.112:0/3372205495 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71bc15a4c0 con 0x7f71a4003a30 2023-09-12T16:08:10.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.478+0000 7f71c1bff700 1 -- 172.21.15.112:0/3372205495 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71bc0c6ec0 con 0x7f71a4003a30 2023-09-12T16:08:10.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.479+0000 7f71a3fff700 1 -- 172.21.15.112:0/3372205495 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f71ac022070 con 0x7f71a4003a30 2023-09-12T16:08:10.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.480+0000 7f71a3fff700 1 --2- 172.21.15.112:0/3372205495 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f71a806a580 0x7f71a806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:10.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.480+0000 7f71a3fff700 1 -- 172.21.15.112:0/3372205495 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f71ac08af30 con 0x7f71a4003a30 2023-09-12T16:08:10.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.480+0000 7f71baffd700 1 --2- 172.21.15.112:0/3372205495 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f71a806a580 0x7f71a806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:10.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.481+0000 7f71baffd700 1 --2- 172.21.15.112:0/3372205495 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f71a806a580 0x7f71a806ca40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0cb6a0 tx=0x7f71b0009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:10.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.484+0000 7f71a3fff700 1 -- 172.21.15.112:0/3372205495 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f71ac056160 con 0x7f71a4003a30 2023-09-12T16:08:10.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.681+0000 7f71c1bff700 1 -- 172.21.15.112:0/3372205495 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f71bc0c6ce0 con 0x7f71a4003a30 2023-09-12T16:08:10.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.681+0000 7f71a3fff700 1 -- 172.21.15.112:0/3372205495 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f71ac02a070 con 0x7f71a4003a30 2023-09-12T16:08:10.682 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-09-12T16:08:10.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.684+0000 7f71c1bff700 1 -- 172.21.15.112:0/3372205495 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f71a806a580 msgr2=0x7f71a806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:10.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.684+0000 7f71c1bff700 1 --2- 172.21.15.112:0/3372205495 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f71a806a580 0x7f71a806ca40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0cb6a0 tx=0x7f71b0009260 comp rx=0 tx=0).stop 2023-09-12T16:08:10.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.684+0000 7f71c1bff700 1 -- 172.21.15.112:0/3372205495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71a4003a30 msgr2=0x7f71bc159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:10.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.684+0000 7f71c1bff700 1 --2- 172.21.15.112:0/3372205495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71a4003a30 0x7f71bc159f80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f71ac001930 tx=0x7f71ac000f80 comp rx=0 tx=0).stop 2023-09-12T16:08:10.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.684+0000 7f71c1bff700 1 -- 172.21.15.112:0/3372205495 shutdown_connections 2023-09-12T16:08:10.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.684+0000 7f71c1bff700 1 --2- 172.21.15.112:0/3372205495 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f71a806a580 0x7f71a806ca40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:10.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.684+0000 7f71c1bff700 1 --2- 172.21.15.112:0/3372205495 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71bc1e72a0 0x7f71bc0ae3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:10.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.684+0000 7f71c1bff700 1 --2- 172.21.15.112:0/3372205495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71a4003a30 0x7f71bc159f80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:10.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.684+0000 7f71c1bff700 1 --2- 172.21.15.112:0/3372205495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71bc0c7070 0x7f71bc1e6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:10.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.684+0000 7f71c1bff700 1 -- 172.21.15.112:0/3372205495 >> 172.21.15.112:0/3372205495 conn(0x7f71bc0d17d0 msgr2=0x7f71bc0af650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:10.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.684+0000 7f71c1bff700 1 -- 172.21.15.112:0/3372205495 shutdown_connections 2023-09-12T16:08:10.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.684+0000 7f71c1bff700 1 -- 172.21.15.112:0/3372205495 wait complete. 2023-09-12T16:08:10.702 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-12T16:08:10.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.906+0000 7fac4cfff700 1 -- 172.21.15.112:0/660257333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac30004850 msgr2=0x7fac30004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:10.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.906+0000 7fac4cfff700 1 --2- 172.21.15.112:0/660257333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac30004850 0x7fac30004cd0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fac48160690 tx=0x7fac30005880 comp rx=0 tx=0).stop 2023-09-12T16:08:10.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.906+0000 7fac46d9d700 1 -- 172.21.15.112:0/660257333 reap_dead start 2023-09-12T16:08:10.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.906+0000 7fac4cfff700 1 -- 172.21.15.112:0/660257333 shutdown_connections 2023-09-12T16:08:10.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.906+0000 7fac4cfff700 1 -- 172.21.15.112:0/660257333 >> 172.21.15.112:0/660257333 conn(0x7fac480d17d0 msgr2=0x7fac480d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:10.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.906+0000 7fac4cfff700 1 -- 172.21.15.112:0/660257333 shutdown_connections 2023-09-12T16:08:10.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.906+0000 7fac4cfff700 1 -- 172.21.15.112:0/660257333 wait complete. 2023-09-12T16:08:10.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.908+0000 7fac4cfff700 1 Processor -- start 2023-09-12T16:08:10.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.908+0000 7fac4cfff700 1 -- start start 2023-09-12T16:08:10.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.909+0000 7fac4cfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac30004850 0x7fac4814da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:10.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.909+0000 7fac4cfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac4815abc0 0x7fac481e5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:10.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.909+0000 7fac4cfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac4815e090 0x7fac4815e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:10.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.909+0000 7fac4cfff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4815ea50 con 0x7fac4815abc0 2023-09-12T16:08:10.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.909+0000 7fac4cfff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac481f1dc0 con 0x7fac4815e090 2023-09-12T16:08:10.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.909+0000 7fac4cfff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac481e6750 con 0x7fac30004850 2023-09-12T16:08:10.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.909+0000 7fac45d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac4815abc0 0x7fac481e5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:10.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.909+0000 7fac45d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac4815abc0 0x7fac481e5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58856/0 (socket says 172.21.15.112:58856) 2023-09-12T16:08:10.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.909+0000 7fac45d9b700 1 -- 172.21.15.112:0/691248581 learned_addr learned my addr 172.21.15.112:0/691248581 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:10.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.910+0000 7fac4659c700 1 --2- 172.21.15.112:0/691248581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac30004850 0x7fac4814da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:10.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.910+0000 7fac46d9d700 1 --2- 172.21.15.112:0/691248581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac4815e090 0x7fac4815e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:10.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.910+0000 7fac45d9b700 1 -- 172.21.15.112:0/691248581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac30004850 msgr2=0x7fac4814da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:10.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.910+0000 7fac45d9b700 1 --2- 172.21.15.112:0/691248581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac30004850 0x7fac4814da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:10.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.910+0000 7fac45d9b700 1 -- 172.21.15.112:0/691248581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac4815e090 msgr2=0x7fac4815e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:10.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.910+0000 7fac45d9b700 1 --2- 172.21.15.112:0/691248581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac4815e090 0x7fac4815e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:10.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.910+0000 7fac45d9b700 1 -- 172.21.15.112:0/691248581 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac481e6a30 con 0x7fac4815abc0 2023-09-12T16:08:10.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.910+0000 7fac46d9d700 1 --2- 172.21.15.112:0/691248581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac4815e090 0x7fac4815e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:10.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.910+0000 7fac4659c700 1 --2- 172.21.15.112:0/691248581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac30004850 0x7fac4814da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:10.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.910+0000 7fac45d9b700 1 --2- 172.21.15.112:0/691248581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac4815abc0 0x7fac481e5de0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fac3c000c00 tx=0x7fac3c00dfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:10.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.910+0000 7fac36ffd700 1 -- 172.21.15.112:0/691248581 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c004460 con 0x7fac4815abc0 2023-09-12T16:08:10.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.910+0000 7fac36ffd700 1 -- 172.21.15.112:0/691248581 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fac3c0045c0 con 0x7fac4815abc0 2023-09-12T16:08:10.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.910+0000 7fac4cfff700 1 -- 172.21.15.112:0/691248581 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac481e6d10 con 0x7fac4815abc0 2023-09-12T16:08:10.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.910+0000 7fac36ffd700 1 -- 172.21.15.112:0/691248581 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c0038e0 con 0x7fac4815abc0 2023-09-12T16:08:10.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.910+0000 7fac4cfff700 1 -- 172.21.15.112:0/691248581 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4814dfb0 con 0x7fac4815abc0 2023-09-12T16:08:10.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.911+0000 7fac4cfff700 1 -- 172.21.15.112:0/691248581 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac48073ea0 con 0x7fac4815abc0 2023-09-12T16:08:10.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.912+0000 7fac36ffd700 1 -- 172.21.15.112:0/691248581 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fac3c003a40 con 0x7fac4815abc0 2023-09-12T16:08:10.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.913+0000 7fac36ffd700 1 --2- 172.21.15.112:0/691248581 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fac2806a580 0x7fac2806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:10.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.914+0000 7fac36ffd700 1 -- 172.21.15.112:0/691248581 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fac3c08a830 con 0x7fac4815abc0 2023-09-12T16:08:10.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.914+0000 7fac4659c700 1 --2- 172.21.15.112:0/691248581 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fac2806a580 0x7fac2806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:10.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.914+0000 7fac4659c700 1 --2- 172.21.15.112:0/691248581 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fac2806a580 0x7fac2806ca40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fac380017a0 tx=0x7fac38001c30 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:10.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:10.918+0000 7fac36ffd700 1 -- 172.21.15.112:0/691248581 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fac3c0559c0 con 0x7fac4815abc0 2023-09-12T16:08:11.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.112+0000 7fac4cfff700 1 -- 172.21.15.112:0/691248581 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fac4808b860 con 0x7fac4815abc0 2023-09-12T16:08:11.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.113+0000 7fac36ffd700 1 -- 172.21.15.112:0/691248581 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fac3c016020 con 0x7fac4815abc0 2023-09-12T16:08:11.113 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:08:11.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.115+0000 7fac4cfff700 1 -- 172.21.15.112:0/691248581 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fac2806a580 msgr2=0x7fac2806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:11.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.115+0000 7fac4cfff700 1 --2- 172.21.15.112:0/691248581 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fac2806a580 0x7fac2806ca40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fac380017a0 tx=0x7fac38001c30 comp rx=0 tx=0).stop 2023-09-12T16:08:11.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.115+0000 7fac4cfff700 1 -- 172.21.15.112:0/691248581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac4815abc0 msgr2=0x7fac481e5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:11.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.115+0000 7fac4cfff700 1 --2- 172.21.15.112:0/691248581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac4815abc0 0x7fac481e5de0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fac3c000c00 tx=0x7fac3c00dfa0 comp rx=0 tx=0).stop 2023-09-12T16:08:11.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.115+0000 7fac4cfff700 1 -- 172.21.15.112:0/691248581 shutdown_connections 2023-09-12T16:08:11.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.115+0000 7fac4cfff700 1 --2- 172.21.15.112:0/691248581 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fac2806a580 0x7fac2806ca40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:11.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.115+0000 7fac4cfff700 1 --2- 172.21.15.112:0/691248581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac30004850 0x7fac4814da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:11.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.115+0000 7fac4cfff700 1 --2- 172.21.15.112:0/691248581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac4815e090 0x7fac4815e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:11.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.115+0000 7fac4cfff700 1 --2- 172.21.15.112:0/691248581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac4815abc0 0x7fac481e5de0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:11.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.115+0000 7fac4cfff700 1 -- 172.21.15.112:0/691248581 >> 172.21.15.112:0/691248581 conn(0x7fac480d17d0 msgr2=0x7fac480afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:11.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.115+0000 7fac4cfff700 1 -- 172.21.15.112:0/691248581 shutdown_connections 2023-09-12T16:08:11.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.115+0000 7fac4cfff700 1 -- 172.21.15.112:0/691248581 wait complete. 2023-09-12T16:08:11.133 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-12T16:08:11.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.335+0000 7f05cafff700 1 -- 172.21.15.112:0/1883131667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05b4004d90 msgr2=0x7f05b4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:11.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.335+0000 7f05cafff700 1 --2- 172.21.15.112:0/1883131667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05b4004d90 0x7f05b4005210 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f05c408bbe0 tx=0x7f05b4005880 comp rx=0 tx=0).stop 2023-09-12T16:08:11.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.336+0000 7f05c959c700 1 -- 172.21.15.112:0/1883131667 reap_dead start 2023-09-12T16:08:11.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.336+0000 7f05cafff700 1 -- 172.21.15.112:0/1883131667 shutdown_connections 2023-09-12T16:08:11.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.336+0000 7f05cafff700 1 -- 172.21.15.112:0/1883131667 >> 172.21.15.112:0/1883131667 conn(0x7f05c40d1930 msgr2=0x7f05c40d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:11.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.336+0000 7f05cafff700 1 -- 172.21.15.112:0/1883131667 shutdown_connections 2023-09-12T16:08:11.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.336+0000 7f05cafff700 1 -- 172.21.15.112:0/1883131667 wait complete. 2023-09-12T16:08:11.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.338+0000 7f05cafff700 1 Processor -- start 2023-09-12T16:08:11.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.338+0000 7f05cafff700 1 -- start start 2023-09-12T16:08:11.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.339+0000 7f05cafff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05b4004d90 0x7f05c41e5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:11.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.339+0000 7f05cafff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05c414f4c0 0x7f05c41e6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:11.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.339+0000 7f05cafff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05c41e4780 0x7f05c41e4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:11.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.340+0000 7f05cafff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c41e5140 con 0x7f05b4004d90 2023-09-12T16:08:11.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.340+0000 7f05cafff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40ca390 con 0x7f05c414f4c0 2023-09-12T16:08:11.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.340+0000 7f05cafff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40ca670 con 0x7f05c41e4780 2023-09-12T16:08:11.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.340+0000 7f05c8d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05b4004d90 0x7f05c41e5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:11.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.340+0000 7f05c8d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05b4004d90 0x7f05c41e5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58874/0 (socket says 172.21.15.112:58874) 2023-09-12T16:08:11.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.340+0000 7f05c8d9b700 1 -- 172.21.15.112:0/1385395792 learned_addr learned my addr 172.21.15.112:0/1385395792 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:11.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.340+0000 7f05c8d9b700 1 -- 172.21.15.112:0/1385395792 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05c41e4780 msgr2=0x7f05c41e4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:11.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.340+0000 7f05c8d9b700 1 --2- 172.21.15.112:0/1385395792 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05c41e4780 0x7f05c41e4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:11.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.340+0000 7f05c8d9b700 1 -- 172.21.15.112:0/1385395792 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05c414f4c0 msgr2=0x7f05c41e6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:11.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.340+0000 7f05c8d9b700 1 --2- 172.21.15.112:0/1385395792 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05c414f4c0 0x7f05c41e6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:11.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.340+0000 7f05c8d9b700 1 -- 172.21.15.112:0/1385395792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c40b2ba0 con 0x7f05b4004d90 2023-09-12T16:08:11.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.340+0000 7f05c8d9b700 1 --2- 172.21.15.112:0/1385395792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05b4004d90 0x7f05c41e5470 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f05b800f380 tx=0x7f05b800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:11.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.341+0000 7f05c17fa700 1 -- 172.21.15.112:0/1385395792 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8006230 con 0x7f05b4004d90 2023-09-12T16:08:11.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.341+0000 7f05c17fa700 1 -- 172.21.15.112:0/1385395792 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f05b8011430 con 0x7f05b4004d90 2023-09-12T16:08:11.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.341+0000 7f05c17fa700 1 -- 172.21.15.112:0/1385395792 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8011820 con 0x7f05b4004d90 2023-09-12T16:08:11.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.341+0000 7f05cafff700 1 -- 172.21.15.112:0/1385395792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c40ca950 con 0x7f05b4004d90 2023-09-12T16:08:11.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.341+0000 7f05cafff700 1 -- 172.21.15.112:0/1385395792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c40ca060 con 0x7f05b4004d90 2023-09-12T16:08:11.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.342+0000 7f05cafff700 1 -- 172.21.15.112:0/1385395792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c404e300 con 0x7f05b4004d90 2023-09-12T16:08:11.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.343+0000 7f05c17fa700 1 -- 172.21.15.112:0/1385395792 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f05b8011980 con 0x7f05b4004d90 2023-09-12T16:08:11.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.344+0000 7f05c17fa700 1 --2- 172.21.15.112:0/1385395792 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f05a806a580 0x7f05a806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:11.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.344+0000 7f05c17fa700 1 -- 172.21.15.112:0/1385395792 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f05b8089890 con 0x7f05b4004d90 2023-09-12T16:08:11.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.344+0000 7f05c3fff700 1 --2- 172.21.15.112:0/1385395792 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f05a806a580 0x7f05a806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:11.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.345+0000 7f05c3fff700 1 --2- 172.21.15.112:0/1385395792 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f05a806a580 0x7f05a806ca40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f05c4066e20 tx=0x7f05b00096f0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:11.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.348+0000 7f05c17fa700 1 -- 172.21.15.112:0/1385395792 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f05b8054a30 con 0x7f05b4004d90 2023-09-12T16:08:11.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.557+0000 7f05cafff700 1 -- 172.21.15.112:0/1385395792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f05c40ca4d0 con 0x7f05b4004d90 2023-09-12T16:08:11.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.558+0000 7f05c17fa700 1 -- 172.21.15.112:0/1385395792 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f05c40ca4d0 con 0x7f05b4004d90 2023-09-12T16:08:11.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.560+0000 7f05cafff700 1 -- 172.21.15.112:0/1385395792 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f05a806a580 msgr2=0x7f05a806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:11.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.560+0000 7f05cafff700 1 --2- 172.21.15.112:0/1385395792 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f05a806a580 0x7f05a806ca40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f05c4066e20 tx=0x7f05b00096f0 comp rx=0 tx=0).stop 2023-09-12T16:08:11.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.560+0000 7f05cafff700 1 -- 172.21.15.112:0/1385395792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05b4004d90 msgr2=0x7f05c41e5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:11.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.560+0000 7f05cafff700 1 --2- 172.21.15.112:0/1385395792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05b4004d90 0x7f05c41e5470 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f05b800f380 tx=0x7f05b800f740 comp rx=0 tx=0).stop 2023-09-12T16:08:11.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.560+0000 7f05cafff700 1 -- 172.21.15.112:0/1385395792 shutdown_connections 2023-09-12T16:08:11.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.560+0000 7f05cafff700 1 --2- 172.21.15.112:0/1385395792 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f05a806a580 0x7f05a806ca40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:11.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.560+0000 7f05cafff700 1 --2- 172.21.15.112:0/1385395792 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05c41e4780 0x7f05c41e4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:11.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.560+0000 7f05cafff700 1 --2- 172.21.15.112:0/1385395792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05b4004d90 0x7f05c41e5470 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:11.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.560+0000 7f05cafff700 1 --2- 172.21.15.112:0/1385395792 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05c414f4c0 0x7f05c41e6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:11.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.560+0000 7f05cafff700 1 -- 172.21.15.112:0/1385395792 >> 172.21.15.112:0/1385395792 conn(0x7f05c40d1930 msgr2=0x7f05c415bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:11.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.560+0000 7f05cafff700 1 -- 172.21.15.112:0/1385395792 shutdown_connections 2023-09-12T16:08:11.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:11.560+0000 7f05cafff700 1 -- 172.21.15.112:0/1385395792 wait complete. 2023-09-12T16:08:11.563 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2023-09-12T16:08:11.578 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-09-12T16:08:11.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:08:11.579 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-09-12T16:08:11.664 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-09-12T16:08:11.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:08:11.665 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-09-12T16:08:11.712 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:08:11.713 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T16:08:11.764 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:08:11.765 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T16:08:11.813 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T16:08:11.813 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T16:08:11.900 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:08:12.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.100+0000 7f989cbff700 1 -- 172.21.15.112:0/4214967496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98980b28f0 msgr2=0x7f98980cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:12.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.100+0000 7f989cbff700 1 --2- 172.21.15.112:0/4214967496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98980b28f0 0x7f98980cd3c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f98980cf400 tx=0x7f989000b380 comp rx=0 tx=0).stop 2023-09-12T16:08:12.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.100+0000 7f989cbff700 1 -- 172.21.15.112:0/4214967496 shutdown_connections 2023-09-12T16:08:12.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.100+0000 7f989cbff700 1 --2- 172.21.15.112:0/4214967496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98980b28f0 0x7f98980cd3c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:12.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.100+0000 7f989cbff700 1 --2- 172.21.15.112:0/4214967496 >> v2:172.21.15.144:3300/0 conn(0x7f989815f480 0x7f98980cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:12.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.100+0000 7f989cbff700 1 -- 172.21.15.112:0/4214967496 >> 172.21.15.112:0/4214967496 conn(0x7f98980d1930 msgr2=0x7f98980d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:12.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.100+0000 7f989cbff700 1 -- 172.21.15.112:0/4214967496 shutdown_connections 2023-09-12T16:08:12.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.100+0000 7f989cbff700 1 -- 172.21.15.112:0/4214967496 wait complete. 2023-09-12T16:08:12.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.102+0000 7f989cbff700 1 Processor -- start 2023-09-12T16:08:12.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.102+0000 7f989cbff700 1 -- start start 2023-09-12T16:08:12.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.104+0000 7f989cbff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98980b28f0 0x7f989815c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:12.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.104+0000 7f989cbff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98980cdfb0 0x7f98980af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:12.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.104+0000 7f989cbff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f989815f480 0x7f989809f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:12.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.104+0000 7f989cbff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989809f6a0 con 0x7f98980b28f0 2023-09-12T16:08:12.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.104+0000 7f989cbff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989815e6b0 con 0x7f98980cdfb0 2023-09-12T16:08:12.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.104+0000 7f989cbff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989815e990 con 0x7f989815f480 2023-09-12T16:08:12.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.104+0000 7f989659c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98980b28f0 0x7f989815c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:12.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.104+0000 7f989659c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98980b28f0 0x7f989815c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58898/0 (socket says 172.21.15.112:58898) 2023-09-12T16:08:12.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.104+0000 7f989659c700 1 -- 172.21.15.112:0/1695241980 learned_addr learned my addr 172.21.15.112:0/1695241980 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:12.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.104+0000 7f9895d9b700 1 --2- 172.21.15.112:0/1695241980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98980cdfb0 0x7f98980af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:12.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.104+0000 7f9896d9d700 1 --2- 172.21.15.112:0/1695241980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f989815f480 0x7f989809f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:12.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.104+0000 7f989659c700 1 -- 172.21.15.112:0/1695241980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f989815f480 msgr2=0x7f989809f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:12.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.104+0000 7f989659c700 1 --2- 172.21.15.112:0/1695241980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f989815f480 0x7f989809f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:12.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.104+0000 7f989659c700 1 -- 172.21.15.112:0/1695241980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98980cdfb0 msgr2=0x7f98980af9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:12.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.104+0000 7f989659c700 1 --2- 172.21.15.112:0/1695241980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98980cdfb0 0x7f98980af9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:12.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.104+0000 7f989659c700 1 -- 172.21.15.112:0/1695241980 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9890009d00 con 0x7f98980b28f0 2023-09-12T16:08:12.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.104+0000 7f9895d9b700 1 --2- 172.21.15.112:0/1695241980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98980cdfb0 0x7f98980af9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:08:12.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.105+0000 7f989659c700 1 --2- 172.21.15.112:0/1695241980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98980b28f0 0x7f989815c570 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f988800d950 tx=0x7f988800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:12.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.105+0000 7f9886ffd700 1 -- 172.21.15.112:0/1695241980 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9888009b40 con 0x7f98980b28f0 2023-09-12T16:08:12.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.105+0000 7f9886ffd700 1 -- 172.21.15.112:0/1695241980 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9888009d90 con 0x7f98980b28f0 2023-09-12T16:08:12.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.105+0000 7f989cbff700 1 -- 172.21.15.112:0/1695241980 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98980af1b0 con 0x7f98980b28f0 2023-09-12T16:08:12.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.105+0000 7f9886ffd700 1 -- 172.21.15.112:0/1695241980 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98880106c0 con 0x7f98980b28f0 2023-09-12T16:08:12.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.105+0000 7f989cbff700 1 -- 172.21.15.112:0/1695241980 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98980aeea0 con 0x7f98980b28f0 2023-09-12T16:08:12.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.106+0000 7f989cbff700 1 -- 172.21.15.112:0/1695241980 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98980afef0 con 0x7f98980b28f0 2023-09-12T16:08:12.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.107+0000 7f9886ffd700 1 -- 172.21.15.112:0/1695241980 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f9888010820 con 0x7f98980b28f0 2023-09-12T16:08:12.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.108+0000 7f9886ffd700 1 --2- 172.21.15.112:0/1695241980 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f987806a580 0x7f987806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:12.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.108+0000 7f9886ffd700 1 -- 172.21.15.112:0/1695241980 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f9888089220 con 0x7f98980b28f0 2023-09-12T16:08:12.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.108+0000 7f9895d9b700 1 --2- 172.21.15.112:0/1695241980 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f987806a580 0x7f987806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:12.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.109+0000 7f9895d9b700 1 --2- 172.21.15.112:0/1695241980 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f987806a580 0x7f987806ca40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f98981f5130 tx=0x7f988c009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:12.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.112+0000 7f9886ffd700 1 -- 172.21.15.112:0/1695241980 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f98880543b0 con 0x7f98980b28f0 2023-09-12T16:08:12.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.314+0000 7f989cbff700 1 -- 172.21.15.112:0/1695241980 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98980af800 con 0x7f98980b28f0 2023-09-12T16:08:12.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.316+0000 7f9886ffd700 1 -- 172.21.15.112:0/1695241980 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18816 (secure 0 0 0) 0x7f98880579d0 con 0x7f98980b28f0 2023-09-12T16:08:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:12.316 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:44.445226+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:08:12.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.318+0000 7f989cbff700 1 -- 172.21.15.112:0/1695241980 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f987806a580 msgr2=0x7f987806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:12.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.318+0000 7f989cbff700 1 --2- 172.21.15.112:0/1695241980 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f987806a580 0x7f987806ca40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f98981f5130 tx=0x7f988c009040 comp rx=0 tx=0).stop 2023-09-12T16:08:12.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.318+0000 7f989cbff700 1 -- 172.21.15.112:0/1695241980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98980b28f0 msgr2=0x7f989815c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:12.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.318+0000 7f989cbff700 1 --2- 172.21.15.112:0/1695241980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98980b28f0 0x7f989815c570 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f988800d950 tx=0x7f988800dd10 comp rx=0 tx=0).stop 2023-09-12T16:08:12.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.318+0000 7f989cbff700 1 -- 172.21.15.112:0/1695241980 shutdown_connections 2023-09-12T16:08:12.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.318+0000 7f989cbff700 1 --2- 172.21.15.112:0/1695241980 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f987806a580 0x7f987806ca40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:12.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.318+0000 7f989cbff700 1 --2- 172.21.15.112:0/1695241980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f989815f480 0x7f989809f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:12.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.318+0000 7f989cbff700 1 --2- 172.21.15.112:0/1695241980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98980b28f0 0x7f989815c570 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:12.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.318+0000 7f989cbff700 1 --2- 172.21.15.112:0/1695241980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98980cdfb0 0x7f98980af9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:12.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.318+0000 7f989cbff700 1 -- 172.21.15.112:0/1695241980 >> 172.21.15.112:0/1695241980 conn(0x7f98980d1930 msgr2=0x7f98980c73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:12.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.318+0000 7f989cbff700 1 -- 172.21.15.112:0/1695241980 shutdown_connections 2023-09-12T16:08:12.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.318+0000 7f989cbff700 1 -- 172.21.15.112:0/1695241980 wait complete. 2023-09-12T16:08:12.336 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-12T16:06:48.871680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-12T16:06:58.137223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-12T16:06:58.684034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-12T16:07:02.283459+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-12T16:08:12.337 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-12T16:08:12.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.538+0000 7f217a1ff700 1 -- 172.21.15.112:0/2792304374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21740cfdb0 msgr2=0x7f21740d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:12.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.538+0000 7f217a1ff700 1 --2- 172.21.15.112:0/2792304374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21740cfdb0 0x7f21740d01e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f217408bf50 tx=0x7f216c00b380 comp rx=0 tx=0).stop 2023-09-12T16:08:12.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.538+0000 7f217a1ff700 1 -- 172.21.15.112:0/2792304374 shutdown_connections 2023-09-12T16:08:12.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.539+0000 7f217a1ff700 1 --2- 172.21.15.112:0/2792304374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21740cfdb0 0x7f21740d01e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:12.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.539+0000 7f217a1ff700 1 --2- 172.21.15.112:0/2792304374 >> v2:172.21.15.144:3300/0 conn(0x7f217415bca0 0x7f217415cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:12.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.539+0000 7f217a1ff700 1 -- 172.21.15.112:0/2792304374 >> 172.21.15.112:0/2792304374 conn(0x7f21740d17d0 msgr2=0x7f21740d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:12.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.539+0000 7f217a1ff700 1 -- 172.21.15.112:0/2792304374 shutdown_connections 2023-09-12T16:08:12.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.539+0000 7f217a1ff700 1 -- 172.21.15.112:0/2792304374 wait complete. 2023-09-12T16:08:12.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.540+0000 7f217a1ff700 1 Processor -- start 2023-09-12T16:08:12.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.540+0000 7f217a1ff700 1 -- start start 2023-09-12T16:08:12.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.541+0000 7f217a1ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21740cfdb0 0x7f21740cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:12.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.541+0000 7f217a1ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f217415bca0 0x7f217414cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:12.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.541+0000 7f217a1ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21740c9570 0x7f21741f29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:12.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.541+0000 7f217a1ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217414d460 con 0x7f21740cfdb0 2023-09-12T16:08:12.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.541+0000 7f217a1ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21740ca340 con 0x7f21740c9570 2023-09-12T16:08:12.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.541+0000 7f217a1ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21740ca620 con 0x7f217415bca0 2023-09-12T16:08:12.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.541+0000 7f21737fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21740cfdb0 0x7f21740cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:12.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.542+0000 7f21737fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21740cfdb0 0x7f21740cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58918/0 (socket says 172.21.15.112:58918) 2023-09-12T16:08:12.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.542+0000 7f21737fe700 1 -- 172.21.15.112:0/4018397221 learned_addr learned my addr 172.21.15.112:0/4018397221 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:12.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.542+0000 7f216bfff700 1 --2- 172.21.15.112:0/4018397221 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f217415bca0 0x7f217414cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:12.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.542+0000 7f2173fff700 1 --2- 172.21.15.112:0/4018397221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21740c9570 0x7f21741f29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:12.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.542+0000 7f21737fe700 1 -- 172.21.15.112:0/4018397221 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f217415bca0 msgr2=0x7f217414cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:12.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.542+0000 7f21737fe700 1 --2- 172.21.15.112:0/4018397221 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f217415bca0 0x7f217414cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:12.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.542+0000 7f21737fe700 1 -- 172.21.15.112:0/4018397221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21740c9570 msgr2=0x7f21741f29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:12.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.542+0000 7f21737fe700 1 --2- 172.21.15.112:0/4018397221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21740c9570 0x7f21741f29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:12.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.542+0000 7f21737fe700 1 -- 172.21.15.112:0/4018397221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c009d00 con 0x7f21740cfdb0 2023-09-12T16:08:12.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.542+0000 7f21737fe700 1 --2- 172.21.15.112:0/4018397221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21740cfdb0 0x7f21740cb3e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f216400d950 tx=0x7f216400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:12.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.542+0000 7f2170ff9700 1 -- 172.21.15.112:0/4018397221 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164009930 con 0x7f21740cfdb0 2023-09-12T16:08:12.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.542+0000 7f2170ff9700 1 -- 172.21.15.112:0/4018397221 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2164009b80 con 0x7f21740cfdb0 2023-09-12T16:08:12.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.542+0000 7f217a1ff700 1 -- 172.21.15.112:0/4018397221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21740ca900 con 0x7f21740cfdb0 2023-09-12T16:08:12.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.542+0000 7f2170ff9700 1 -- 172.21.15.112:0/4018397221 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164010460 con 0x7f21740cfdb0 2023-09-12T16:08:12.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.543+0000 7f217a1ff700 1 -- 172.21.15.112:0/4018397221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21740caec0 con 0x7f21740cfdb0 2023-09-12T16:08:12.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.544+0000 7f217a1ff700 1 -- 172.21.15.112:0/4018397221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21740cb080 con 0x7f21740cfdb0 2023-09-12T16:08:12.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.545+0000 7f2170ff9700 1 -- 172.21.15.112:0/4018397221 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f21640105c0 con 0x7f21740cfdb0 2023-09-12T16:08:12.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.545+0000 7f2170ff9700 1 --2- 172.21.15.112:0/4018397221 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f215406a580 0x7f215406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:12.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.546+0000 7f2170ff9700 1 -- 172.21.15.112:0/4018397221 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f2164089270 con 0x7f21740cfdb0 2023-09-12T16:08:12.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.546+0000 7f216bfff700 1 --2- 172.21.15.112:0/4018397221 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f215406a580 0x7f215406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:12.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.546+0000 7f216bfff700 1 --2- 172.21.15.112:0/4018397221 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f215406a580 0x7f215406ca40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f215c000f60 tx=0x7f215c009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:12.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.550+0000 7f2170ff9700 1 -- 172.21.15.112:0/4018397221 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f2164057e00 con 0x7f21740cfdb0 2023-09-12T16:08:12.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.746+0000 7f217a1ff700 1 -- 172.21.15.112:0/4018397221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21740cbc90 con 0x7f21740cfdb0 2023-09-12T16:08:12.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.747+0000 7f2170ff9700 1 -- 172.21.15.112:0/4018397221 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2164057990 con 0x7f21740cfdb0 2023-09-12T16:08:12.747 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-09-12T16:08:12.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.749+0000 7f217a1ff700 1 -- 172.21.15.112:0/4018397221 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f215406a580 msgr2=0x7f215406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:12.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.749+0000 7f217a1ff700 1 --2- 172.21.15.112:0/4018397221 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f215406a580 0x7f215406ca40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f215c000f60 tx=0x7f215c009040 comp rx=0 tx=0).stop 2023-09-12T16:08:12.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.749+0000 7f217a1ff700 1 -- 172.21.15.112:0/4018397221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21740cfdb0 msgr2=0x7f21740cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:12.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.749+0000 7f217a1ff700 1 --2- 172.21.15.112:0/4018397221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21740cfdb0 0x7f21740cb3e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f216400d950 tx=0x7f216400dd10 comp rx=0 tx=0).stop 2023-09-12T16:08:12.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.749+0000 7f217a1ff700 1 -- 172.21.15.112:0/4018397221 shutdown_connections 2023-09-12T16:08:12.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.749+0000 7f217a1ff700 1 --2- 172.21.15.112:0/4018397221 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f215406a580 0x7f215406ca40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:12.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.749+0000 7f217a1ff700 1 --2- 172.21.15.112:0/4018397221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21740c9570 0x7f21741f29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:12.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.749+0000 7f217a1ff700 1 --2- 172.21.15.112:0/4018397221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21740cfdb0 0x7f21740cb3e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:12.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.749+0000 7f217a1ff700 1 --2- 172.21.15.112:0/4018397221 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f217415bca0 0x7f217414cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:12.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.749+0000 7f217a1ff700 1 -- 172.21.15.112:0/4018397221 >> 172.21.15.112:0/4018397221 conn(0x7f21740d17d0 msgr2=0x7f21740b5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:12.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.749+0000 7f217a1ff700 1 -- 172.21.15.112:0/4018397221 shutdown_connections 2023-09-12T16:08:12.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.749+0000 7f217a1ff700 1 -- 172.21.15.112:0/4018397221 wait complete. 2023-09-12T16:08:12.767 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-12T16:08:12.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.972+0000 7f19183ff700 1 -- 172.21.15.112:0/3477051821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19100d2410 msgr2=0x7f191015f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:12.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.972+0000 7f19183ff700 1 --2- 172.21.15.112:0/3477051821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19100d2410 0x7f191015f530 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1900005fd0 tx=0x7f1900009c70 comp rx=0 tx=0).stop 2023-09-12T16:08:12.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.972+0000 7f19183ff700 1 -- 172.21.15.112:0/3477051821 shutdown_connections 2023-09-12T16:08:12.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.972+0000 7f19183ff700 1 --2- 172.21.15.112:0/3477051821 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f191015bb40 0x7f19100d1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:12.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.972+0000 7f19183ff700 1 --2- 172.21.15.112:0/3477051821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19100d2410 0x7f191015f530 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:12.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.972+0000 7f19183ff700 1 -- 172.21.15.112:0/3477051821 >> 172.21.15.112:0/3477051821 conn(0x7f191009aa90 msgr2=0x7f19100d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:12.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.972+0000 7f19183ff700 1 -- 172.21.15.112:0/3477051821 shutdown_connections 2023-09-12T16:08:12.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.972+0000 7f19183ff700 1 -- 172.21.15.112:0/3477051821 wait complete. 2023-09-12T16:08:12.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.973+0000 7f19183ff700 1 Processor -- start 2023-09-12T16:08:12.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.974+0000 7f19183ff700 1 -- start start 2023-09-12T16:08:12.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.974+0000 7f19183ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19100d2410 0x7f191014daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:12.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.974+0000 7f19183ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f191015bb40 0x7f191006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:12.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.974+0000 7f19183ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f191015fa70 0x7f191006ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:12.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.974+0000 7f19183ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19100c9210 con 0x7f191015bb40 2023-09-12T16:08:12.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.974+0000 7f19183ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191014e030 con 0x7f19100d2410 2023-09-12T16:08:12.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.974+0000 7f19183ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19100c9460 con 0x7f191015fa70 2023-09-12T16:08:12.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.975+0000 7f191599a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f191015bb40 0x7f191006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:12.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.975+0000 7f191599a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f191015bb40 0x7f191006c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58946/0 (socket says 172.21.15.112:58946) 2023-09-12T16:08:12.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.975+0000 7f191599a700 1 -- 172.21.15.112:0/2542348897 learned_addr learned my addr 172.21.15.112:0/2542348897 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:12.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.975+0000 7f191619b700 1 --2- 172.21.15.112:0/2542348897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19100d2410 0x7f191014daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:12.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.975+0000 7f191699c700 1 --2- 172.21.15.112:0/2542348897 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f191015fa70 0x7f191006ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:12.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.975+0000 7f191599a700 1 -- 172.21.15.112:0/2542348897 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f191015fa70 msgr2=0x7f191006ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:12.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.975+0000 7f191599a700 1 --2- 172.21.15.112:0/2542348897 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f191015fa70 0x7f191006ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:12.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.975+0000 7f191599a700 1 -- 172.21.15.112:0/2542348897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19100d2410 msgr2=0x7f191014daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:12.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.975+0000 7f191599a700 1 --2- 172.21.15.112:0/2542348897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19100d2410 0x7f191014daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:12.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.975+0000 7f191599a700 1 -- 172.21.15.112:0/2542348897 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19000095f0 con 0x7f191015bb40 2023-09-12T16:08:12.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.975+0000 7f191599a700 1 --2- 172.21.15.112:0/2542348897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f191015bb40 0x7f191006c4f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1900000c00 tx=0x7f1900004b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:12.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.975+0000 7f1906ffd700 1 -- 172.21.15.112:0/2542348897 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190001d070 con 0x7f191015bb40 2023-09-12T16:08:12.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.976+0000 7f1906ffd700 1 -- 172.21.15.112:0/2542348897 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1900004320 con 0x7f191015bb40 2023-09-12T16:08:12.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.976+0000 7f19183ff700 1 -- 172.21.15.112:0/2542348897 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19100cfe40 con 0x7f191015bb40 2023-09-12T16:08:12.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.976+0000 7f1906ffd700 1 -- 172.21.15.112:0/2542348897 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900003680 con 0x7f191015bb40 2023-09-12T16:08:12.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.976+0000 7f19183ff700 1 -- 172.21.15.112:0/2542348897 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19100c9a20 con 0x7f191015bb40 2023-09-12T16:08:12.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.977+0000 7f19183ff700 1 -- 172.21.15.112:0/2542348897 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1910073ea0 con 0x7f191015bb40 2023-09-12T16:08:12.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.977+0000 7f1906ffd700 1 -- 172.21.15.112:0/2542348897 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f19000037e0 con 0x7f191015bb40 2023-09-12T16:08:12.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.978+0000 7f1906ffd700 1 --2- 172.21.15.112:0/2542348897 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f18f406a580 0x7f18f406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:12.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.978+0000 7f1906ffd700 1 -- 172.21.15.112:0/2542348897 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f190008a450 con 0x7f191015bb40 2023-09-12T16:08:12.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.979+0000 7f191619b700 1 --2- 172.21.15.112:0/2542348897 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f18f406a580 0x7f18f406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:12.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.979+0000 7f191619b700 1 --2- 172.21.15.112:0/2542348897 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f18f406a580 0x7f18f406ca40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f190c005950 tx=0x7f190c0058e0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:12.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:12.983+0000 7f1906ffd700 1 -- 172.21.15.112:0/2542348897 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f19000555e0 con 0x7f191015bb40 2023-09-12T16:08:13.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.177+0000 7f19183ff700 1 -- 172.21.15.112:0/2542348897 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f19100cdb50 con 0x7f191015bb40 2023-09-12T16:08:13.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.177+0000 7f1906ffd700 1 -- 172.21.15.112:0/2542348897 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1900058c00 con 0x7f191015bb40 2023-09-12T16:08:13.178 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:08:13.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.179+0000 7f19183ff700 1 -- 172.21.15.112:0/2542348897 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f18f406a580 msgr2=0x7f18f406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:13.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.179+0000 7f19183ff700 1 --2- 172.21.15.112:0/2542348897 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f18f406a580 0x7f18f406ca40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f190c005950 tx=0x7f190c0058e0 comp rx=0 tx=0).stop 2023-09-12T16:08:13.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.179+0000 7f19183ff700 1 -- 172.21.15.112:0/2542348897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f191015bb40 msgr2=0x7f191006c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:13.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.179+0000 7f19183ff700 1 --2- 172.21.15.112:0/2542348897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f191015bb40 0x7f191006c4f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1900000c00 tx=0x7f1900004b10 comp rx=0 tx=0).stop 2023-09-12T16:08:13.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.179+0000 7f19183ff700 1 -- 172.21.15.112:0/2542348897 shutdown_connections 2023-09-12T16:08:13.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.179+0000 7f19183ff700 1 --2- 172.21.15.112:0/2542348897 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f18f406a580 0x7f18f406ca40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:13.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.179+0000 7f19183ff700 1 --2- 172.21.15.112:0/2542348897 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f191015fa70 0x7f191006ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:13.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.179+0000 7f19183ff700 1 --2- 172.21.15.112:0/2542348897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19100d2410 0x7f191014daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:13.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.180+0000 7f19183ff700 1 --2- 172.21.15.112:0/2542348897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f191015bb40 0x7f191006c4f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:13.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.180+0000 7f19183ff700 1 -- 172.21.15.112:0/2542348897 >> 172.21.15.112:0/2542348897 conn(0x7f191009aa90 msgr2=0x7f19100b70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:13.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.180+0000 7f19183ff700 1 -- 172.21.15.112:0/2542348897 shutdown_connections 2023-09-12T16:08:13.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.180+0000 7f19183ff700 1 -- 172.21.15.112:0/2542348897 wait complete. 2023-09-12T16:08:13.197 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-12T16:08:13.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.400+0000 7f4b95dff700 1 -- 172.21.15.112:0/3338348543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b900cd5b0 msgr2=0x7f4b900cda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:13.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.400+0000 7f4b95dff700 1 --2- 172.21.15.112:0/3338348543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b900cd5b0 0x7f4b900cda20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4b900cae60 tx=0x7f4b8800b380 comp rx=0 tx=0).stop 2023-09-12T16:08:13.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.400+0000 7f4b95dff700 1 -- 172.21.15.112:0/3338348543 shutdown_connections 2023-09-12T16:08:13.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.400+0000 7f4b95dff700 1 --2- 172.21.15.112:0/3338348543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b900cd5b0 0x7f4b900cda20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:13.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.400+0000 7f4b95dff700 1 --2- 172.21.15.112:0/3338348543 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b90142ef0 0x7f4b9015a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:13.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.400+0000 7f4b95dff700 1 --2- 172.21.15.112:0/3338348543 >> v2:172.21.15.144:3300/0 conn(0x7f4b9015dc20 0x7f4b90070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:13.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.400+0000 7f4b95dff700 1 -- 172.21.15.112:0/3338348543 >> 172.21.15.112:0/3338348543 conn(0x7f4b9006a200 msgr2=0x7f4b9006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:13.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.400+0000 7f4b95dff700 1 -- 172.21.15.112:0/3338348543 shutdown_connections 2023-09-12T16:08:13.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.400+0000 7f4b95dff700 1 -- 172.21.15.112:0/3338348543 wait complete. 2023-09-12T16:08:13.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.402+0000 7f4b95dff700 1 Processor -- start 2023-09-12T16:08:13.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.402+0000 7f4b95dff700 1 -- start start 2023-09-12T16:08:13.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.403+0000 7f4b95dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b900cd5b0 0x7f4b9015b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:13.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.403+0000 7f4b95dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b90142ef0 0x7f4b901e5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:13.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.403+0000 7f4b95dff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b9015dc20 0x7f4b901e6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:13.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.403+0000 7f4b95dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9015bc70 con 0x7f4b90142ef0 2023-09-12T16:08:13.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.403+0000 7f4b95dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9015bf50 con 0x7f4b900cd5b0 2023-09-12T16:08:13.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.403+0000 7f4b95dff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9015c230 con 0x7f4b9015dc20 2023-09-12T16:08:13.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.404+0000 7f4b87fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b90142ef0 0x7f4b901e5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:13.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.404+0000 7f4b87fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b90142ef0 0x7f4b901e5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58976/0 (socket says 172.21.15.112:58976) 2023-09-12T16:08:13.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.404+0000 7f4b87fff700 1 -- 172.21.15.112:0/212074540 learned_addr learned my addr 172.21.15.112:0/212074540 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:13.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.404+0000 7f4b8ffff700 1 --2- 172.21.15.112:0/212074540 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b9015dc20 0x7f4b901e6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:13.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.404+0000 7f4b8f7fe700 1 --2- 172.21.15.112:0/212074540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b900cd5b0 0x7f4b9015b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:13.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.404+0000 7f4b87fff700 1 -- 172.21.15.112:0/212074540 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b9015dc20 msgr2=0x7f4b901e6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:13.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.404+0000 7f4b87fff700 1 --2- 172.21.15.112:0/212074540 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b9015dc20 0x7f4b901e6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:13.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.404+0000 7f4b87fff700 1 -- 172.21.15.112:0/212074540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b900cd5b0 msgr2=0x7f4b9015b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:13.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.404+0000 7f4b87fff700 1 --2- 172.21.15.112:0/212074540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b900cd5b0 0x7f4b9015b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:13.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.404+0000 7f4b87fff700 1 -- 172.21.15.112:0/212074540 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b88009d00 con 0x7f4b90142ef0 2023-09-12T16:08:13.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.404+0000 7f4b87fff700 1 --2- 172.21.15.112:0/212074540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b90142ef0 0x7f4b901e5be0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800d950 tx=0x7f4b7800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:13.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.404+0000 7f4b8cff9700 1 -- 172.21.15.112:0/212074540 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78009930 con 0x7f4b90142ef0 2023-09-12T16:08:13.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.404+0000 7f4b8cff9700 1 -- 172.21.15.112:0/212074540 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4b78009b80 con 0x7f4b90142ef0 2023-09-12T16:08:13.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.404+0000 7f4b8cff9700 1 -- 172.21.15.112:0/212074540 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78010460 con 0x7f4b90142ef0 2023-09-12T16:08:13.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.404+0000 7f4b95dff700 1 -- 172.21.15.112:0/212074540 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9015c510 con 0x7f4b90142ef0 2023-09-12T16:08:13.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.405+0000 7f4b95dff700 1 -- 172.21.15.112:0/212074540 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9015b960 con 0x7f4b90142ef0 2023-09-12T16:08:13.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.406+0000 7f4b95dff700 1 -- 172.21.15.112:0/212074540 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b90073ea0 con 0x7f4b90142ef0 2023-09-12T16:08:13.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.406+0000 7f4b8cff9700 1 -- 172.21.15.112:0/212074540 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f4b780105c0 con 0x7f4b90142ef0 2023-09-12T16:08:13.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.408+0000 7f4b8cff9700 1 --2- 172.21.15.112:0/212074540 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f4b7006a580 0x7f4b7006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:13.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.408+0000 7f4b8cff9700 1 -- 172.21.15.112:0/212074540 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f4b78089150 con 0x7f4b90142ef0 2023-09-12T16:08:13.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.408+0000 7f4b8f7fe700 1 --2- 172.21.15.112:0/212074540 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f4b7006a580 0x7f4b7006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:13.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.409+0000 7f4b8f7fe700 1 --2- 172.21.15.112:0/212074540 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f4b7006a580 0x7f4b7006ca40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4b80005950 tx=0x7f4b800058e0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:13.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.412+0000 7f4b8cff9700 1 -- 172.21.15.112:0/212074540 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f4b78057d70 con 0x7f4b90142ef0 2023-09-12T16:08:13.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.608+0000 7f4b95dff700 1 -- 172.21.15.112:0/212074540 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4b90142470 con 0x7f4b90142ef0 2023-09-12T16:08:13.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.608+0000 7f4b8cff9700 1 -- 172.21.15.112:0/212074540 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4b78057900 con 0x7f4b90142ef0 2023-09-12T16:08:13.609 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-09-12T16:08:13.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.610+0000 7f4b95dff700 1 -- 172.21.15.112:0/212074540 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f4b7006a580 msgr2=0x7f4b7006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:13.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.611+0000 7f4b95dff700 1 --2- 172.21.15.112:0/212074540 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f4b7006a580 0x7f4b7006ca40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4b80005950 tx=0x7f4b800058e0 comp rx=0 tx=0).stop 2023-09-12T16:08:13.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.611+0000 7f4b95dff700 1 -- 172.21.15.112:0/212074540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b90142ef0 msgr2=0x7f4b901e5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:13.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.611+0000 7f4b95dff700 1 --2- 172.21.15.112:0/212074540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b90142ef0 0x7f4b901e5be0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800d950 tx=0x7f4b7800dd10 comp rx=0 tx=0).stop 2023-09-12T16:08:13.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.611+0000 7f4b95dff700 1 -- 172.21.15.112:0/212074540 shutdown_connections 2023-09-12T16:08:13.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.611+0000 7f4b95dff700 1 --2- 172.21.15.112:0/212074540 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f4b7006a580 0x7f4b7006ca40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:13.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.611+0000 7f4b95dff700 1 --2- 172.21.15.112:0/212074540 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b9015dc20 0x7f4b901e6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:13.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.611+0000 7f4b95dff700 1 --2- 172.21.15.112:0/212074540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b900cd5b0 0x7f4b9015b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:13.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.611+0000 7f4b95dff700 1 --2- 172.21.15.112:0/212074540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b90142ef0 0x7f4b901e5be0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:13.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.611+0000 7f4b95dff700 1 -- 172.21.15.112:0/212074540 >> 172.21.15.112:0/212074540 conn(0x7f4b9006a200 msgr2=0x7f4b900aeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:13.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.611+0000 7f4b95dff700 1 -- 172.21.15.112:0/212074540 shutdown_connections 2023-09-12T16:08:13.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.611+0000 7f4b95dff700 1 -- 172.21.15.112:0/212074540 wait complete. 2023-09-12T16:08:13.628 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-12T16:08:13.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.830+0000 7f559c7ff700 1 -- 172.21.15.112:0/930905369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5580005210 msgr2=0x7f558000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:13.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.830+0000 7f559c7ff700 1 --2- 172.21.15.112:0/930905369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5580005210 0x7f558000ba10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f558c00e350 tx=0x7f5580005880 comp rx=0 tx=0).stop 2023-09-12T16:08:13.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.830+0000 7f559c7ff700 1 -- 172.21.15.112:0/930905369 shutdown_connections 2023-09-12T16:08:13.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.830+0000 7f559c7ff700 1 --2- 172.21.15.112:0/930905369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5580005210 0x7f558000ba10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:13.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.830+0000 7f559c7ff700 1 -- 172.21.15.112:0/930905369 >> 172.21.15.112:0/930905369 conn(0x7f559409aa90 msgr2=0x7f55940d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:13.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.830+0000 7f559c7ff700 1 -- 172.21.15.112:0/930905369 shutdown_connections 2023-09-12T16:08:13.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.830+0000 7f559c7ff700 1 -- 172.21.15.112:0/930905369 wait complete. 2023-09-12T16:08:13.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.832+0000 7f559c7ff700 1 Processor -- start 2023-09-12T16:08:13.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.832+0000 7f559c7ff700 1 -- start start 2023-09-12T16:08:13.835 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.833+0000 7f559c7ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5580005210 0x7f5594151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:13.835 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.833+0000 7f559c7ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55940cae40 0x7f55940cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:13.835 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.833+0000 7f559c7ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f559415e4e0 0x7f559415e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:13.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.833+0000 7f559c7ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55940c5f40 con 0x7f55940cae40 2023-09-12T16:08:13.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.833+0000 7f559c7ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55940cb800 con 0x7f559415e4e0 2023-09-12T16:08:13.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.833+0000 7f559c7ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55940c52c0 con 0x7f5580005210 2023-09-12T16:08:13.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.833+0000 7f5599d9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55940cae40 0x7f55940cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:13.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.833+0000 7f5599d9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55940cae40 0x7f55940cb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58994/0 (socket says 172.21.15.112:58994) 2023-09-12T16:08:13.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.833+0000 7f5599d9a700 1 -- 172.21.15.112:0/1021951821 learned_addr learned my addr 172.21.15.112:0/1021951821 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:13.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.834+0000 7f559a59b700 1 --2- 172.21.15.112:0/1021951821 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5580005210 0x7f5594151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:13.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.834+0000 7f559ad9c700 1 --2- 172.21.15.112:0/1021951821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f559415e4e0 0x7f559415e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:13.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.834+0000 7f5599d9a700 1 -- 172.21.15.112:0/1021951821 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5580005210 msgr2=0x7f5594151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:13.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.834+0000 7f5599d9a700 1 --2- 172.21.15.112:0/1021951821 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5580005210 0x7f5594151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:13.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.834+0000 7f5599d9a700 1 -- 172.21.15.112:0/1021951821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f559415e4e0 msgr2=0x7f559415e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:13.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.834+0000 7f5599d9a700 1 --2- 172.21.15.112:0/1021951821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f559415e4e0 0x7f559415e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:13.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.834+0000 7f5599d9a700 1 -- 172.21.15.112:0/1021951821 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55940cfe40 con 0x7f55940cae40 2023-09-12T16:08:13.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.834+0000 7f559ad9c700 1 --2- 172.21.15.112:0/1021951821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f559415e4e0 0x7f559415e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:08:13.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.834+0000 7f559a59b700 1 --2- 172.21.15.112:0/1021951821 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5580005210 0x7f5594151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:08:13.839 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.834+0000 7f5599d9a700 1 --2- 172.21.15.112:0/1021951821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55940cae40 0x7f55940cb2c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5584004da0 tx=0x7f5584001540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:13.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.834+0000 7f558affd700 1 -- 172.21.15.112:0/1021951821 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5584011660 con 0x7f55940cae40 2023-09-12T16:08:13.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.834+0000 7f558affd700 1 -- 172.21.15.112:0/1021951821 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f55840118d0 con 0x7f55940cae40 2023-09-12T16:08:13.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.834+0000 7f558affd700 1 -- 172.21.15.112:0/1021951821 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5584011ce0 con 0x7f55940cae40 2023-09-12T16:08:13.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.834+0000 7f559c7ff700 1 -- 172.21.15.112:0/1021951821 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55940c55a0 con 0x7f55940cae40 2023-09-12T16:08:13.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.834+0000 7f559c7ff700 1 -- 172.21.15.112:0/1021951821 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55940c5b60 con 0x7f55940cae40 2023-09-12T16:08:13.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.835+0000 7f559c7ff700 1 -- 172.21.15.112:0/1021951821 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55940c5d20 con 0x7f55940cae40 2023-09-12T16:08:13.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.836+0000 7f558affd700 1 -- 172.21.15.112:0/1021951821 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f558401b460 con 0x7f55940cae40 2023-09-12T16:08:13.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.837+0000 7f558affd700 1 --2- 172.21.15.112:0/1021951821 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f557806a580 0x7f557806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:13.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.837+0000 7f558affd700 1 -- 172.21.15.112:0/1021951821 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5584089670 con 0x7f55940cae40 2023-09-12T16:08:13.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.837+0000 7f559a59b700 1 --2- 172.21.15.112:0/1021951821 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f557806a580 0x7f557806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:13.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.838+0000 7f559a59b700 1 --2- 172.21.15.112:0/1021951821 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f557806a580 0x7f557806ca40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5590001050 tx=0x7f5590001b90 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:13.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:13.841+0000 7f558affd700 1 -- 172.21.15.112:0/1021951821 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f55840548a0 con 0x7f55940cae40 2023-09-12T16:08:14.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.046+0000 7f559c7ff700 1 -- 172.21.15.112:0/1021951821 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f55940c6080 con 0x7f55940cae40 2023-09-12T16:08:14.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.046+0000 7f558affd700 1 -- 172.21.15.112:0/1021951821 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f55940c6080 con 0x7f55940cae40 2023-09-12T16:08:14.047 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:08:14.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.049+0000 7f559c7ff700 1 -- 172.21.15.112:0/1021951821 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f557806a580 msgr2=0x7f557806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:14.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.049+0000 7f559c7ff700 1 --2- 172.21.15.112:0/1021951821 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f557806a580 0x7f557806ca40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5590001050 tx=0x7f5590001b90 comp rx=0 tx=0).stop 2023-09-12T16:08:14.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.049+0000 7f559c7ff700 1 -- 172.21.15.112:0/1021951821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55940cae40 msgr2=0x7f55940cb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:14.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.049+0000 7f559c7ff700 1 --2- 172.21.15.112:0/1021951821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55940cae40 0x7f55940cb2c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5584004da0 tx=0x7f5584001540 comp rx=0 tx=0).stop 2023-09-12T16:08:14.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.049+0000 7f559c7ff700 1 -- 172.21.15.112:0/1021951821 shutdown_connections 2023-09-12T16:08:14.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.049+0000 7f559c7ff700 1 --2- 172.21.15.112:0/1021951821 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f557806a580 0x7f557806ca40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:14.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.049+0000 7f559c7ff700 1 --2- 172.21.15.112:0/1021951821 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5580005210 0x7f5594151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:14.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.049+0000 7f559c7ff700 1 --2- 172.21.15.112:0/1021951821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f559415e4e0 0x7f559415e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:14.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.049+0000 7f559c7ff700 1 --2- 172.21.15.112:0/1021951821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55940cae40 0x7f55940cb2c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:14.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.049+0000 7f559c7ff700 1 -- 172.21.15.112:0/1021951821 >> 172.21.15.112:0/1021951821 conn(0x7f559409aa90 msgr2=0x7f55940ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:14.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.049+0000 7f559c7ff700 1 -- 172.21.15.112:0/1021951821 shutdown_connections 2023-09-12T16:08:14.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.049+0000 7f559c7ff700 1 -- 172.21.15.112:0/1021951821 wait complete. 2023-09-12T16:08:14.067 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-12T16:08:14.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.268+0000 7fa150bff700 1 -- 172.21.15.112:0/802305070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa134003a30 msgr2=0x7fa134003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:14.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.268+0000 7fa150bff700 1 --2- 172.21.15.112:0/802305070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa134003a30 0x7fa134003e50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa13c00c310 tx=0x7fa134005880 comp rx=0 tx=0).stop 2023-09-12T16:08:14.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.268+0000 7fa14ad9d700 1 -- 172.21.15.112:0/802305070 reap_dead start 2023-09-12T16:08:14.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.268+0000 7fa150bff700 1 -- 172.21.15.112:0/802305070 shutdown_connections 2023-09-12T16:08:14.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.268+0000 7fa150bff700 1 -- 172.21.15.112:0/802305070 >> 172.21.15.112:0/802305070 conn(0x7fa14c09ab60 msgr2=0x7fa14c0d1890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:14.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.268+0000 7fa150bff700 1 -- 172.21.15.112:0/802305070 shutdown_connections 2023-09-12T16:08:14.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.268+0000 7fa150bff700 1 -- 172.21.15.112:0/802305070 wait complete. 2023-09-12T16:08:14.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.270+0000 7fa150bff700 1 Processor -- start 2023-09-12T16:08:14.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.270+0000 7fa150bff700 1 -- start start 2023-09-12T16:08:14.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.271+0000 7fa150bff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa134003a30 0x7fa14c1e4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:14.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.271+0000 7fa150bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa14c1e5360 0x7fa14c1f1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:14.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.271+0000 7fa150bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa14c1f23b0 0x7fa14c1f2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:14.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.271+0000 7fa150bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c1f2da0 con 0x7fa14c1e5360 2023-09-12T16:08:14.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.271+0000 7fa150bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c1e61b0 con 0x7fa14c1f23b0 2023-09-12T16:08:14.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.271+0000 7fa150bff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c1e6490 con 0x7fa134003a30 2023-09-12T16:08:14.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.271+0000 7fa149d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa14c1e5360 0x7fa14c1f1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:14.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.271+0000 7fa149d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa14c1e5360 0x7fa14c1f1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59018/0 (socket says 172.21.15.112:59018) 2023-09-12T16:08:14.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.271+0000 7fa149d9b700 1 -- 172.21.15.112:0/2872440159 learned_addr learned my addr 172.21.15.112:0/2872440159 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:14.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.271+0000 7fa14ad9d700 1 --2- 172.21.15.112:0/2872440159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa14c1f23b0 0x7fa14c1f2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:14.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.271+0000 7fa14a59c700 1 --2- 172.21.15.112:0/2872440159 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa134003a30 0x7fa14c1e4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:14.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.271+0000 7fa149d9b700 1 -- 172.21.15.112:0/2872440159 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa134003a30 msgr2=0x7fa14c1e4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:14.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.271+0000 7fa149d9b700 1 --2- 172.21.15.112:0/2872440159 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa134003a30 0x7fa14c1e4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:14.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.271+0000 7fa149d9b700 1 -- 172.21.15.112:0/2872440159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa14c1f23b0 msgr2=0x7fa14c1f2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:14.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.271+0000 7fa149d9b700 1 --2- 172.21.15.112:0/2872440159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa14c1f23b0 0x7fa14c1f2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:14.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.271+0000 7fa149d9b700 1 -- 172.21.15.112:0/2872440159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14c1e6770 con 0x7fa14c1e5360 2023-09-12T16:08:14.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.271+0000 7fa14ad9d700 1 --2- 172.21.15.112:0/2872440159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa14c1f23b0 0x7fa14c1f2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:08:14.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.272+0000 7fa149d9b700 1 --2- 172.21.15.112:0/2872440159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa14c1e5360 0x7fa14c1f1e70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa140011ae0 tx=0x7fa140011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:14.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.272+0000 7fa13affd700 1 -- 172.21.15.112:0/2872440159 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000fb80 con 0x7fa14c1e5360 2023-09-12T16:08:14.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.272+0000 7fa13affd700 1 -- 172.21.15.112:0/2872440159 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa14000fce0 con 0x7fa14c1e5360 2023-09-12T16:08:14.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.272+0000 7fa150bff700 1 -- 172.21.15.112:0/2872440159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa14c1e6a50 con 0x7fa14c1e5360 2023-09-12T16:08:14.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.272+0000 7fa13affd700 1 -- 172.21.15.112:0/2872440159 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140004280 con 0x7fa14c1e5360 2023-09-12T16:08:14.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.272+0000 7fa150bff700 1 -- 172.21.15.112:0/2872440159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa14c1e7250 con 0x7fa14c1e5360 2023-09-12T16:08:14.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.273+0000 7fa150bff700 1 -- 172.21.15.112:0/2872440159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa14c1e70a0 con 0x7fa14c1e5360 2023-09-12T16:08:14.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.274+0000 7fa13affd700 1 -- 172.21.15.112:0/2872440159 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fa1400043e0 con 0x7fa14c1e5360 2023-09-12T16:08:14.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.275+0000 7fa13affd700 1 --2- 172.21.15.112:0/2872440159 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa12c06a580 0x7fa12c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:14.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.275+0000 7fa13affd700 1 -- 172.21.15.112:0/2872440159 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fa1400897d0 con 0x7fa14c1e5360 2023-09-12T16:08:14.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.275+0000 7fa14a59c700 1 --2- 172.21.15.112:0/2872440159 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa12c06a580 0x7fa12c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:14.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.275+0000 7fa14a59c700 1 --2- 172.21.15.112:0/2872440159 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa12c06a580 0x7fa12c06ca40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa13c001930 tx=0x7fa13c00f000 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:14.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.279+0000 7fa13affd700 1 -- 172.21.15.112:0/2872440159 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fa140054990 con 0x7fa14c1e5360 2023-09-12T16:08:14.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.487+0000 7fa150bff700 1 -- 172.21.15.112:0/2872440159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa14c04e300 con 0x7fa14c1e5360 2023-09-12T16:08:14.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.487+0000 7fa13affd700 1 -- 172.21.15.112:0/2872440159 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa140057fb0 con 0x7fa14c1e5360 2023-09-12T16:08:14.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.489+0000 7fa150bff700 1 -- 172.21.15.112:0/2872440159 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa12c06a580 msgr2=0x7fa12c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:14.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.489+0000 7fa150bff700 1 --2- 172.21.15.112:0/2872440159 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa12c06a580 0x7fa12c06ca40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa13c001930 tx=0x7fa13c00f000 comp rx=0 tx=0).stop 2023-09-12T16:08:14.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.490+0000 7fa150bff700 1 -- 172.21.15.112:0/2872440159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa14c1e5360 msgr2=0x7fa14c1f1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:14.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.490+0000 7fa150bff700 1 --2- 172.21.15.112:0/2872440159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa14c1e5360 0x7fa14c1f1e70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa140011ae0 tx=0x7fa140011ea0 comp rx=0 tx=0).stop 2023-09-12T16:08:14.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.490+0000 7fa150bff700 1 -- 172.21.15.112:0/2872440159 shutdown_connections 2023-09-12T16:08:14.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.490+0000 7fa150bff700 1 --2- 172.21.15.112:0/2872440159 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fa12c06a580 0x7fa12c06ca40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:14.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.490+0000 7fa150bff700 1 --2- 172.21.15.112:0/2872440159 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa134003a30 0x7fa14c1e4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:14.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.490+0000 7fa150bff700 1 --2- 172.21.15.112:0/2872440159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa14c1f23b0 0x7fa14c1f2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:14.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.490+0000 7fa150bff700 1 --2- 172.21.15.112:0/2872440159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa14c1e5360 0x7fa14c1f1e70 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:14.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.490+0000 7fa150bff700 1 -- 172.21.15.112:0/2872440159 >> 172.21.15.112:0/2872440159 conn(0x7fa14c09ab60 msgr2=0x7fa14c0ccb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:14.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.490+0000 7fa150bff700 1 -- 172.21.15.112:0/2872440159 shutdown_connections 2023-09-12T16:08:14.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.490+0000 7fa150bff700 1 -- 172.21.15.112:0/2872440159 wait complete. 2023-09-12T16:08:14.493 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2023-09-12T16:08:14.507 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-09-12T16:08:14.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:08:14.508 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-09-12T16:08:14.602 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-09-12T16:08:14.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:08:14.603 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-09-12T16:08:14.651 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-12T16:08:14.652 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-12T16:08:14.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.851+0000 7fb75ddff700 1 -- 172.21.15.112:0/3152770195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7580cdfb0 msgr2=0x7fb7580cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:14.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.851+0000 7fb75ddff700 1 --2- 172.21.15.112:0/3152770195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7580cdfb0 0x7fb7580cc3b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb75808baa0 tx=0x7fb74c009ba0 comp rx=0 tx=0).stop 2023-09-12T16:08:14.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.851+0000 7fb75ddff700 1 -- 172.21.15.112:0/3152770195 shutdown_connections 2023-09-12T16:08:14.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.851+0000 7fb75ddff700 1 --2- 172.21.15.112:0/3152770195 >> v2:172.21.15.144:3300/0 conn(0x7fb7580d0590 0x7fb7580cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:14.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.851+0000 7fb75ddff700 1 --2- 172.21.15.112:0/3152770195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7580cdfb0 0x7fb7580cc3b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:14.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.851+0000 7fb75ddff700 1 -- 172.21.15.112:0/3152770195 >> 172.21.15.112:0/3152770195 conn(0x7fb7580d1930 msgr2=0x7fb7580d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:14.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.851+0000 7fb75ddff700 1 -- 172.21.15.112:0/3152770195 shutdown_connections 2023-09-12T16:08:14.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.851+0000 7fb75ddff700 1 -- 172.21.15.112:0/3152770195 wait complete. 2023-09-12T16:08:14.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.853+0000 7fb75ddff700 1 Processor -- start 2023-09-12T16:08:14.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.853+0000 7fb75ddff700 1 -- start start 2023-09-12T16:08:14.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.854+0000 7fb75ddff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7580cdfb0 0x7fb75806c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:14.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.854+0000 7fb75ddff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7580d0590 0x7fb75809b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:14.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.854+0000 7fb75ddff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb75815f480 0x7fb758159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:14.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.854+0000 7fb75ddff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7580b4520 con 0x7fb7580cdfb0 2023-09-12T16:08:14.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.854+0000 7fb75ddff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7580b4ae0 con 0x7fb75815f480 2023-09-12T16:08:14.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.854+0000 7fb75ddff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75809f1e0 con 0x7fb7580d0590 2023-09-12T16:08:14.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.854+0000 7fb7577fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7580cdfb0 0x7fb75806c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:14.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.854+0000 7fb7577fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7580cdfb0 0x7fb75806c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59024/0 (socket says 172.21.15.112:59024) 2023-09-12T16:08:14.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.854+0000 7fb7577fe700 1 -- 172.21.15.112:0/1477928737 learned_addr learned my addr 172.21.15.112:0/1477928737 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:14.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.855+0000 7fb757fff700 1 --2- 172.21.15.112:0/1477928737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb75815f480 0x7fb758159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:14.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.855+0000 7fb756ffd700 1 --2- 172.21.15.112:0/1477928737 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7580d0590 0x7fb75809b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:14.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.855+0000 7fb7577fe700 1 -- 172.21.15.112:0/1477928737 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7580d0590 msgr2=0x7fb75809b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:14.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.855+0000 7fb7577fe700 1 --2- 172.21.15.112:0/1477928737 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7580d0590 0x7fb75809b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:14.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.855+0000 7fb7577fe700 1 -- 172.21.15.112:0/1477928737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb75815f480 msgr2=0x7fb758159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:14.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.855+0000 7fb7577fe700 1 --2- 172.21.15.112:0/1477928737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb75815f480 0x7fb758159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:14.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.855+0000 7fb7577fe700 1 -- 172.21.15.112:0/1477928737 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74c009520 con 0x7fb7580cdfb0 2023-09-12T16:08:14.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.855+0000 7fb756ffd700 1 --2- 172.21.15.112:0/1477928737 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7580d0590 0x7fb75809b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:14.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.855+0000 7fb757fff700 1 --2- 172.21.15.112:0/1477928737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb75815f480 0x7fb758159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:14.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.855+0000 7fb7577fe700 1 --2- 172.21.15.112:0/1477928737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7580cdfb0 0x7fb75806c160 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb74800c4b0 tx=0x7fb74800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:14.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.855+0000 7fb73ffff700 1 -- 172.21.15.112:0/1477928737 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7480054e0 con 0x7fb7580cdfb0 2023-09-12T16:08:14.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.855+0000 7fb73ffff700 1 -- 172.21.15.112:0/1477928737 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb748003680 con 0x7fb7580cdfb0 2023-09-12T16:08:14.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.855+0000 7fb73ffff700 1 -- 172.21.15.112:0/1477928737 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb748003a90 con 0x7fb7580cdfb0 2023-09-12T16:08:14.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.855+0000 7fb75ddff700 1 -- 172.21.15.112:0/1477928737 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75809f4c0 con 0x7fb7580cdfb0 2023-09-12T16:08:14.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.855+0000 7fb75ddff700 1 -- 172.21.15.112:0/1477928737 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75809ee00 con 0x7fb7580cdfb0 2023-09-12T16:08:14.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.856+0000 7fb75ddff700 1 -- 172.21.15.112:0/1477928737 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb75809ef90 con 0x7fb7580cdfb0 2023-09-12T16:08:14.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.857+0000 7fb73ffff700 1 -- 172.21.15.112:0/1477928737 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fb748003bf0 con 0x7fb7580cdfb0 2023-09-12T16:08:14.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.858+0000 7fb73ffff700 1 --2- 172.21.15.112:0/1477928737 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb74406a580 0x7fb74406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:14.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.858+0000 7fb73ffff700 1 -- 172.21.15.112:0/1477928737 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb7480884b0 con 0x7fb7580cdfb0 2023-09-12T16:08:14.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.859+0000 7fb756ffd700 1 --2- 172.21.15.112:0/1477928737 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb74406a580 0x7fb74406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:14.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.859+0000 7fb756ffd700 1 --2- 172.21.15.112:0/1477928737 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb74406a580 0x7fb74406ca40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb74c009fd0 tx=0x7fb74c0047c0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:14.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:14.863+0000 7fb73ffff700 1 -- 172.21.15.112:0/1477928737 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb748053640 con 0x7fb7580cdfb0 2023-09-12T16:08:15.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.104+0000 7fb75ddff700 1 -- 172.21.15.112:0/1477928737 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb75804e300 con 0x7fb7580cdfb0 2023-09-12T16:08:15.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.105+0000 7fb73ffff700 1 -- 172.21.15.112:0/1477928737 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7fb748056c60 con 0x7fb7580cdfb0 2023-09-12T16:08:15.105 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:15.106 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3995117138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3995117138},{"type":"v1","addr":"172.21.15.112:6836","nonce":3995117138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3233826602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3233826602},{"type":"v1","addr":"172.21.15.112:6837","nonce":3233826602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1854265710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1854265710},{"type":"v1","addr":"172.21.15.144:6834","nonce":1854265710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-12T16:06:59.697334+0000","modified":"2023-09-12T16:07:20.393475+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4396":{"gid":4396,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/2785398652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2785398652},{"type":"v1","addr":"172.21.15.144:6835","nonce":2785398652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-12T16:08:15.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.107+0000 7fb75ddff700 1 -- 172.21.15.112:0/1477928737 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb74406a580 msgr2=0x7fb74406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:15.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.107+0000 7fb75ddff700 1 --2- 172.21.15.112:0/1477928737 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb74406a580 0x7fb74406ca40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb74c009fd0 tx=0x7fb74c0047c0 comp rx=0 tx=0).stop 2023-09-12T16:08:15.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.107+0000 7fb75ddff700 1 -- 172.21.15.112:0/1477928737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7580cdfb0 msgr2=0x7fb75806c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:15.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.107+0000 7fb75ddff700 1 --2- 172.21.15.112:0/1477928737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7580cdfb0 0x7fb75806c160 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb74800c4b0 tx=0x7fb74800c870 comp rx=0 tx=0).stop 2023-09-12T16:08:15.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.107+0000 7fb75ddff700 1 -- 172.21.15.112:0/1477928737 shutdown_connections 2023-09-12T16:08:15.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.107+0000 7fb75ddff700 1 --2- 172.21.15.112:0/1477928737 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb74406a580 0x7fb74406ca40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:15.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.107+0000 7fb75ddff700 1 --2- 172.21.15.112:0/1477928737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb75815f480 0x7fb758159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:15.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.107+0000 7fb75ddff700 1 --2- 172.21.15.112:0/1477928737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7580cdfb0 0x7fb75806c160 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:15.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.107+0000 7fb75ddff700 1 --2- 172.21.15.112:0/1477928737 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7580d0590 0x7fb75809b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:15.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.108+0000 7fb75ddff700 1 -- 172.21.15.112:0/1477928737 >> 172.21.15.112:0/1477928737 conn(0x7fb7580d1930 msgr2=0x7fb75815d330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:15.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.108+0000 7fb75ddff700 1 -- 172.21.15.112:0/1477928737 shutdown_connections 2023-09-12T16:08:15.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.108+0000 7fb75ddff700 1 -- 172.21.15.112:0/1477928737 wait complete. 2023-09-12T16:08:15.110 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 9 2023-09-12T16:08:15.126 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:08:15.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.327+0000 7fabc23ff700 1 -- 172.21.15.112:0/3252501233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faba4003a00 msgr2=0x7faba4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:15.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.327+0000 7fabc23ff700 1 --2- 172.21.15.112:0/3252501233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faba4003a00 0x7faba4003e20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fabac00c310 tx=0x7faba4005880 comp rx=0 tx=0).stop 2023-09-12T16:08:15.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.328+0000 7fabc23ff700 1 -- 172.21.15.112:0/3252501233 shutdown_connections 2023-09-12T16:08:15.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.328+0000 7fabc23ff700 1 --2- 172.21.15.112:0/3252501233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faba4003a00 0x7faba4003e20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:15.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.328+0000 7fabc23ff700 1 -- 172.21.15.112:0/3252501233 >> 172.21.15.112:0/3252501233 conn(0x7fabbc06a650 msgr2=0x7fabbc06c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:15.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.328+0000 7fabc23ff700 1 -- 172.21.15.112:0/3252501233 shutdown_connections 2023-09-12T16:08:15.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.328+0000 7fabc23ff700 1 -- 172.21.15.112:0/3252501233 wait complete. 2023-09-12T16:08:15.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.329+0000 7fabc23ff700 1 Processor -- start 2023-09-12T16:08:15.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.329+0000 7fabc23ff700 1 -- start start 2023-09-12T16:08:15.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.330+0000 7fabc23ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faba4003a00 0x7fabbc157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:15.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.330+0000 7fabc23ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc0c8cb0 0x7fabbc0c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:15.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.330+0000 7fabc23ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabbc0aa8e0 0x7fabbc0aad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:15.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.330+0000 7fabc23ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0c9670 con 0x7fabbc0c8cb0 2023-09-12T16:08:15.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.330+0000 7fabc23ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0ab2a0 con 0x7fabbc0aa8e0 2023-09-12T16:08:15.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.330+0000 7fabc23ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0ccfa0 con 0x7faba4003a00 2023-09-12T16:08:15.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.331+0000 7fabbb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc0c8cb0 0x7fabbc0c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:15.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.331+0000 7fabbb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc0c8cb0 0x7fabbc0c9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59040/0 (socket says 172.21.15.112:59040) 2023-09-12T16:08:15.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.331+0000 7fabbb7fe700 1 -- 172.21.15.112:0/2171154688 learned_addr learned my addr 172.21.15.112:0/2171154688 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:15.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.331+0000 7fabc099c700 1 --2- 172.21.15.112:0/2171154688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabbc0aa8e0 0x7fabbc0aad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:15.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.331+0000 7fabbbfff700 1 --2- 172.21.15.112:0/2171154688 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faba4003a00 0x7fabbc157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:15.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.331+0000 7fabbb7fe700 1 -- 172.21.15.112:0/2171154688 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faba4003a00 msgr2=0x7fabbc157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:15.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.331+0000 7fabbb7fe700 1 --2- 172.21.15.112:0/2171154688 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faba4003a00 0x7fabbc157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:15.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.331+0000 7fabbb7fe700 1 -- 172.21.15.112:0/2171154688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabbc0aa8e0 msgr2=0x7fabbc0aad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:15.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.331+0000 7fabbb7fe700 1 --2- 172.21.15.112:0/2171154688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabbc0aa8e0 0x7fabbc0aad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:15.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.331+0000 7fabbb7fe700 1 -- 172.21.15.112:0/2171154688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc0cb080 con 0x7fabbc0c8cb0 2023-09-12T16:08:15.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.331+0000 7fabbbfff700 1 --2- 172.21.15.112:0/2171154688 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faba4003a00 0x7fabbc157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:08:15.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.331+0000 7fabbb7fe700 1 --2- 172.21.15.112:0/2171154688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc0c8cb0 0x7fabbc0c9130 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fabb0011b10 tx=0x7fabb0011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:15.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.331+0000 7fabb8ff9700 1 -- 172.21.15.112:0/2171154688 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb000fd20 con 0x7fabbc0c8cb0 2023-09-12T16:08:15.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.331+0000 7fabb8ff9700 1 -- 172.21.15.112:0/2171154688 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fabb000fe80 con 0x7fabbc0c8cb0 2023-09-12T16:08:15.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.331+0000 7fabb8ff9700 1 -- 172.21.15.112:0/2171154688 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb0004280 con 0x7fabbc0c8cb0 2023-09-12T16:08:15.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.331+0000 7fabc23ff700 1 -- 172.21.15.112:0/2171154688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabbc0ab4c0 con 0x7fabbc0c8cb0 2023-09-12T16:08:15.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.332+0000 7fabc23ff700 1 -- 172.21.15.112:0/2171154688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabbc0aba80 con 0x7fabbc0c8cb0 2023-09-12T16:08:15.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.333+0000 7fabc23ff700 1 -- 172.21.15.112:0/2171154688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabbc04e300 con 0x7fabbc0c8cb0 2023-09-12T16:08:15.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.333+0000 7fabb8ff9700 1 -- 172.21.15.112:0/2171154688 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fabb00043e0 con 0x7fabbc0c8cb0 2023-09-12T16:08:15.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.334+0000 7fabb8ff9700 1 --2- 172.21.15.112:0/2171154688 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7faba806a580 0x7faba806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:15.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.334+0000 7fabb8ff9700 1 -- 172.21.15.112:0/2171154688 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fabb00899e0 con 0x7fabbc0c8cb0 2023-09-12T16:08:15.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.334+0000 7fabbbfff700 1 --2- 172.21.15.112:0/2171154688 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7faba806a580 0x7faba806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:15.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.335+0000 7fabbbfff700 1 --2- 172.21.15.112:0/2171154688 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7faba806a580 0x7faba806ca40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fabac000c00 tx=0x7fabac00f000 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:15.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.339+0000 7fabb8ff9700 1 -- 172.21.15.112:0/2171154688 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fabb0054b80 con 0x7fabbc0c8cb0 2023-09-12T16:08:15.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.535+0000 7fabc23ff700 1 -- 172.21.15.112:0/2171154688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabbc06d0d0 con 0x7fabbc0c8cb0 2023-09-12T16:08:15.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.537+0000 7fabb8ff9700 1 -- 172.21.15.112:0/2171154688 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18816 (secure 0 0 0) 0x7fabb00581a0 con 0x7fabbc0c8cb0 2023-09-12T16:08:15.537 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:15.537 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:44.445226+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:08:15.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.539+0000 7fabc23ff700 1 -- 172.21.15.112:0/2171154688 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7faba806a580 msgr2=0x7faba806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:15.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.539+0000 7fabc23ff700 1 --2- 172.21.15.112:0/2171154688 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7faba806a580 0x7faba806ca40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fabac000c00 tx=0x7fabac00f000 comp rx=0 tx=0).stop 2023-09-12T16:08:15.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.539+0000 7fabc23ff700 1 -- 172.21.15.112:0/2171154688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc0c8cb0 msgr2=0x7fabbc0c9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:15.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.539+0000 7fabc23ff700 1 --2- 172.21.15.112:0/2171154688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc0c8cb0 0x7fabbc0c9130 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fabb0011b10 tx=0x7fabb0011e20 comp rx=0 tx=0).stop 2023-09-12T16:08:15.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.539+0000 7fabc23ff700 1 -- 172.21.15.112:0/2171154688 shutdown_connections 2023-09-12T16:08:15.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.539+0000 7fabc23ff700 1 --2- 172.21.15.112:0/2171154688 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7faba806a580 0x7faba806ca40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:15.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.539+0000 7fabc23ff700 1 --2- 172.21.15.112:0/2171154688 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faba4003a00 0x7fabbc157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:15.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.539+0000 7fabc23ff700 1 --2- 172.21.15.112:0/2171154688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabbc0aa8e0 0x7fabbc0aad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:15.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.539+0000 7fabc23ff700 1 --2- 172.21.15.112:0/2171154688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc0c8cb0 0x7fabbc0c9130 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:15.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.539+0000 7fabc23ff700 1 -- 172.21.15.112:0/2171154688 >> 172.21.15.112:0/2171154688 conn(0x7fabbc06a650 msgr2=0x7fabbc0c80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:15.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.539+0000 7fabc23ff700 1 -- 172.21.15.112:0/2171154688 shutdown_connections 2023-09-12T16:08:15.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.540+0000 7fabc23ff700 1 -- 172.21.15.112:0/2171154688 wait complete. 2023-09-12T16:08:15.558 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-12T16:06:48.871680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-12T16:06:58.137223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-12T16:06:58.684034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-12T16:07:02.283459+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-12T16:08:15.559 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-12T16:08:15.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.759+0000 7f2a469ff700 1 -- 172.21.15.112:0/3199245868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a400cfdb0 msgr2=0x7f2a400d0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:15.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.759+0000 7f2a469ff700 1 --2- 172.21.15.112:0/3199245868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a400cfdb0 0x7f2a400d0200 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2a38009f60 tx=0x7f2a38009f90 comp rx=0 tx=0).stop 2023-09-12T16:08:15.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.760+0000 7f2a469ff700 1 -- 172.21.15.112:0/3199245868 shutdown_connections 2023-09-12T16:08:15.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.760+0000 7f2a469ff700 1 --2- 172.21.15.112:0/3199245868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a400cfdb0 0x7f2a400d0200 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:15.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.760+0000 7f2a469ff700 1 --2- 172.21.15.112:0/3199245868 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a4015bca0 0x7f2a4015cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:15.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.760+0000 7f2a469ff700 1 -- 172.21.15.112:0/3199245868 >> 172.21.15.112:0/3199245868 conn(0x7f2a400d17d0 msgr2=0x7f2a400d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:15.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.760+0000 7f2a469ff700 1 -- 172.21.15.112:0/3199245868 shutdown_connections 2023-09-12T16:08:15.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.760+0000 7f2a469ff700 1 -- 172.21.15.112:0/3199245868 wait complete. 2023-09-12T16:08:15.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.761+0000 7f2a469ff700 1 Processor -- start 2023-09-12T16:08:15.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.761+0000 7f2a469ff700 1 -- start start 2023-09-12T16:08:15.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.762+0000 7f2a469ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a400cfdb0 0x7f2a4014a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:15.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.762+0000 7f2a469ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4015bca0 0x7f2a401e5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:15.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.762+0000 7f2a469ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a400b0bc0 0x7f2a400b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:15.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.762+0000 7f2a469ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a400b15b0 con 0x7f2a4015bca0 2023-09-12T16:08:15.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.762+0000 7f2a469ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a400b2ad0 con 0x7f2a400b0bc0 2023-09-12T16:08:15.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.762+0000 7f2a469ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a400b2d70 con 0x7f2a400cfdb0 2023-09-12T16:08:15.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.763+0000 7f2a3f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4015bca0 0x7f2a401e5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:15.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.763+0000 7f2a3f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4015bca0 0x7f2a401e5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59048/0 (socket says 172.21.15.112:59048) 2023-09-12T16:08:15.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.763+0000 7f2a3f7fe700 1 -- 172.21.15.112:0/3922220336 learned_addr learned my addr 172.21.15.112:0/3922220336 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:15.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.763+0000 7f2a44f9c700 1 --2- 172.21.15.112:0/3922220336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a400b0bc0 0x7f2a400b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:15.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.763+0000 7f2a3ffff700 1 --2- 172.21.15.112:0/3922220336 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a400cfdb0 0x7f2a4014a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:15.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.763+0000 7f2a3f7fe700 1 -- 172.21.15.112:0/3922220336 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a400cfdb0 msgr2=0x7f2a4014a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:15.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.763+0000 7f2a3f7fe700 1 --2- 172.21.15.112:0/3922220336 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a400cfdb0 0x7f2a4014a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:15.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.763+0000 7f2a3f7fe700 1 -- 172.21.15.112:0/3922220336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a400b0bc0 msgr2=0x7f2a400b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:15.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.763+0000 7f2a3f7fe700 1 --2- 172.21.15.112:0/3922220336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a400b0bc0 0x7f2a400b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:15.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.763+0000 7f2a3f7fe700 1 -- 172.21.15.112:0/3922220336 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a38009c40 con 0x7f2a4015bca0 2023-09-12T16:08:15.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.763+0000 7f2a3f7fe700 1 --2- 172.21.15.112:0/3922220336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4015bca0 0x7f2a401e5090 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400c500 tx=0x7f2a3400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:15.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.763+0000 7f2a3cff9700 1 -- 172.21.15.112:0/3922220336 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34011790 con 0x7f2a4015bca0 2023-09-12T16:08:15.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.764+0000 7f2a3cff9700 1 -- 172.21.15.112:0/3922220336 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2a340118f0 con 0x7f2a4015bca0 2023-09-12T16:08:15.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.764+0000 7f2a3cff9700 1 -- 172.21.15.112:0/3922220336 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34011ce0 con 0x7f2a4015bca0 2023-09-12T16:08:15.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.764+0000 7f2a469ff700 1 -- 172.21.15.112:0/3922220336 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4014b890 con 0x7f2a4015bca0 2023-09-12T16:08:15.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.764+0000 7f2a469ff700 1 -- 172.21.15.112:0/3922220336 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4014aff0 con 0x7f2a4015bca0 2023-09-12T16:08:15.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.765+0000 7f2a469ff700 1 -- 172.21.15.112:0/3922220336 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a400b2f20 con 0x7f2a4015bca0 2023-09-12T16:08:15.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.766+0000 7f2a3cff9700 1 -- 172.21.15.112:0/3922220336 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f2a3401c460 con 0x7f2a4015bca0 2023-09-12T16:08:15.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.766+0000 7f2a3cff9700 1 --2- 172.21.15.112:0/3922220336 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f2a2c06a580 0x7f2a2c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:15.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.766+0000 7f2a3cff9700 1 -- 172.21.15.112:0/3922220336 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f2a34088b00 con 0x7f2a4015bca0 2023-09-12T16:08:15.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.767+0000 7f2a3ffff700 1 --2- 172.21.15.112:0/3922220336 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f2a2c06a580 0x7f2a2c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:15.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.767+0000 7f2a3ffff700 1 --2- 172.21.15.112:0/3922220336 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f2a2c06a580 0x7f2a2c06ca40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009bc0 tx=0x7f2a30009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:15.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.771+0000 7f2a3cff9700 1 -- 172.21.15.112:0/3922220336 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f2a400b2f20 con 0x7f2a4015bca0 2023-09-12T16:08:15.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.970+0000 7f2a469ff700 1 -- 172.21.15.112:0/3922220336 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2a400d0740 con 0x7f2a4015bca0 2023-09-12T16:08:15.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.970+0000 7f2a3cff9700 1 -- 172.21.15.112:0/3922220336 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a400d0740 con 0x7f2a4015bca0 2023-09-12T16:08:15.971 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-09-12T16:08:15.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.972+0000 7f2a469ff700 1 -- 172.21.15.112:0/3922220336 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f2a2c06a580 msgr2=0x7f2a2c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:15.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.972+0000 7f2a469ff700 1 --2- 172.21.15.112:0/3922220336 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f2a2c06a580 0x7f2a2c06ca40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009bc0 tx=0x7f2a30009260 comp rx=0 tx=0).stop 2023-09-12T16:08:15.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.972+0000 7f2a469ff700 1 -- 172.21.15.112:0/3922220336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4015bca0 msgr2=0x7f2a401e5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:15.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.972+0000 7f2a469ff700 1 --2- 172.21.15.112:0/3922220336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4015bca0 0x7f2a401e5090 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400c500 tx=0x7f2a3400c810 comp rx=0 tx=0).stop 2023-09-12T16:08:15.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.973+0000 7f2a469ff700 1 -- 172.21.15.112:0/3922220336 shutdown_connections 2023-09-12T16:08:15.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.973+0000 7f2a469ff700 1 --2- 172.21.15.112:0/3922220336 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f2a2c06a580 0x7f2a2c06ca40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:15.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.973+0000 7f2a469ff700 1 --2- 172.21.15.112:0/3922220336 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a400cfdb0 0x7f2a4014a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:15.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.973+0000 7f2a469ff700 1 --2- 172.21.15.112:0/3922220336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a400b0bc0 0x7f2a400b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:15.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.973+0000 7f2a469ff700 1 --2- 172.21.15.112:0/3922220336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4015bca0 0x7f2a401e5090 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:15.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.973+0000 7f2a469ff700 1 -- 172.21.15.112:0/3922220336 >> 172.21.15.112:0/3922220336 conn(0x7f2a400d17d0 msgr2=0x7f2a400afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:15.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.973+0000 7f2a469ff700 1 -- 172.21.15.112:0/3922220336 shutdown_connections 2023-09-12T16:08:15.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:15.973+0000 7f2a469ff700 1 -- 172.21.15.112:0/3922220336 wait complete. 2023-09-12T16:08:15.991 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-12T16:08:16.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.192+0000 7fac39dff700 1 -- 172.21.15.112:0/3566636282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac340cf5b0 msgr2=0x7fac340cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:16.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.192+0000 7fac39dff700 1 --2- 172.21.15.112:0/3566636282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac340cf5b0 0x7fac340cebc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fac280098c0 tx=0x7fac28009bd0 comp rx=0 tx=0).stop 2023-09-12T16:08:16.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.192+0000 7fac39dff700 1 -- 172.21.15.112:0/3566636282 shutdown_connections 2023-09-12T16:08:16.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.192+0000 7fac39dff700 1 --2- 172.21.15.112:0/3566636282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac340cf5b0 0x7fac340cebc0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:16.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.192+0000 7fac39dff700 1 -- 172.21.15.112:0/3566636282 >> 172.21.15.112:0/3566636282 conn(0x7fac340d17d0 msgr2=0x7fac340d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:16.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.192+0000 7fac39dff700 1 -- 172.21.15.112:0/3566636282 shutdown_connections 2023-09-12T16:08:16.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.192+0000 7fac39dff700 1 -- 172.21.15.112:0/3566636282 wait complete. 2023-09-12T16:08:16.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.194+0000 7fac39dff700 1 Processor -- start 2023-09-12T16:08:16.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.194+0000 7fac39dff700 1 -- start start 2023-09-12T16:08:16.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.195+0000 7fac39dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac340cfdb0 0x7fac34159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:16.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.195+0000 7fac39dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac3415bca0 0x7fac340b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:16.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.195+0000 7fac39dff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac341f2b70 0x7fac3406bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:16.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.195+0000 7fac39dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3415d990 con 0x7fac340cfdb0 2023-09-12T16:08:16.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.195+0000 7fac39dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac341f3000 con 0x7fac3415bca0 2023-09-12T16:08:16.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.195+0000 7fac39dff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac340b3250 con 0x7fac341f2b70 2023-09-12T16:08:16.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.195+0000 7fac337fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac340cfdb0 0x7fac34159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:16.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.195+0000 7fac337fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac340cfdb0 0x7fac34159bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60526/0 (socket says 172.21.15.112:60526) 2023-09-12T16:08:16.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.195+0000 7fac337fe700 1 -- 172.21.15.112:0/2127477910 learned_addr learned my addr 172.21.15.112:0/2127477910 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:16.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.195+0000 7fac32ffd700 1 --2- 172.21.15.112:0/2127477910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac3415bca0 0x7fac340b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:16.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.195+0000 7fac337fe700 1 -- 172.21.15.112:0/2127477910 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac341f2b70 msgr2=0x7fac3406bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:16.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.195+0000 7fac337fe700 1 --2- 172.21.15.112:0/2127477910 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac341f2b70 0x7fac3406bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:16.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.195+0000 7fac337fe700 1 -- 172.21.15.112:0/2127477910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac3415bca0 msgr2=0x7fac340b2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:16.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.195+0000 7fac337fe700 1 --2- 172.21.15.112:0/2127477910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac3415bca0 0x7fac340b2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:16.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.195+0000 7fac337fe700 1 -- 172.21.15.112:0/2127477910 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac28009520 con 0x7fac340cfdb0 2023-09-12T16:08:16.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.196+0000 7fac337fe700 1 --2- 172.21.15.112:0/2127477910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac340cfdb0 0x7fac34159bc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fac2400c450 tx=0x7fac2400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:16.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.196+0000 7fac1bfff700 1 -- 172.21.15.112:0/2127477910 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac240052d0 con 0x7fac340cfdb0 2023-09-12T16:08:16.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.196+0000 7fac1bfff700 1 -- 172.21.15.112:0/2127477910 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fac24005520 con 0x7fac340cfdb0 2023-09-12T16:08:16.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.196+0000 7fac39dff700 1 -- 172.21.15.112:0/2127477910 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac340b3530 con 0x7fac340cfdb0 2023-09-12T16:08:16.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.196+0000 7fac1bfff700 1 -- 172.21.15.112:0/2127477910 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac240038e0 con 0x7fac340cfdb0 2023-09-12T16:08:16.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.196+0000 7fac39dff700 1 -- 172.21.15.112:0/2127477910 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac340b3af0 con 0x7fac340cfdb0 2023-09-12T16:08:16.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.197+0000 7fac39dff700 1 -- 172.21.15.112:0/2127477910 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac340b3c80 con 0x7fac340cfdb0 2023-09-12T16:08:16.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.198+0000 7fac1bfff700 1 -- 172.21.15.112:0/2127477910 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fac24003a40 con 0x7fac340cfdb0 2023-09-12T16:08:16.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.199+0000 7fac1bfff700 1 --2- 172.21.15.112:0/2127477910 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fac2006a580 0x7fac2006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:16.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.199+0000 7fac1bfff700 1 -- 172.21.15.112:0/2127477910 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fac24088470 con 0x7fac340cfdb0 2023-09-12T16:08:16.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.199+0000 7fac32ffd700 1 --2- 172.21.15.112:0/2127477910 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fac2006a580 0x7fac2006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:16.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.200+0000 7fac32ffd700 1 --2- 172.21.15.112:0/2127477910 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fac2006a580 0x7fac2006ca40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fac28009230 tx=0x7fac280047c0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:16.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.203+0000 7fac1bfff700 1 -- 172.21.15.112:0/2127477910 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fac24053600 con 0x7fac340cfdb0 2023-09-12T16:08:16.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.401+0000 7fac39dff700 1 -- 172.21.15.112:0/2127477910 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fac34073ea0 con 0x7fac340cfdb0 2023-09-12T16:08:16.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.402+0000 7fac1bfff700 1 -- 172.21.15.112:0/2127477910 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fac24056c20 con 0x7fac340cfdb0 2023-09-12T16:08:16.402 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:08:16.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.404+0000 7fac39dff700 1 -- 172.21.15.112:0/2127477910 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fac2006a580 msgr2=0x7fac2006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:16.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.404+0000 7fac39dff700 1 --2- 172.21.15.112:0/2127477910 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fac2006a580 0x7fac2006ca40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fac28009230 tx=0x7fac280047c0 comp rx=0 tx=0).stop 2023-09-12T16:08:16.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.404+0000 7fac39dff700 1 -- 172.21.15.112:0/2127477910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac340cfdb0 msgr2=0x7fac34159bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:16.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.404+0000 7fac39dff700 1 --2- 172.21.15.112:0/2127477910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac340cfdb0 0x7fac34159bc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fac2400c450 tx=0x7fac2400c810 comp rx=0 tx=0).stop 2023-09-12T16:08:16.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.404+0000 7fac39dff700 1 -- 172.21.15.112:0/2127477910 shutdown_connections 2023-09-12T16:08:16.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.404+0000 7fac39dff700 1 --2- 172.21.15.112:0/2127477910 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fac2006a580 0x7fac2006ca40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:16.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.404+0000 7fac39dff700 1 --2- 172.21.15.112:0/2127477910 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac341f2b70 0x7fac3406bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:16.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.404+0000 7fac39dff700 1 --2- 172.21.15.112:0/2127477910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac340cfdb0 0x7fac34159bc0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:16.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.404+0000 7fac39dff700 1 --2- 172.21.15.112:0/2127477910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac3415bca0 0x7fac340b2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:16.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.404+0000 7fac39dff700 1 -- 172.21.15.112:0/2127477910 >> 172.21.15.112:0/2127477910 conn(0x7fac340d17d0 msgr2=0x7fac3415adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:16.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.404+0000 7fac39dff700 1 -- 172.21.15.112:0/2127477910 shutdown_connections 2023-09-12T16:08:16.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.404+0000 7fac39dff700 1 -- 172.21.15.112:0/2127477910 wait complete. 2023-09-12T16:08:16.422 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-12T16:08:16.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.625+0000 7f834dbff700 1 -- 172.21.15.112:0/2728670473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83480d00e0 msgr2=0x7f83480ca7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:16.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.625+0000 7f834dbff700 1 --2- 172.21.15.112:0/2728670473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83480d00e0 0x7f83480ca7e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f833c0098c0 tx=0x7f833c009bd0 comp rx=0 tx=0).stop 2023-09-12T16:08:16.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.625+0000 7f834dbff700 1 -- 172.21.15.112:0/2728670473 shutdown_connections 2023-09-12T16:08:16.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.626+0000 7f834dbff700 1 --2- 172.21.15.112:0/2728670473 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83480cad20 0x7f83480c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:16.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.626+0000 7f834dbff700 1 --2- 172.21.15.112:0/2728670473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83480d00e0 0x7f83480ca7e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:16.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.626+0000 7f834dbff700 1 -- 172.21.15.112:0/2728670473 >> 172.21.15.112:0/2728670473 conn(0x7f83480cf5c0 msgr2=0x7f83480cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:16.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.626+0000 7f834dbff700 1 -- 172.21.15.112:0/2728670473 shutdown_connections 2023-09-12T16:08:16.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.626+0000 7f834dbff700 1 -- 172.21.15.112:0/2728670473 wait complete. 2023-09-12T16:08:16.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.627+0000 7f834dbff700 1 Processor -- start 2023-09-12T16:08:16.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.627+0000 7f834dbff700 1 -- start start 2023-09-12T16:08:16.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.628+0000 7f834dbff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83480cad20 0x7f83480c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:16.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.628+0000 7f834dbff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83480d00e0 0x7f83481f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:16.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.628+0000 7f834dbff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83481598d0 0x7f83481f22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:16.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.628+0000 7f834dbff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83480c78f0 con 0x7f83480d00e0 2023-09-12T16:08:16.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.628+0000 7f834dbff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83480c7bd0 con 0x7f83481598d0 2023-09-12T16:08:16.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.628+0000 7f834dbff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83480c7eb0 con 0x7f83480cad20 2023-09-12T16:08:16.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.628+0000 7f8346ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83480d00e0 0x7f83481f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:16.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.629+0000 7f8346ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83480d00e0 0x7f83481f1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60554/0 (socket says 172.21.15.112:60554) 2023-09-12T16:08:16.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.629+0000 7f8346ffd700 1 -- 172.21.15.112:0/3395512848 learned_addr learned my addr 172.21.15.112:0/3395512848 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:16.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.629+0000 7f8347fff700 1 --2- 172.21.15.112:0/3395512848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83481598d0 0x7f83481f22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:16.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.629+0000 7f83477fe700 1 --2- 172.21.15.112:0/3395512848 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83480cad20 0x7f83480c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:16.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.629+0000 7f8346ffd700 1 -- 172.21.15.112:0/3395512848 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83480cad20 msgr2=0x7f83480c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:16.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.629+0000 7f8346ffd700 1 --2- 172.21.15.112:0/3395512848 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83480cad20 0x7f83480c70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:16.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.629+0000 7f8346ffd700 1 -- 172.21.15.112:0/3395512848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83481598d0 msgr2=0x7f83481f22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:16.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.629+0000 7f8346ffd700 1 --2- 172.21.15.112:0/3395512848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83481598d0 0x7f83481f22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:16.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.629+0000 7f8346ffd700 1 -- 172.21.15.112:0/3395512848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c009520 con 0x7f83480d00e0 2023-09-12T16:08:16.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.629+0000 7f8347fff700 1 --2- 172.21.15.112:0/3395512848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83481598d0 0x7f83481f22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:08:16.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.629+0000 7f8346ffd700 1 --2- 172.21.15.112:0/3395512848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83480d00e0 0x7f83481f1da0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f833c009230 tx=0x7f833c00f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:16.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.629+0000 7f832ffff700 1 -- 172.21.15.112:0/3395512848 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c01b040 con 0x7f83480d00e0 2023-09-12T16:08:16.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.629+0000 7f832ffff700 1 -- 172.21.15.112:0/3395512848 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f833c004830 con 0x7f83480d00e0 2023-09-12T16:08:16.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.629+0000 7f834dbff700 1 -- 172.21.15.112:0/3395512848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8348159f50 con 0x7f83480d00e0 2023-09-12T16:08:16.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.629+0000 7f832ffff700 1 -- 172.21.15.112:0/3395512848 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c004c40 con 0x7f83480d00e0 2023-09-12T16:08:16.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.630+0000 7f834dbff700 1 -- 172.21.15.112:0/3395512848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83480c75e0 con 0x7f83480d00e0 2023-09-12T16:08:16.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.630+0000 7f834dbff700 1 -- 172.21.15.112:0/3395512848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834815a470 con 0x7f83480d00e0 2023-09-12T16:08:16.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.631+0000 7f832ffff700 1 -- 172.21.15.112:0/3395512848 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f833c005020 con 0x7f83480d00e0 2023-09-12T16:08:16.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.632+0000 7f832ffff700 1 --2- 172.21.15.112:0/3395512848 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f833406a580 0x7f833406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:16.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.632+0000 7f832ffff700 1 -- 172.21.15.112:0/3395512848 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f833c08a8c0 con 0x7f83480d00e0 2023-09-12T16:08:16.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.632+0000 7f83477fe700 1 --2- 172.21.15.112:0/3395512848 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f833406a580 0x7f833406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:16.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.633+0000 7f83477fe700 1 --2- 172.21.15.112:0/3395512848 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f833406a580 0x7f833406ca40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8348157810 tx=0x7f8338009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:16.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.636+0000 7f832ffff700 1 -- 172.21.15.112:0/3395512848 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f834815a470 con 0x7f83480d00e0 2023-09-12T16:08:16.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.832+0000 7f834dbff700 1 -- 172.21.15.112:0/3395512848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f834815a470 con 0x7f83480d00e0 2023-09-12T16:08:16.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.833+0000 7f832ffff700 1 -- 172.21.15.112:0/3395512848 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f834815a470 con 0x7f83480d00e0 2023-09-12T16:08:16.833 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-09-12T16:08:16.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.835+0000 7f834dbff700 1 -- 172.21.15.112:0/3395512848 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f833406a580 msgr2=0x7f833406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:16.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.835+0000 7f834dbff700 1 --2- 172.21.15.112:0/3395512848 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f833406a580 0x7f833406ca40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8348157810 tx=0x7f8338009040 comp rx=0 tx=0).stop 2023-09-12T16:08:16.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.835+0000 7f834dbff700 1 -- 172.21.15.112:0/3395512848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83480d00e0 msgr2=0x7f83481f1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:16.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.835+0000 7f834dbff700 1 --2- 172.21.15.112:0/3395512848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83480d00e0 0x7f83481f1da0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f833c009230 tx=0x7f833c00f7c0 comp rx=0 tx=0).stop 2023-09-12T16:08:16.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.836+0000 7f834dbff700 1 -- 172.21.15.112:0/3395512848 shutdown_connections 2023-09-12T16:08:16.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.836+0000 7f834dbff700 1 --2- 172.21.15.112:0/3395512848 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f833406a580 0x7f833406ca40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:16.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.836+0000 7f834dbff700 1 --2- 172.21.15.112:0/3395512848 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83480cad20 0x7f83480c70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:16.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.836+0000 7f834dbff700 1 --2- 172.21.15.112:0/3395512848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83481598d0 0x7f83481f22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:16.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.836+0000 7f834dbff700 1 --2- 172.21.15.112:0/3395512848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83480d00e0 0x7f83481f1da0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:16.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.836+0000 7f834dbff700 1 -- 172.21.15.112:0/3395512848 >> 172.21.15.112:0/3395512848 conn(0x7f83480cf5c0 msgr2=0x7f834806fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:16.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.836+0000 7f834dbff700 1 -- 172.21.15.112:0/3395512848 shutdown_connections 2023-09-12T16:08:16.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:16.836+0000 7f834dbff700 1 -- 172.21.15.112:0/3395512848 wait complete. 2023-09-12T16:08:16.853 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-12T16:08:17.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.059+0000 7f498d5ff700 1 -- 172.21.15.112:0/3220506184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49880cf5b0 msgr2=0x7f49880cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:17.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.059+0000 7f498d5ff700 1 --2- 172.21.15.112:0/3220506184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49880cf5b0 0x7f49880cebc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f498808bf50 tx=0x7f4970009c70 comp rx=0 tx=0).stop 2023-09-12T16:08:17.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.059+0000 7f498d5ff700 1 -- 172.21.15.112:0/3220506184 shutdown_connections 2023-09-12T16:08:17.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.059+0000 7f498d5ff700 1 --2- 172.21.15.112:0/3220506184 >> v2:172.21.15.144:3300/0 conn(0x7f498815bca0 0x7f498815cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.059+0000 7f498d5ff700 1 --2- 172.21.15.112:0/3220506184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49880cf5b0 0x7f49880cebc0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.059+0000 7f498d5ff700 1 -- 172.21.15.112:0/3220506184 >> 172.21.15.112:0/3220506184 conn(0x7f49880d17d0 msgr2=0x7f49880d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:17.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.059+0000 7f498d5ff700 1 -- 172.21.15.112:0/3220506184 shutdown_connections 2023-09-12T16:08:17.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.059+0000 7f498d5ff700 1 -- 172.21.15.112:0/3220506184 wait complete. 2023-09-12T16:08:17.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.060+0000 7f498d5ff700 1 Processor -- start 2023-09-12T16:08:17.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.061+0000 7f498d5ff700 1 -- start start 2023-09-12T16:08:17.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.061+0000 7f498d5ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49880cfdb0 0x7f4988158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:17.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.062+0000 7f498d5ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f498815bca0 0x7f49881e4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:17.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.062+0000 7f498d5ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49881e4790 0x7f49880c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:17.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.062+0000 7f498d5ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49881e5840 con 0x7f49880cfdb0 2023-09-12T16:08:17.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.062+0000 7f498d5ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49881e4c30 con 0x7f498815bca0 2023-09-12T16:08:17.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.062+0000 7f498d5ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49881e4f10 con 0x7f49881e4790 2023-09-12T16:08:17.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.062+0000 7f4986ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49880cfdb0 0x7f4988158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:17.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.062+0000 7f4986ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49880cfdb0 0x7f4988158dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60572/0 (socket says 172.21.15.112:60572) 2023-09-12T16:08:17.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.062+0000 7f4986ffd700 1 -- 172.21.15.112:0/603885972 learned_addr learned my addr 172.21.15.112:0/603885972 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:17.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.062+0000 7f49877fe700 1 --2- 172.21.15.112:0/603885972 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49881e4790 0x7f49880c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:17.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.062+0000 7f4986ffd700 1 -- 172.21.15.112:0/603885972 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49881e4790 msgr2=0x7f49880c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:17.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.062+0000 7f497ffff700 1 --2- 172.21.15.112:0/603885972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f498815bca0 0x7f49881e4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:17.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.062+0000 7f4986ffd700 1 --2- 172.21.15.112:0/603885972 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49881e4790 0x7f49880c6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.062+0000 7f4986ffd700 1 -- 172.21.15.112:0/603885972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f498815bca0 msgr2=0x7f49881e4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:17.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.062+0000 7f4986ffd700 1 --2- 172.21.15.112:0/603885972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f498815bca0 0x7f49881e4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.062+0000 7f4986ffd700 1 -- 172.21.15.112:0/603885972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49700095f0 con 0x7f49880cfdb0 2023-09-12T16:08:17.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.062+0000 7f49877fe700 1 --2- 172.21.15.112:0/603885972 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49881e4790 0x7f49880c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:17.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.062+0000 7f497ffff700 1 --2- 172.21.15.112:0/603885972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f498815bca0 0x7f49881e4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:17.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.062+0000 7f4986ffd700 1 --2- 172.21.15.112:0/603885972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49880cfdb0 0x7f4988158dc0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f497800d950 tx=0x7f497800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:17.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.063+0000 7f497f7fe700 1 -- 172.21.15.112:0/603885972 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4978009930 con 0x7f49880cfdb0 2023-09-12T16:08:17.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.063+0000 7f497f7fe700 1 -- 172.21.15.112:0/603885972 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4978009b80 con 0x7f49880cfdb0 2023-09-12T16:08:17.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.063+0000 7f498d5ff700 1 -- 172.21.15.112:0/603885972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49881e51f0 con 0x7f49880cfdb0 2023-09-12T16:08:17.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.063+0000 7f497f7fe700 1 -- 172.21.15.112:0/603885972 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4978010460 con 0x7f49880cfdb0 2023-09-12T16:08:17.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.063+0000 7f498d5ff700 1 -- 172.21.15.112:0/603885972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49880cb780 con 0x7f49880cfdb0 2023-09-12T16:08:17.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.064+0000 7f498d5ff700 1 -- 172.21.15.112:0/603885972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4988073ea0 con 0x7f49880cfdb0 2023-09-12T16:08:17.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.065+0000 7f497f7fe700 1 -- 172.21.15.112:0/603885972 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f49780105c0 con 0x7f49880cfdb0 2023-09-12T16:08:17.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.066+0000 7f497f7fe700 1 --2- 172.21.15.112:0/603885972 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f496806a580 0x7f496806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:17.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.066+0000 7f497f7fe700 1 -- 172.21.15.112:0/603885972 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f49780891c0 con 0x7f49880cfdb0 2023-09-12T16:08:17.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.067+0000 7f497ffff700 1 --2- 172.21.15.112:0/603885972 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f496806a580 0x7f496806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:17.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.067+0000 7f497ffff700 1 --2- 172.21.15.112:0/603885972 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f496806a580 0x7f496806ca40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4970000c00 tx=0x7f49700047c0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:17.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.071+0000 7f497f7fe700 1 -- 172.21.15.112:0/603885972 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f4978057e80 con 0x7f49880cfdb0 2023-09-12T16:08:17.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.265+0000 7f498d5ff700 1 -- 172.21.15.112:0/603885972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4988159370 con 0x7f49880cfdb0 2023-09-12T16:08:17.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.266+0000 7f497f7fe700 1 -- 172.21.15.112:0/603885972 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4978057a10 con 0x7f49880cfdb0 2023-09-12T16:08:17.266 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T16:08:17.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.268+0000 7f498d5ff700 1 -- 172.21.15.112:0/603885972 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f496806a580 msgr2=0x7f496806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:17.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.268+0000 7f498d5ff700 1 --2- 172.21.15.112:0/603885972 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f496806a580 0x7f496806ca40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4970000c00 tx=0x7f49700047c0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.268+0000 7f498d5ff700 1 -- 172.21.15.112:0/603885972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49880cfdb0 msgr2=0x7f4988158dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:17.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.268+0000 7f498d5ff700 1 --2- 172.21.15.112:0/603885972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49880cfdb0 0x7f4988158dc0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f497800d950 tx=0x7f497800dd10 comp rx=0 tx=0).stop 2023-09-12T16:08:17.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.268+0000 7f498d5ff700 1 -- 172.21.15.112:0/603885972 shutdown_connections 2023-09-12T16:08:17.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.268+0000 7f498d5ff700 1 --2- 172.21.15.112:0/603885972 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f496806a580 0x7f496806ca40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.268+0000 7f498d5ff700 1 --2- 172.21.15.112:0/603885972 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49881e4790 0x7f49880c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.268+0000 7f498d5ff700 1 --2- 172.21.15.112:0/603885972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49880cfdb0 0x7f4988158dc0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.268+0000 7f498d5ff700 1 --2- 172.21.15.112:0/603885972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f498815bca0 0x7f49881e4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.268+0000 7f498d5ff700 1 -- 172.21.15.112:0/603885972 >> 172.21.15.112:0/603885972 conn(0x7f49880d17d0 msgr2=0x7f49880afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:17.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.268+0000 7f498d5ff700 1 -- 172.21.15.112:0/603885972 shutdown_connections 2023-09-12T16:08:17.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.268+0000 7f498d5ff700 1 -- 172.21.15.112:0/603885972 wait complete. 2023-09-12T16:08:17.286 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-12T16:08:17.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.485+0000 7f809e7ff700 1 -- 172.21.15.112:0/1394374526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80980cdfb0 msgr2=0x7f80980d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:17.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.485+0000 7f809e7ff700 1 --2- 172.21.15.112:0/1394374526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80980cdfb0 0x7f80980d03c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f80980cf400 tx=0x7f808c009ba0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.485+0000 7f809e7ff700 1 -- 172.21.15.112:0/1394374526 shutdown_connections 2023-09-12T16:08:17.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.485+0000 7f809e7ff700 1 --2- 172.21.15.112:0/1394374526 >> v2:172.21.15.144:3300/0 conn(0x7f809815f480 0x7f80980cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.485+0000 7f809e7ff700 1 --2- 172.21.15.112:0/1394374526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80980cdfb0 0x7f80980d03c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.485+0000 7f809e7ff700 1 -- 172.21.15.112:0/1394374526 >> 172.21.15.112:0/1394374526 conn(0x7f80980d1930 msgr2=0x7f80980d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:17.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.485+0000 7f809e7ff700 1 -- 172.21.15.112:0/1394374526 shutdown_connections 2023-09-12T16:08:17.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.485+0000 7f809e7ff700 1 -- 172.21.15.112:0/1394374526 wait complete. 2023-09-12T16:08:17.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.487+0000 7f809e7ff700 1 Processor -- start 2023-09-12T16:08:17.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.487+0000 7f809e7ff700 1 -- start start 2023-09-12T16:08:17.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.488+0000 7f809e7ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f80980b28f0 0x7f809815b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:17.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.488+0000 7f809e7ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80980cdfb0 0x7f80980cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:17.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.488+0000 7f809e7ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f809815f480 0x7f80980cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:17.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.488+0000 7f809e7ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80980c8ed0 con 0x7f80980cdfb0 2023-09-12T16:08:17.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.488+0000 7f809e7ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809809e7d0 con 0x7f809815f480 2023-09-12T16:08:17.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.488+0000 7f809e7ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809815bd30 con 0x7f80980b28f0 2023-09-12T16:08:17.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.488+0000 7f80977fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80980cdfb0 0x7f80980cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:17.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.488+0000 7f80977fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80980cdfb0 0x7f80980cb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60590/0 (socket says 172.21.15.112:60590) 2023-09-12T16:08:17.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.488+0000 7f80977fe700 1 -- 172.21.15.112:0/907791843 learned_addr learned my addr 172.21.15.112:0/907791843 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:17.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.488+0000 7f8097fff700 1 --2- 172.21.15.112:0/907791843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f80980b28f0 0x7f809815b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:17.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.488+0000 7f809cd9c700 1 --2- 172.21.15.112:0/907791843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f809815f480 0x7f80980cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:17.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.488+0000 7f80977fe700 1 -- 172.21.15.112:0/907791843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f80980b28f0 msgr2=0x7f809815b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:17.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.488+0000 7f80977fe700 1 --2- 172.21.15.112:0/907791843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f80980b28f0 0x7f809815b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.488+0000 7f80977fe700 1 -- 172.21.15.112:0/907791843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f809815f480 msgr2=0x7f80980cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:17.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.488+0000 7f80977fe700 1 --2- 172.21.15.112:0/907791843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f809815f480 0x7f80980cb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.488+0000 7f80977fe700 1 -- 172.21.15.112:0/907791843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c009520 con 0x7f80980cdfb0 2023-09-12T16:08:17.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.488+0000 7f809cd9c700 1 --2- 172.21.15.112:0/907791843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f809815f480 0x7f80980cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:17.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.489+0000 7f80977fe700 1 --2- 172.21.15.112:0/907791843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80980cdfb0 0x7f80980cb210 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f808c009ef0 tx=0x7f808c00f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:17.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.489+0000 7f8094ff9700 1 -- 172.21.15.112:0/907791843 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c00fca0 con 0x7f80980cdfb0 2023-09-12T16:08:17.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.489+0000 7f8094ff9700 1 -- 172.21.15.112:0/907791843 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f808c004830 con 0x7f80980cdfb0 2023-09-12T16:08:17.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.489+0000 7f809e7ff700 1 -- 172.21.15.112:0/907791843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80980af1f0 con 0x7f80980cdfb0 2023-09-12T16:08:17.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.489+0000 7f8094ff9700 1 -- 172.21.15.112:0/907791843 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c004c40 con 0x7f80980cdfb0 2023-09-12T16:08:17.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.489+0000 7f809e7ff700 1 -- 172.21.15.112:0/907791843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80980c8af0 con 0x7f80980cdfb0 2023-09-12T16:08:17.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.490+0000 7f809e7ff700 1 -- 172.21.15.112:0/907791843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80980af710 con 0x7f80980cdfb0 2023-09-12T16:08:17.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.491+0000 7f8094ff9700 1 -- 172.21.15.112:0/907791843 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f808c004da0 con 0x7f80980cdfb0 2023-09-12T16:08:17.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.492+0000 7f8094ff9700 1 --2- 172.21.15.112:0/907791843 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f808406a580 0x7f808406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:17.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.492+0000 7f8094ff9700 1 -- 172.21.15.112:0/907791843 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f808c08a800 con 0x7f80980cdfb0 2023-09-12T16:08:17.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.492+0000 7f8097fff700 1 --2- 172.21.15.112:0/907791843 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f808406a580 0x7f808406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:17.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.493+0000 7f8097fff700 1 --2- 172.21.15.112:0/907791843 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f808406a580 0x7f808406ca40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8088009c20 tx=0x7f80880091e0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:17.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.496+0000 7f8094ff9700 1 -- 172.21.15.112:0/907791843 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f80980af710 con 0x7f80980cdfb0 2023-09-12T16:08:17.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.734+0000 7f809e7ff700 1 -- 172.21.15.112:0/907791843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80980af710 con 0x7f80980cdfb0 2023-09-12T16:08:17.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.735+0000 7f8094ff9700 1 -- 172.21.15.112:0/907791843 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f80980af710 con 0x7f80980cdfb0 2023-09-12T16:08:17.735 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:17.736 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3995117138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3995117138},{"type":"v1","addr":"172.21.15.112:6836","nonce":3995117138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3233826602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3233826602},{"type":"v1","addr":"172.21.15.112:6837","nonce":3233826602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1854265710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1854265710},{"type":"v1","addr":"172.21.15.144:6834","nonce":1854265710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-12T16:06:59.697334+0000","modified":"2023-09-12T16:07:20.393475+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4396":{"gid":4396,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/2785398652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2785398652},{"type":"v1","addr":"172.21.15.144:6835","nonce":2785398652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-12T16:08:17.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.737+0000 7f809e7ff700 1 -- 172.21.15.112:0/907791843 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f808406a580 msgr2=0x7f808406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:17.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.737+0000 7f809e7ff700 1 --2- 172.21.15.112:0/907791843 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f808406a580 0x7f808406ca40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8088009c20 tx=0x7f80880091e0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.737+0000 7f809e7ff700 1 -- 172.21.15.112:0/907791843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80980cdfb0 msgr2=0x7f80980cb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:17.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.737+0000 7f809e7ff700 1 --2- 172.21.15.112:0/907791843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80980cdfb0 0x7f80980cb210 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f808c009ef0 tx=0x7f808c00f7c0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.738+0000 7f809e7ff700 1 -- 172.21.15.112:0/907791843 shutdown_connections 2023-09-12T16:08:17.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.738+0000 7f809e7ff700 1 --2- 172.21.15.112:0/907791843 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f808406a580 0x7f808406ca40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.738+0000 7f809e7ff700 1 --2- 172.21.15.112:0/907791843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f80980b28f0 0x7f809815b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.738+0000 7f809e7ff700 1 --2- 172.21.15.112:0/907791843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f809815f480 0x7f80980cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.738+0000 7f809e7ff700 1 --2- 172.21.15.112:0/907791843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80980cdfb0 0x7f80980cb210 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.738+0000 7f809e7ff700 1 -- 172.21.15.112:0/907791843 >> 172.21.15.112:0/907791843 conn(0x7f80980d1930 msgr2=0x7f809806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:17.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.738+0000 7f809e7ff700 1 -- 172.21.15.112:0/907791843 shutdown_connections 2023-09-12T16:08:17.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.738+0000 7f809e7ff700 1 -- 172.21.15.112:0/907791843 wait complete. 2023-09-12T16:08:17.740 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 9 2023-09-12T16:08:17.756 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:08:17.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.955+0000 7fb9f15ff700 1 -- 172.21.15.112:0/1286357284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec0cdb50 msgr2=0x7fb9ec0cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:17.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.955+0000 7fb9f15ff700 1 --2- 172.21.15.112:0/1286357284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec0cdb50 0x7fb9ec0cb4b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00098c0 tx=0x7fb9e0009bd0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.955+0000 7fb9f15ff700 1 -- 172.21.15.112:0/1286357284 shutdown_connections 2023-09-12T16:08:17.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.955+0000 7fb9f15ff700 1 --2- 172.21.15.112:0/1286357284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec0cdb50 0x7fb9ec0cb4b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.955+0000 7fb9f15ff700 1 -- 172.21.15.112:0/1286357284 >> 172.21.15.112:0/1286357284 conn(0x7fb9ec06a650 msgr2=0x7fb9ec06c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:17.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.955+0000 7fb9f15ff700 1 -- 172.21.15.112:0/1286357284 shutdown_connections 2023-09-12T16:08:17.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.955+0000 7fb9f15ff700 1 -- 172.21.15.112:0/1286357284 wait complete. 2023-09-12T16:08:17.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.957+0000 7fb9f15ff700 1 Processor -- start 2023-09-12T16:08:17.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.957+0000 7fb9f15ff700 1 -- start start 2023-09-12T16:08:17.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.958+0000 7fb9f15ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9ec0cb9f0 0x7fb9ec1e6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:17.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.958+0000 7fb9f15ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9ec0cdb50 0x7fb9ec1f19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:17.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.958+0000 7fb9f15ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec15bac0 0x7fb9ec1e40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:17.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.958+0000 7fb9f15ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec1f1f10 con 0x7fb9ec15bac0 2023-09-12T16:08:17.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.958+0000 7fb9f15ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec0c2160 con 0x7fb9ec0cdb50 2023-09-12T16:08:17.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.958+0000 7fb9f15ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec15ea40 con 0x7fb9ec0cb9f0 2023-09-12T16:08:17.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.958+0000 7fb9eb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec15bac0 0x7fb9ec1e40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:17.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.958+0000 7fb9ea7fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9ec0cdb50 0x7fb9ec1f19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:17.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.958+0000 7fb9eb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec15bac0 0x7fb9ec1e40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60606/0 (socket says 172.21.15.112:60606) 2023-09-12T16:08:17.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.958+0000 7fb9eaffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9ec0cb9f0 0x7fb9ec1e6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:17.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.958+0000 7fb9eb7fe700 1 -- 172.21.15.112:0/3700306145 learned_addr learned my addr 172.21.15.112:0/3700306145 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:17.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.959+0000 7fb9eb7fe700 1 -- 172.21.15.112:0/3700306145 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9ec0cb9f0 msgr2=0x7fb9ec1e6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:17.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.959+0000 7fb9eb7fe700 1 --2- 172.21.15.112:0/3700306145 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9ec0cb9f0 0x7fb9ec1e6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.959+0000 7fb9eb7fe700 1 -- 172.21.15.112:0/3700306145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9ec0cdb50 msgr2=0x7fb9ec1f19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:17.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.959+0000 7fb9eb7fe700 1 --2- 172.21.15.112:0/3700306145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9ec0cdb50 0x7fb9ec1f19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:17.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.959+0000 7fb9eb7fe700 1 -- 172.21.15.112:0/3700306145 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e0009520 con 0x7fb9ec15bac0 2023-09-12T16:08:17.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.959+0000 7fb9eb7fe700 1 --2- 172.21.15.112:0/3700306145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec15bac0 0x7fb9ec1e40e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400cc50 tx=0x7fb9e400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:17.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.959+0000 7fb9d37fe700 1 -- 172.21.15.112:0/3700306145 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4003c00 con 0x7fb9ec15bac0 2023-09-12T16:08:17.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.959+0000 7fb9d37fe700 1 -- 172.21.15.112:0/3700306145 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb9e4003d60 con 0x7fb9ec15bac0 2023-09-12T16:08:17.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.959+0000 7fb9f15ff700 1 -- 172.21.15.112:0/3700306145 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ec0c1830 con 0x7fb9ec15bac0 2023-09-12T16:08:17.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.959+0000 7fb9d37fe700 1 -- 172.21.15.112:0/3700306145 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e400aad0 con 0x7fb9ec15bac0 2023-09-12T16:08:17.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.959+0000 7fb9f15ff700 1 -- 172.21.15.112:0/3700306145 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ec0c1df0 con 0x7fb9ec15bac0 2023-09-12T16:08:17.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.960+0000 7fb9f15ff700 1 -- 172.21.15.112:0/3700306145 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9ec0c2310 con 0x7fb9ec15bac0 2023-09-12T16:08:17.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.961+0000 7fb9d37fe700 1 -- 172.21.15.112:0/3700306145 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fb9e400ac30 con 0x7fb9ec15bac0 2023-09-12T16:08:17.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.962+0000 7fb9d37fe700 1 --2- 172.21.15.112:0/3700306145 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb9d806a580 0x7fb9d806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:17.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.962+0000 7fb9d37fe700 1 -- 172.21.15.112:0/3700306145 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb9e4088fe0 con 0x7fb9ec15bac0 2023-09-12T16:08:17.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.963+0000 7fb9eaffd700 1 --2- 172.21.15.112:0/3700306145 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb9d806a580 0x7fb9d806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:17.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.963+0000 7fb9eaffd700 1 --2- 172.21.15.112:0/3700306145 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb9d806a580 0x7fb9d806ca40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc004740 tx=0x7fb9dc007f40 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:17.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:17.967+0000 7fb9d37fe700 1 -- 172.21.15.112:0/3700306145 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb9ec0c2310 con 0x7fb9ec15bac0 2023-09-12T16:08:18.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.165+0000 7fb9f15ff700 1 -- 172.21.15.112:0/3700306145 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9ec0c22d0 con 0x7fb9ec15bac0 2023-09-12T16:08:18.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.166+0000 7fb9d37fe700 1 -- 172.21.15.112:0/3700306145 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18816 (secure 0 0 0) 0x7fb9e40540a0 con 0x7fb9ec15bac0 2023-09-12T16:08:18.167 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:18.167 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:44.445226+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:08:18.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.168+0000 7fb9f15ff700 1 -- 172.21.15.112:0/3700306145 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb9d806a580 msgr2=0x7fb9d806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:18.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.168+0000 7fb9f15ff700 1 --2- 172.21.15.112:0/3700306145 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb9d806a580 0x7fb9d806ca40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc004740 tx=0x7fb9dc007f40 comp rx=0 tx=0).stop 2023-09-12T16:08:18.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.168+0000 7fb9f15ff700 1 -- 172.21.15.112:0/3700306145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec15bac0 msgr2=0x7fb9ec1e40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:18.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.169+0000 7fb9f15ff700 1 --2- 172.21.15.112:0/3700306145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec15bac0 0x7fb9ec1e40e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400cc50 tx=0x7fb9e400cf60 comp rx=0 tx=0).stop 2023-09-12T16:08:18.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.169+0000 7fb9f15ff700 1 -- 172.21.15.112:0/3700306145 shutdown_connections 2023-09-12T16:08:18.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.169+0000 7fb9f15ff700 1 --2- 172.21.15.112:0/3700306145 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb9d806a580 0x7fb9d806ca40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:18.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.169+0000 7fb9f15ff700 1 --2- 172.21.15.112:0/3700306145 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9ec0cb9f0 0x7fb9ec1e6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:18.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.169+0000 7fb9f15ff700 1 --2- 172.21.15.112:0/3700306145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec15bac0 0x7fb9ec1e40e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:18.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.169+0000 7fb9f15ff700 1 --2- 172.21.15.112:0/3700306145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9ec0cdb50 0x7fb9ec1f19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:18.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.169+0000 7fb9f15ff700 1 -- 172.21.15.112:0/3700306145 >> 172.21.15.112:0/3700306145 conn(0x7fb9ec06a650 msgr2=0x7fb9ec070f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:18.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.169+0000 7fb9f15ff700 1 -- 172.21.15.112:0/3700306145 shutdown_connections 2023-09-12T16:08:18.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.169+0000 7fb9f15ff700 1 -- 172.21.15.112:0/3700306145 wait complete. 2023-09-12T16:08:18.187 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-12T16:08:18.188 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-12T16:08:18.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.386+0000 7f7fe6bff700 1 -- 172.21.15.112:0/1754407562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fe00cdfb0 msgr2=0x7f7fe00cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:18.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.386+0000 7f7fe6bff700 1 --2- 172.21.15.112:0/1754407562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fe00cdfb0 0x7f7fe00cc3b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc005fd0 tx=0x7f7fcc009c70 comp rx=0 tx=0).stop 2023-09-12T16:08:18.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.386+0000 7f7fe6bff700 1 -- 172.21.15.112:0/1754407562 shutdown_connections 2023-09-12T16:08:18.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.386+0000 7f7fe6bff700 1 --2- 172.21.15.112:0/1754407562 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7fe00d0590 0x7f7fe00cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:18.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.386+0000 7f7fe6bff700 1 --2- 172.21.15.112:0/1754407562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fe00cdfb0 0x7f7fe00cc3b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:18.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.386+0000 7f7fe6bff700 1 -- 172.21.15.112:0/1754407562 >> 172.21.15.112:0/1754407562 conn(0x7f7fe00d1930 msgr2=0x7f7fe00d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:18.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.386+0000 7f7fe6bff700 1 -- 172.21.15.112:0/1754407562 shutdown_connections 2023-09-12T16:08:18.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.386+0000 7f7fe6bff700 1 -- 172.21.15.112:0/1754407562 wait complete. 2023-09-12T16:08:18.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.388+0000 7f7fe6bff700 1 Processor -- start 2023-09-12T16:08:18.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.388+0000 7f7fe6bff700 1 -- start start 2023-09-12T16:08:18.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.389+0000 7f7fe6bff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7fe00cdfb0 0x7f7fe00b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:18.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.389+0000 7f7fe6bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fe00d0590 0x7f7fe00b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:18.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.389+0000 7f7fe6bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fe015f480 0x7f7fe00afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:18.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.389+0000 7f7fe6bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe00b1f20 con 0x7f7fe00d0590 2023-09-12T16:08:18.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.389+0000 7f7fe6bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe00b10c0 con 0x7f7fe015f480 2023-09-12T16:08:18.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.389+0000 7f7fe6bff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe00b1960 con 0x7f7fe00cdfb0 2023-09-12T16:08:18.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.389+0000 7f7fdffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fe00d0590 0x7f7fe00b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:18.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.389+0000 7f7fdffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fe00d0590 0x7f7fe00b0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60626/0 (socket says 172.21.15.112:60626) 2023-09-12T16:08:18.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.389+0000 7f7fdffff700 1 -- 172.21.15.112:0/77791559 learned_addr learned my addr 172.21.15.112:0/77791559 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:18.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.389+0000 7f7fe519c700 1 --2- 172.21.15.112:0/77791559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fe015f480 0x7f7fe00afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:18.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.389+0000 7f7fe499b700 1 --2- 172.21.15.112:0/77791559 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7fe00cdfb0 0x7f7fe00b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:18.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.390+0000 7f7fdffff700 1 -- 172.21.15.112:0/77791559 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7fe00cdfb0 msgr2=0x7f7fe00b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:18.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.390+0000 7f7fdffff700 1 --2- 172.21.15.112:0/77791559 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7fe00cdfb0 0x7f7fe00b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:18.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.390+0000 7f7fdffff700 1 -- 172.21.15.112:0/77791559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fe015f480 msgr2=0x7f7fe00afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:18.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.390+0000 7f7fdffff700 1 --2- 172.21.15.112:0/77791559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fe015f480 0x7f7fe00afee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:18.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.390+0000 7f7fdffff700 1 -- 172.21.15.112:0/77791559 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc0095f0 con 0x7f7fe00d0590 2023-09-12T16:08:18.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.390+0000 7f7fe519c700 1 --2- 172.21.15.112:0/77791559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fe015f480 0x7f7fe00afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:08:18.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.390+0000 7f7fdffff700 1 --2- 172.21.15.112:0/77791559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fe00d0590 0x7f7fe00b0b80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0098e0 tx=0x7f7fcc003db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:18.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.390+0000 7f7fdd7fa700 1 -- 172.21.15.112:0/77791559 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc01d070 con 0x7f7fe00d0590 2023-09-12T16:08:18.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.390+0000 7f7fdd7fa700 1 -- 172.21.15.112:0/77791559 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7fcc004830 con 0x7f7fe00d0590 2023-09-12T16:08:18.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.390+0000 7f7fdd7fa700 1 -- 172.21.15.112:0/77791559 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc004c40 con 0x7f7fe00d0590 2023-09-12T16:08:18.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.390+0000 7f7fe6bff700 1 -- 172.21.15.112:0/77791559 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe00b2ba0 con 0x7f7fe00d0590 2023-09-12T16:08:18.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.390+0000 7f7fe6bff700 1 -- 172.21.15.112:0/77791559 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe00af6e0 con 0x7f7fe00d0590 2023-09-12T16:08:18.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.391+0000 7f7fe6bff700 1 -- 172.21.15.112:0/77791559 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe004e300 con 0x7f7fe00d0590 2023-09-12T16:08:18.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.392+0000 7f7fdd7fa700 1 -- 172.21.15.112:0/77791559 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f7fcc00b820 con 0x7f7fe00d0590 2023-09-12T16:08:18.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.394+0000 7f7fdd7fa700 1 --2- 172.21.15.112:0/77791559 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7fc406a580 0x7f7fc406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:18.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.394+0000 7f7fdd7fa700 1 -- 172.21.15.112:0/77791559 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f7fcc08a510 con 0x7f7fe00d0590 2023-09-12T16:08:18.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.394+0000 7f7fe499b700 1 --2- 172.21.15.112:0/77791559 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7fc406a580 0x7f7fc406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:18.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.395+0000 7f7fe499b700 1 --2- 172.21.15.112:0/77791559 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7fc406a580 0x7f7fc406ca40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4000fb0 tx=0x7f7fd4009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:18.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.398+0000 7f7fdd7fa700 1 -- 172.21.15.112:0/77791559 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f7fcc055620 con 0x7f7fe00d0590 2023-09-12T16:08:18.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.635+0000 7f7fe6bff700 1 -- 172.21.15.112:0/77791559 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fe00b4300 con 0x7f7fe00d0590 2023-09-12T16:08:18.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.635+0000 7f7fdd7fa700 1 -- 172.21.15.112:0/77791559 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f7fcc058c40 con 0x7f7fe00d0590 2023-09-12T16:08:18.636 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:18.636 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3995117138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3995117138},{"type":"v1","addr":"172.21.15.112:6836","nonce":3995117138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3233826602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3233826602},{"type":"v1","addr":"172.21.15.112:6837","nonce":3233826602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1854265710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1854265710},{"type":"v1","addr":"172.21.15.144:6834","nonce":1854265710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-12T16:06:59.697334+0000","modified":"2023-09-12T16:07:20.393475+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4396":{"gid":4396,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/2785398652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2785398652},{"type":"v1","addr":"172.21.15.144:6835","nonce":2785398652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-12T16:08:18.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.637+0000 7f7fe6bff700 1 -- 172.21.15.112:0/77791559 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7fc406a580 msgr2=0x7f7fc406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:18.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.637+0000 7f7fe6bff700 1 --2- 172.21.15.112:0/77791559 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7fc406a580 0x7f7fc406ca40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4000fb0 tx=0x7f7fd4009040 comp rx=0 tx=0).stop 2023-09-12T16:08:18.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.637+0000 7f7fe6bff700 1 -- 172.21.15.112:0/77791559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fe00d0590 msgr2=0x7f7fe00b0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:18.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.637+0000 7f7fe6bff700 1 --2- 172.21.15.112:0/77791559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fe00d0590 0x7f7fe00b0b80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0098e0 tx=0x7f7fcc003db0 comp rx=0 tx=0).stop 2023-09-12T16:08:18.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.638+0000 7f7fe6bff700 1 -- 172.21.15.112:0/77791559 shutdown_connections 2023-09-12T16:08:18.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.638+0000 7f7fe6bff700 1 --2- 172.21.15.112:0/77791559 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7fc406a580 0x7f7fc406ca40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:18.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.638+0000 7f7fe6bff700 1 --2- 172.21.15.112:0/77791559 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7fe00cdfb0 0x7f7fe00b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:18.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.638+0000 7f7fe6bff700 1 --2- 172.21.15.112:0/77791559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fe015f480 0x7f7fe00afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:18.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.638+0000 7f7fe6bff700 1 --2- 172.21.15.112:0/77791559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fe00d0590 0x7f7fe00b0b80 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:18.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.638+0000 7f7fe6bff700 1 -- 172.21.15.112:0/77791559 >> 172.21.15.112:0/77791559 conn(0x7f7fe00d1930 msgr2=0x7f7fe00b6530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:18.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.638+0000 7f7fe6bff700 1 -- 172.21.15.112:0/77791559 shutdown_connections 2023-09-12T16:08:18.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.638+0000 7f7fe6bff700 1 -- 172.21.15.112:0/77791559 wait complete. 2023-09-12T16:08:18.641 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 9 2023-09-12T16:08:18.656 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-12T16:08:18.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.856+0000 7f01ff5ff700 1 -- 172.21.15.112:0/1005953821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01f80b2f70 msgr2=0x7f01f815a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:18.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.856+0000 7f01ff5ff700 1 --2- 172.21.15.112:0/1005953821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01f80b2f70 0x7f01f815a540 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f01f8070350 tx=0x7f01e8009c70 comp rx=0 tx=0).stop 2023-09-12T16:08:18.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.856+0000 7f01ff5ff700 1 -- 172.21.15.112:0/1005953821 shutdown_connections 2023-09-12T16:08:18.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.856+0000 7f01ff5ff700 1 --2- 172.21.15.112:0/1005953821 >> v2:172.21.15.144:3300/0 conn(0x7f01f8070be0 0x7f01f815d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:18.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.856+0000 7f01ff5ff700 1 --2- 172.21.15.112:0/1005953821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01f80b2f70 0x7f01f815a540 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:18.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.856+0000 7f01ff5ff700 1 -- 172.21.15.112:0/1005953821 >> 172.21.15.112:0/1005953821 conn(0x7f01f806a650 msgr2=0x7f01f806c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:18.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.856+0000 7f01ff5ff700 1 -- 172.21.15.112:0/1005953821 shutdown_connections 2023-09-12T16:08:18.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.856+0000 7f01ff5ff700 1 -- 172.21.15.112:0/1005953821 wait complete. 2023-09-12T16:08:18.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.858+0000 7f01ff5ff700 1 Processor -- start 2023-09-12T16:08:18.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.859+0000 7f01ff5ff700 1 -- start start 2023-09-12T16:08:18.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.860+0000 7f01ff5ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f01f8070be0 0x7f01f80c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:18.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.860+0000 7f01ff5ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01f80b2f70 0x7f01f8150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:18.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.860+0000 7f01ff5ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01f815aa80 0x7f01f80c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:18.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.860+0000 7f01ff5ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f80afab0 con 0x7f01f80b2f70 2023-09-12T16:08:18.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.860+0000 7f01ff5ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f80b1b60 con 0x7f01f815aa80 2023-09-12T16:08:18.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.860+0000 7f01ff5ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f80afd50 con 0x7f01f8070be0 2023-09-12T16:08:18.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.860+0000 7f01fcb9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01f80b2f70 0x7f01f8150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:18.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.860+0000 7f01fcb9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01f80b2f70 0x7f01f8150f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60644/0 (socket says 172.21.15.112:60644) 2023-09-12T16:08:18.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.860+0000 7f01fcb9a700 1 -- 172.21.15.112:0/3213489924 learned_addr learned my addr 172.21.15.112:0/3213489924 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:18.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.860+0000 7f01fdb9c700 1 --2- 172.21.15.112:0/3213489924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01f815aa80 0x7f01f80c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:18.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.860+0000 7f01fd39b700 1 --2- 172.21.15.112:0/3213489924 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f01f8070be0 0x7f01f80c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:18.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.861+0000 7f01fcb9a700 1 -- 172.21.15.112:0/3213489924 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f01f8070be0 msgr2=0x7f01f80c1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:18.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.861+0000 7f01fcb9a700 1 --2- 172.21.15.112:0/3213489924 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f01f8070be0 0x7f01f80c1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:18.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.861+0000 7f01fcb9a700 1 -- 172.21.15.112:0/3213489924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01f815aa80 msgr2=0x7f01f80c2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:18.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.861+0000 7f01fcb9a700 1 --2- 172.21.15.112:0/3213489924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01f815aa80 0x7f01f80c2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:18.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.861+0000 7f01fcb9a700 1 -- 172.21.15.112:0/3213489924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e80095f0 con 0x7f01f80b2f70 2023-09-12T16:08:18.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.861+0000 7f01fdb9c700 1 --2- 172.21.15.112:0/3213489924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01f815aa80 0x7f01f80c2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:08:18.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.861+0000 7f01fcb9a700 1 --2- 172.21.15.112:0/3213489924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01f80b2f70 0x7f01f8150f40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f01e8000c00 tx=0x7f01e80050d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:18.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.861+0000 7f01edffb700 1 -- 172.21.15.112:0/3213489924 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e801d070 con 0x7f01f80b2f70 2023-09-12T16:08:18.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.861+0000 7f01edffb700 1 -- 172.21.15.112:0/3213489924 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f01e8004260 con 0x7f01f80b2f70 2023-09-12T16:08:18.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.861+0000 7f01ff5ff700 1 -- 172.21.15.112:0/3213489924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f80b1e40 con 0x7f01f80b2f70 2023-09-12T16:08:18.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.861+0000 7f01edffb700 1 -- 172.21.15.112:0/3213489924 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e800b760 con 0x7f01f80b2f70 2023-09-12T16:08:18.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.861+0000 7f01ff5ff700 1 -- 172.21.15.112:0/3213489924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f80c4580 con 0x7f01f80b2f70 2023-09-12T16:08:18.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.862+0000 7f01ff5ff700 1 -- 172.21.15.112:0/3213489924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f80b00c0 con 0x7f01f80b2f70 2023-09-12T16:08:18.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.863+0000 7f01edffb700 1 -- 172.21.15.112:0/3213489924 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f01e800b8c0 con 0x7f01f80b2f70 2023-09-12T16:08:18.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.864+0000 7f01edffb700 1 --2- 172.21.15.112:0/3213489924 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f01dc06a580 0x7f01dc06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:18.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.864+0000 7f01edffb700 1 -- 172.21.15.112:0/3213489924 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f01e808a4a0 con 0x7f01f80b2f70 2023-09-12T16:08:18.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.864+0000 7f01fd39b700 1 --2- 172.21.15.112:0/3213489924 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f01dc06a580 0x7f01dc06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:18.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.865+0000 7f01fd39b700 1 --2- 172.21.15.112:0/3213489924 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f01dc06a580 0x7f01dc06ca40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f01f4005950 tx=0x7f01f40058e0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:18.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:18.868+0000 7f01edffb700 1 -- 172.21.15.112:0/3213489924 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f01e8055630 con 0x7f01f80b2f70 2023-09-12T16:08:19.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.113+0000 7f01ff5ff700 1 -- 172.21.15.112:0/3213489924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01f8072b20 con 0x7f01f80b2f70 2023-09-12T16:08:19.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.113+0000 7f01edffb700 1 -- 172.21.15.112:0/3213489924 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f01e805de60 con 0x7f01f80b2f70 2023-09-12T16:08:19.114 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:19.114 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3995117138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3995117138},{"type":"v1","addr":"172.21.15.112:6836","nonce":3995117138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3233826602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3233826602},{"type":"v1","addr":"172.21.15.112:6837","nonce":3233826602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1854265710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1854265710},{"type":"v1","addr":"172.21.15.144:6834","nonce":1854265710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-12T16:06:59.697334+0000","modified":"2023-09-12T16:07:20.393475+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4396":{"gid":4396,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/2785398652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2785398652},{"type":"v1","addr":"172.21.15.144:6835","nonce":2785398652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-12T16:08:19.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.116+0000 7f01ff5ff700 1 -- 172.21.15.112:0/3213489924 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f01dc06a580 msgr2=0x7f01dc06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:19.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.116+0000 7f01ff5ff700 1 --2- 172.21.15.112:0/3213489924 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f01dc06a580 0x7f01dc06ca40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f01f4005950 tx=0x7f01f40058e0 comp rx=0 tx=0).stop 2023-09-12T16:08:19.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.116+0000 7f01ff5ff700 1 -- 172.21.15.112:0/3213489924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01f80b2f70 msgr2=0x7f01f8150f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:19.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.116+0000 7f01ff5ff700 1 --2- 172.21.15.112:0/3213489924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01f80b2f70 0x7f01f8150f40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f01e8000c00 tx=0x7f01e80050d0 comp rx=0 tx=0).stop 2023-09-12T16:08:19.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.116+0000 7f01ff5ff700 1 -- 172.21.15.112:0/3213489924 shutdown_connections 2023-09-12T16:08:19.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.116+0000 7f01ff5ff700 1 --2- 172.21.15.112:0/3213489924 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f01dc06a580 0x7f01dc06ca40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:19.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.116+0000 7f01ff5ff700 1 --2- 172.21.15.112:0/3213489924 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f01f8070be0 0x7f01f80c1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:19.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.116+0000 7f01ff5ff700 1 --2- 172.21.15.112:0/3213489924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01f815aa80 0x7f01f80c2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:19.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.116+0000 7f01ff5ff700 1 --2- 172.21.15.112:0/3213489924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01f80b2f70 0x7f01f8150f40 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:19.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.116+0000 7f01ff5ff700 1 -- 172.21.15.112:0/3213489924 >> 172.21.15.112:0/3213489924 conn(0x7f01f806a650 msgr2=0x7f01f80c7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:19.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.116+0000 7f01ff5ff700 1 -- 172.21.15.112:0/3213489924 shutdown_connections 2023-09-12T16:08:19.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.116+0000 7f01ff5ff700 1 -- 172.21.15.112:0/3213489924 wait complete. 2023-09-12T16:08:19.119 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 9 2023-09-12T16:08:19.134 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:08:19.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.335+0000 7fdfeedff700 1 -- 172.21.15.112:0/468586937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfd8003a00 msgr2=0x7fdfd8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:19.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.335+0000 7fdfeedff700 1 --2- 172.21.15.112:0/468586937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfd8003a00 0x7fdfd8003e20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc00c310 tx=0x7fdfd8005880 comp rx=0 tx=0).stop 2023-09-12T16:08:19.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.335+0000 7fdfeedff700 1 -- 172.21.15.112:0/468586937 shutdown_connections 2023-09-12T16:08:19.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.335+0000 7fdfeedff700 1 --2- 172.21.15.112:0/468586937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfd8003a00 0x7fdfd8003e20 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:19.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.335+0000 7fdfeedff700 1 -- 172.21.15.112:0/468586937 >> 172.21.15.112:0/468586937 conn(0x7fdfe809abe0 msgr2=0x7fdfe80d18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:19.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.335+0000 7fdfeedff700 1 -- 172.21.15.112:0/468586937 shutdown_connections 2023-09-12T16:08:19.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.335+0000 7fdfeedff700 1 -- 172.21.15.112:0/468586937 wait complete. 2023-09-12T16:08:19.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.337+0000 7fdfeedff700 1 Processor -- start 2023-09-12T16:08:19.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.337+0000 7fdfeedff700 1 -- start start 2023-09-12T16:08:19.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.338+0000 7fdfeedff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfd8003a00 0x7fdfe809b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:19.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.338+0000 7fdfeedff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdfe80c9ee0 0x7fdfe809cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:19.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.338+0000 7fdfeedff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfe80ca870 0x7fdfe815aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:19.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.338+0000 7fdfeedff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe809bca0 con 0x7fdfe80ca870 2023-09-12T16:08:19.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.338+0000 7fdfeedff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe809bf80 con 0x7fdfd8003a00 2023-09-12T16:08:19.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.338+0000 7fdfeedff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe809c260 con 0x7fdfe80c9ee0 2023-09-12T16:08:19.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.338+0000 7fdfed39c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfe80ca870 0x7fdfe815aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:19.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.338+0000 7fdfed39c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfe80ca870 0x7fdfe815aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60664/0 (socket says 172.21.15.112:60664) 2023-09-12T16:08:19.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.338+0000 7fdfed39c700 1 -- 172.21.15.112:0/2141165950 learned_addr learned my addr 172.21.15.112:0/2141165950 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:19.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.338+0000 7fdfe7fff700 1 --2- 172.21.15.112:0/2141165950 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdfe80c9ee0 0x7fdfe809cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:19.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.338+0000 7fdfecb9b700 1 --2- 172.21.15.112:0/2141165950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfd8003a00 0x7fdfe809b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:19.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.339+0000 7fdfed39c700 1 -- 172.21.15.112:0/2141165950 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdfe80c9ee0 msgr2=0x7fdfe809cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:19.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.339+0000 7fdfed39c700 1 --2- 172.21.15.112:0/2141165950 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdfe80c9ee0 0x7fdfe809cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:19.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.339+0000 7fdfed39c700 1 -- 172.21.15.112:0/2141165950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfd8003a00 msgr2=0x7fdfe809b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:19.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.339+0000 7fdfed39c700 1 --2- 172.21.15.112:0/2141165950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfd8003a00 0x7fdfe809b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:19.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.339+0000 7fdfed39c700 1 -- 172.21.15.112:0/2141165950 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe809c540 con 0x7fdfe80ca870 2023-09-12T16:08:19.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.339+0000 7fdfed39c700 1 --2- 172.21.15.112:0/2141165950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfe80ca870 0x7fdfe815aa40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fdfe808ab40 tx=0x7fdfe00018c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:19.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.339+0000 7fdfe57fa700 1 -- 172.21.15.112:0/2141165950 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0011660 con 0x7fdfe80ca870 2023-09-12T16:08:19.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.339+0000 7fdfe57fa700 1 -- 172.21.15.112:0/2141165950 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdfe00118b0 con 0x7fdfe80ca870 2023-09-12T16:08:19.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.339+0000 7fdfeedff700 1 -- 172.21.15.112:0/2141165950 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe809c820 con 0x7fdfe80ca870 2023-09-12T16:08:19.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.339+0000 7fdfe57fa700 1 -- 172.21.15.112:0/2141165950 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0011cc0 con 0x7fdfe80ca870 2023-09-12T16:08:19.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.339+0000 7fdfeedff700 1 -- 172.21.15.112:0/2141165950 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe809d280 con 0x7fdfe80ca870 2023-09-12T16:08:19.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.340+0000 7fdfeedff700 1 -- 172.21.15.112:0/2141165950 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfe804e300 con 0x7fdfe80ca870 2023-09-12T16:08:19.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.341+0000 7fdfe57fa700 1 -- 172.21.15.112:0/2141165950 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fdfe001c460 con 0x7fdfe80ca870 2023-09-12T16:08:19.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.342+0000 7fdfe57fa700 1 --2- 172.21.15.112:0/2141165950 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdfcc06a580 0x7fdfcc06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:19.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.342+0000 7fdfe57fa700 1 -- 172.21.15.112:0/2141165950 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fdfe0089660 con 0x7fdfe80ca870 2023-09-12T16:08:19.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.343+0000 7fdfecb9b700 1 --2- 172.21.15.112:0/2141165950 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdfcc06a580 0x7fdfcc06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:19.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.343+0000 7fdfecb9b700 1 --2- 172.21.15.112:0/2141165950 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdfcc06a580 0x7fdfcc06ca40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc000c00 tx=0x7fdfdc00f000 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:19.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.346+0000 7fdfe57fa700 1 -- 172.21.15.112:0/2141165950 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fdfe0054800 con 0x7fdfe80ca870 2023-09-12T16:08:19.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.543+0000 7fdfeedff700 1 -- 172.21.15.112:0/2141165950 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfe809ca60 con 0x7fdfe80ca870 2023-09-12T16:08:19.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.544+0000 7fdfe57fa700 1 -- 172.21.15.112:0/2141165950 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18816 (secure 0 0 0) 0x7fdfe00020c0 con 0x7fdfe80ca870 2023-09-12T16:08:19.545 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:19.545 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:07:44.445226+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:06:58.137223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-12T16:06:58.684034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-12T16:07:02.283459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:08:19.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.547+0000 7fdfeedff700 1 -- 172.21.15.112:0/2141165950 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdfcc06a580 msgr2=0x7fdfcc06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:19.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.547+0000 7fdfeedff700 1 --2- 172.21.15.112:0/2141165950 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdfcc06a580 0x7fdfcc06ca40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc000c00 tx=0x7fdfdc00f000 comp rx=0 tx=0).stop 2023-09-12T16:08:19.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.547+0000 7fdfeedff700 1 -- 172.21.15.112:0/2141165950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfe80ca870 msgr2=0x7fdfe815aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:19.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.547+0000 7fdfeedff700 1 --2- 172.21.15.112:0/2141165950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfe80ca870 0x7fdfe815aa40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fdfe808ab40 tx=0x7fdfe00018c0 comp rx=0 tx=0).stop 2023-09-12T16:08:19.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.547+0000 7fdfeedff700 1 -- 172.21.15.112:0/2141165950 shutdown_connections 2023-09-12T16:08:19.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.547+0000 7fdfeedff700 1 --2- 172.21.15.112:0/2141165950 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdfcc06a580 0x7fdfcc06ca40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:19.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.547+0000 7fdfeedff700 1 --2- 172.21.15.112:0/2141165950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfe80ca870 0x7fdfe815aa40 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:19.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.547+0000 7fdfeedff700 1 --2- 172.21.15.112:0/2141165950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfd8003a00 0x7fdfe809b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:19.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.547+0000 7fdfeedff700 1 --2- 172.21.15.112:0/2141165950 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdfe80c9ee0 0x7fdfe809cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:19.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.547+0000 7fdfeedff700 1 -- 172.21.15.112:0/2141165950 >> 172.21.15.112:0/2141165950 conn(0x7fdfe809abe0 msgr2=0x7fdfe80b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:19.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.547+0000 7fdfeedff700 1 -- 172.21.15.112:0/2141165950 shutdown_connections 2023-09-12T16:08:19.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.547+0000 7fdfeedff700 1 -- 172.21.15.112:0/2141165950 wait complete. 2023-09-12T16:08:19.565 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-12T16:08:19.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.766+0000 7fc5953ff700 1 -- 172.21.15.112:0/2946025922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5900cdfb0 msgr2=0x7fc5900d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:19.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.766+0000 7fc5953ff700 1 --2- 172.21.15.112:0/2946025922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5900cdfb0 0x7fc5900d03c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc578005fd0 tx=0x7fc578009c70 comp rx=0 tx=0).stop 2023-09-12T16:08:19.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.766+0000 7fc5953ff700 1 -- 172.21.15.112:0/2946025922 shutdown_connections 2023-09-12T16:08:19.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.766+0000 7fc5953ff700 1 --2- 172.21.15.112:0/2946025922 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc59015f480 0x7fc5900cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.766+0000 7fc5953ff700 1 --2- 172.21.15.112:0/2946025922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5900cdfb0 0x7fc5900d03c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.766+0000 7fc5953ff700 1 -- 172.21.15.112:0/2946025922 >> 172.21.15.112:0/2946025922 conn(0x7fc5900d1930 msgr2=0x7fc5900d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.767+0000 7fc5953ff700 1 -- 172.21.15.112:0/2946025922 shutdown_connections 2023-09-12T16:08:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.767+0000 7fc5953ff700 1 -- 172.21.15.112:0/2946025922 wait complete. 2023-09-12T16:08:19.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.768+0000 7fc5953ff700 1 Processor -- start 2023-09-12T16:08:19.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.768+0000 7fc5953ff700 1 -- start start 2023-09-12T16:08:19.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.769+0000 7fc5953ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5900b28f0 0x7fc590151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:19.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.769+0000 7fc5953ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5900cdfb0 0x7fc5900cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:19.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.769+0000 7fc5953ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc59015f480 0x7fc5900cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:19.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.769+0000 7fc5953ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5900b2360 con 0x7fc5900cdfb0 2023-09-12T16:08:19.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.769+0000 7fc5953ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5900ca080 con 0x7fc5900b28f0 2023-09-12T16:08:19.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.769+0000 7fc5953ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5900b1da0 con 0x7fc59015f480 2023-09-12T16:08:19.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.769+0000 7fc587fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5900cdfb0 0x7fc5900cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:19.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.769+0000 7fc587fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5900cdfb0 0x7fc5900cc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60672/0 (socket says 172.21.15.112:60672) 2023-09-12T16:08:19.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.769+0000 7fc587fff700 1 -- 172.21.15.112:0/271969105 learned_addr learned my addr 172.21.15.112:0/271969105 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:19.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.770+0000 7fc58effd700 1 --2- 172.21.15.112:0/271969105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5900b28f0 0x7fc590151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:19.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.770+0000 7fc58f7fe700 1 --2- 172.21.15.112:0/271969105 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc59015f480 0x7fc5900cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:19.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.770+0000 7fc587fff700 1 -- 172.21.15.112:0/271969105 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc59015f480 msgr2=0x7fc5900cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:19.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.770+0000 7fc587fff700 1 --2- 172.21.15.112:0/271969105 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc59015f480 0x7fc5900cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:19.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.770+0000 7fc587fff700 1 -- 172.21.15.112:0/271969105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5900b28f0 msgr2=0x7fc590151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:19.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.770+0000 7fc587fff700 1 --2- 172.21.15.112:0/271969105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5900b28f0 0x7fc590151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:19.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.770+0000 7fc587fff700 1 -- 172.21.15.112:0/271969105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5780095f0 con 0x7fc5900cdfb0 2023-09-12T16:08:19.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.770+0000 7fc58effd700 1 --2- 172.21.15.112:0/271969105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5900b28f0 0x7fc590151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:08:19.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.770+0000 7fc587fff700 1 --2- 172.21.15.112:0/271969105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5900cdfb0 0x7fc5900cc370 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc5780098e0 tx=0x7fc578003db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:19.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.770+0000 7fc5877fe700 1 -- 172.21.15.112:0/271969105 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57801d070 con 0x7fc5900cdfb0 2023-09-12T16:08:19.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.770+0000 7fc5877fe700 1 -- 172.21.15.112:0/271969105 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc57800b820 con 0x7fc5900cdfb0 2023-09-12T16:08:19.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.770+0000 7fc5953ff700 1 -- 172.21.15.112:0/271969105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5900b2080 con 0x7fc5900cdfb0 2023-09-12T16:08:19.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.770+0000 7fc5877fe700 1 -- 172.21.15.112:0/271969105 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57800bc10 con 0x7fc5900cdfb0 2023-09-12T16:08:19.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.770+0000 7fc5953ff700 1 -- 172.21.15.112:0/271969105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5901521f0 con 0x7fc5900cdfb0 2023-09-12T16:08:19.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.771+0000 7fc5953ff700 1 -- 172.21.15.112:0/271969105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59004e300 con 0x7fc5900cdfb0 2023-09-12T16:08:19.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.772+0000 7fc5877fe700 1 -- 172.21.15.112:0/271969105 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fc57800bd70 con 0x7fc5900cdfb0 2023-09-12T16:08:19.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.773+0000 7fc5877fe700 1 --2- 172.21.15.112:0/271969105 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc57006a580 0x7fc57006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:19.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.773+0000 7fc5877fe700 1 -- 172.21.15.112:0/271969105 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc57808a5f0 con 0x7fc5900cdfb0 2023-09-12T16:08:19.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.774+0000 7fc58effd700 1 --2- 172.21.15.112:0/271969105 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc57006a580 0x7fc57006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:19.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.774+0000 7fc58effd700 1 --2- 172.21.15.112:0/271969105 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc57006a580 0x7fc57006ca40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc580009ce0 tx=0x7fc5800091e0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:19.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:19.778+0000 7fc5877fe700 1 -- 172.21.15.112:0/271969105 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fc578055700 con 0x7fc5900cdfb0 2023-09-12T16:08:20.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.021+0000 7fc5953ff700 1 -- 172.21.15.112:0/271969105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc5900b4300 con 0x7fc5900cdfb0 2023-09-12T16:08:20.021 INFO:tasks.ceph.mon.a.smithi112.stderr:2023-09-12T16:08:20.021+0000 7f16619f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-12T16:08:20.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.023+0000 7fc5877fe700 1 -- 172.21.15.112:0/271969105 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc578058d20 con 0x7fc5900cdfb0 2023-09-12T16:08:20.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.026+0000 7fc5953ff700 1 -- 172.21.15.112:0/271969105 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc57006a580 msgr2=0x7fc57006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:20.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.026+0000 7fc5953ff700 1 --2- 172.21.15.112:0/271969105 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc57006a580 0x7fc57006ca40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc580009ce0 tx=0x7fc5800091e0 comp rx=0 tx=0).stop 2023-09-12T16:08:20.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.026+0000 7fc5953ff700 1 -- 172.21.15.112:0/271969105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5900cdfb0 msgr2=0x7fc5900cc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:20.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.026+0000 7fc5953ff700 1 --2- 172.21.15.112:0/271969105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5900cdfb0 0x7fc5900cc370 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc5780098e0 tx=0x7fc578003db0 comp rx=0 tx=0).stop 2023-09-12T16:08:20.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.027+0000 7fc5953ff700 1 -- 172.21.15.112:0/271969105 shutdown_connections 2023-09-12T16:08:20.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.027+0000 7fc5953ff700 1 --2- 172.21.15.112:0/271969105 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc57006a580 0x7fc57006ca40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:20.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.027+0000 7fc5953ff700 1 --2- 172.21.15.112:0/271969105 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc59015f480 0x7fc5900cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:20.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.027+0000 7fc5953ff700 1 --2- 172.21.15.112:0/271969105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5900b28f0 0x7fc590151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:20.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.027+0000 7fc5953ff700 1 --2- 172.21.15.112:0/271969105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5900cdfb0 0x7fc5900cc370 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:20.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.027+0000 7fc5953ff700 1 -- 172.21.15.112:0/271969105 >> 172.21.15.112:0/271969105 conn(0x7fc5900d1930 msgr2=0x7fc59015bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:20.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.027+0000 7fc5953ff700 1 -- 172.21.15.112:0/271969105 shutdown_connections 2023-09-12T16:08:20.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.027+0000 7fc5953ff700 1 -- 172.21.15.112:0/271969105 wait complete. 2023-09-12T16:08:20.029 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-12T16:08:20.038 INFO:tasks.ceph.mds.d.smithi144.stderr: -6399> 2023-09-12T16:07:06.197+0000 7f57757f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-12T16:08:20.045 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-12T16:08:20.093 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-09-12T16:08:20.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.249+0000 7fae011ff700 1 -- 172.21.15.112:0/410227691 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadfc0cdb50 msgr2=0x7fadfc0cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:20.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.249+0000 7fae011ff700 1 --2- 172.21.15.112:0/410227691 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadfc0cdb50 0x7fadfc0cb4b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fadf00098f0 tx=0x7fadf0009c00 comp rx=0 tx=0).stop 2023-09-12T16:08:20.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.249+0000 7fae011ff700 1 -- 172.21.15.112:0/410227691 shutdown_connections 2023-09-12T16:08:20.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.249+0000 7fae011ff700 1 --2- 172.21.15.112:0/410227691 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadfc0cdb50 0x7fadfc0cb4b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:20.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.249+0000 7fae011ff700 1 -- 172.21.15.112:0/410227691 >> 172.21.15.112:0/410227691 conn(0x7fadfc06a650 msgr2=0x7fadfc06c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:20.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.249+0000 7fae011ff700 1 -- 172.21.15.112:0/410227691 shutdown_connections 2023-09-12T16:08:20.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.249+0000 7fae011ff700 1 -- 172.21.15.112:0/410227691 wait complete. 2023-09-12T16:08:20.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.251+0000 7fae011ff700 1 Processor -- start 2023-09-12T16:08:20.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.252+0000 7fae011ff700 1 -- start start 2023-09-12T16:08:20.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.253+0000 7fae011ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadfc0cb9f0 0x7fadfc1e40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:20.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.253+0000 7fae011ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadfc0cdb50 0x7fadfc0ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:20.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.253+0000 7fae011ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadfc15bac0 0x7fadfc0ad950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:20.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.253+0000 7fae011ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc1e4620 con 0x7fadfc0cdb50 2023-09-12T16:08:20.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.253+0000 7fae011ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc0c5eb0 con 0x7fadfc0cb9f0 2023-09-12T16:08:20.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.253+0000 7fae011ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc0c6190 con 0x7fadfc15bac0 2023-09-12T16:08:20.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.253+0000 7fadfa59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadfc0cdb50 0x7fadfc0ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:20.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.253+0000 7fadfa59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadfc0cdb50 0x7fadfc0ad410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60686/0 (socket says 172.21.15.112:60686) 2023-09-12T16:08:20.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.253+0000 7fadfa59c700 1 -- 172.21.15.112:0/258060728 learned_addr learned my addr 172.21.15.112:0/258060728 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:20.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.253+0000 7fadfad9d700 1 --2- 172.21.15.112:0/258060728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadfc0cb9f0 0x7fadfc1e40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:20.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.253+0000 7fadfb59e700 1 --2- 172.21.15.112:0/258060728 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadfc15bac0 0x7fadfc0ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:20.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.253+0000 7fadfa59c700 1 -- 172.21.15.112:0/258060728 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadfc15bac0 msgr2=0x7fadfc0ad950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:20.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.253+0000 7fadfa59c700 1 --2- 172.21.15.112:0/258060728 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadfc15bac0 0x7fadfc0ad950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:20.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.253+0000 7fadfa59c700 1 -- 172.21.15.112:0/258060728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadfc0cb9f0 msgr2=0x7fadfc1e40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:20.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.253+0000 7fadfa59c700 1 --2- 172.21.15.112:0/258060728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadfc0cb9f0 0x7fadfc1e40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:20.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.253+0000 7fadfa59c700 1 -- 172.21.15.112:0/258060728 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf0009520 con 0x7fadfc0cdb50 2023-09-12T16:08:20.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.254+0000 7fadfa59c700 1 --2- 172.21.15.112:0/258060728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadfc0cdb50 0x7fadfc0ad410 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fadfc06e6a0 tx=0x7fadf000fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:20.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.254+0000 7fade37fe700 1 -- 172.21.15.112:0/258060728 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0025070 con 0x7fadfc0cdb50 2023-09-12T16:08:20.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.254+0000 7fade37fe700 1 -- 172.21.15.112:0/258060728 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fadf000bb20 con 0x7fadfc0cdb50 2023-09-12T16:08:20.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.254+0000 7fade37fe700 1 -- 172.21.15.112:0/258060728 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf001b040 con 0x7fadfc0cdb50 2023-09-12T16:08:20.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.254+0000 7fae011ff700 1 -- 172.21.15.112:0/258060728 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadfc0c6470 con 0x7fadfc0cdb50 2023-09-12T16:08:20.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.254+0000 7fae011ff700 1 -- 172.21.15.112:0/258060728 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadfc0c6a30 con 0x7fadfc0cdb50 2023-09-12T16:08:20.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.255+0000 7fae011ff700 1 -- 172.21.15.112:0/258060728 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadfc04e300 con 0x7fadfc0cdb50 2023-09-12T16:08:20.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.256+0000 7fade37fe700 1 -- 172.21.15.112:0/258060728 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fadf0004a90 con 0x7fadfc0cdb50 2023-09-12T16:08:20.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.257+0000 7fade37fe700 1 --2- 172.21.15.112:0/258060728 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fade806a580 0x7fade806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:20.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.257+0000 7fade37fe700 1 -- 172.21.15.112:0/258060728 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6778+0+0 (secure 0 0 0) 0x7fadf008afd0 con 0x7fadfc0cdb50 2023-09-12T16:08:20.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.257+0000 7fadfad9d700 1 --2- 172.21.15.112:0/258060728 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fade806a580 0x7fade806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:20.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.258+0000 7fadfad9d700 1 --2- 172.21.15.112:0/258060728 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fade806a580 0x7fade806ca40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fadec004740 tx=0x7fadec007e30 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:20.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.261+0000 7fade37fe700 1 -- 172.21.15.112:0/258060728 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fadf00561a0 con 0x7fadfc0cdb50 2023-09-12T16:08:20.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:20.503+0000 7fae011ff700 1 -- 172.21.15.112:0/258060728 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fadfc0c0c20 con 0x7fadfc0cdb50 2023-09-12T16:08:21.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.029+0000 7fade37fe700 1 -- 172.21.15.112:0/258060728 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fadf0005b40 con 0x7fadfc0cdb50 2023-09-12T16:08:21.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.032+0000 7fae011ff700 1 -- 172.21.15.112:0/258060728 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fade806a580 msgr2=0x7fade806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:21.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.032+0000 7fae011ff700 1 --2- 172.21.15.112:0/258060728 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fade806a580 0x7fade806ca40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fadec004740 tx=0x7fadec007e30 comp rx=0 tx=0).stop 2023-09-12T16:08:21.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.032+0000 7fae011ff700 1 -- 172.21.15.112:0/258060728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadfc0cdb50 msgr2=0x7fadfc0ad410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:21.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.032+0000 7fae011ff700 1 --2- 172.21.15.112:0/258060728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadfc0cdb50 0x7fadfc0ad410 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fadfc06e6a0 tx=0x7fadf000fee0 comp rx=0 tx=0).stop 2023-09-12T16:08:21.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.032+0000 7fae011ff700 1 -- 172.21.15.112:0/258060728 shutdown_connections 2023-09-12T16:08:21.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.032+0000 7fae011ff700 1 --2- 172.21.15.112:0/258060728 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fade806a580 0x7fade806ca40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:21.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.032+0000 7fae011ff700 1 --2- 172.21.15.112:0/258060728 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadfc15bac0 0x7fadfc0ad950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:21.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.032+0000 7fae011ff700 1 --2- 172.21.15.112:0/258060728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadfc0cb9f0 0x7fadfc1e40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:21.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.032+0000 7fae011ff700 1 --2- 172.21.15.112:0/258060728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadfc0cdb50 0x7fadfc0ad410 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:21.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.032+0000 7fae011ff700 1 -- 172.21.15.112:0/258060728 >> 172.21.15.112:0/258060728 conn(0x7fadfc06a650 msgr2=0x7fadfc071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:21.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.032+0000 7fae011ff700 1 -- 172.21.15.112:0/258060728 shutdown_connections 2023-09-12T16:08:21.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.032+0000 7fae011ff700 1 -- 172.21.15.112:0/258060728 wait complete. 2023-09-12T16:08:21.052 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-12T16:08:21.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.255+0000 7feb0c7ff700 1 -- 172.21.15.112:0/1574543274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb0415bb40 msgr2=0x7feb040d1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:21.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.255+0000 7feb0c7ff700 1 --2- 172.21.15.112:0/1574543274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb0415bb40 0x7feb040d1ed0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7feb0408a8d0 tx=0x7feb00009c70 comp rx=0 tx=0).stop 2023-09-12T16:08:21.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.255+0000 7feb0c7ff700 1 -- 172.21.15.112:0/1574543274 shutdown_connections 2023-09-12T16:08:21.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.255+0000 7feb0c7ff700 1 --2- 172.21.15.112:0/1574543274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb0415bb40 0x7feb040d1ed0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:21.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.255+0000 7feb0c7ff700 1 --2- 172.21.15.112:0/1574543274 >> v2:172.21.15.144:3300/0 conn(0x7feb040d2410 0x7feb0415f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:21.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.255+0000 7feb0c7ff700 1 -- 172.21.15.112:0/1574543274 >> 172.21.15.112:0/1574543274 conn(0x7feb0409aa90 msgr2=0x7feb040d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:21.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.255+0000 7feb0c7ff700 1 -- 172.21.15.112:0/1574543274 shutdown_connections 2023-09-12T16:08:21.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.255+0000 7feb0c7ff700 1 -- 172.21.15.112:0/1574543274 wait complete. 2023-09-12T16:08:21.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.257+0000 7feb0c7ff700 1 Processor -- start 2023-09-12T16:08:21.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.257+0000 7feb0c7ff700 1 -- start start 2023-09-12T16:08:21.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.258+0000 7feb0c7ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb040d2410 0x7feb0414f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:21.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.258+0000 7feb0c7ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb0415bb40 0x7feb040c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:21.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.258+0000 7feb0c7ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feb0415fa70 0x7feb040ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:21.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.258+0000 7feb0c7ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb040c8120 con 0x7feb040d2410 2023-09-12T16:08:21.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.258+0000 7feb0c7ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb040c85b0 con 0x7feb0415bb40 2023-09-12T16:08:21.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.258+0000 7feb0c7ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb040c7510 con 0x7feb0415fa70 2023-09-12T16:08:21.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.258+0000 7feb0a59b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb040d2410 0x7feb0414f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:21.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.258+0000 7feb0a59b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb040d2410 0x7feb0414f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60702/0 (socket says 172.21.15.112:60702) 2023-09-12T16:08:21.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.258+0000 7feb0a59b700 1 -- 172.21.15.112:0/2898204934 learned_addr learned my addr 172.21.15.112:0/2898204934 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:21.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.259+0000 7feb09d9a700 1 --2- 172.21.15.112:0/2898204934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb0415bb40 0x7feb040c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:21.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.259+0000 7feb0ad9c700 1 --2- 172.21.15.112:0/2898204934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feb0415fa70 0x7feb040ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:21.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.259+0000 7feb0a59b700 1 -- 172.21.15.112:0/2898204934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feb0415fa70 msgr2=0x7feb040ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:21.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.259+0000 7feb0a59b700 1 --2- 172.21.15.112:0/2898204934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feb0415fa70 0x7feb040ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:21.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.259+0000 7feb0a59b700 1 -- 172.21.15.112:0/2898204934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb0415bb40 msgr2=0x7feb040c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:21.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.259+0000 7feb0a59b700 1 --2- 172.21.15.112:0/2898204934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb0415bb40 0x7feb040c6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:21.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.259+0000 7feb0a59b700 1 -- 172.21.15.112:0/2898204934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb000095f0 con 0x7feb040d2410 2023-09-12T16:08:21.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.259+0000 7feb09d9a700 1 --2- 172.21.15.112:0/2898204934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb0415bb40 0x7feb040c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:08:21.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.259+0000 7feb0a59b700 1 --2- 172.21.15.112:0/2898204934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb040d2410 0x7feb0414f030 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7feb0408af50 tx=0x7feb0000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:21.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.259+0000 7feafaffd700 1 -- 172.21.15.112:0/2898204934 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0001d070 con 0x7feb040d2410 2023-09-12T16:08:21.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.259+0000 7feafaffd700 1 -- 172.21.15.112:0/2898204934 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feb00003890 con 0x7feb040d2410 2023-09-12T16:08:21.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.259+0000 7feb0c7ff700 1 -- 172.21.15.112:0/2898204934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb040cfe40 con 0x7feb040d2410 2023-09-12T16:08:21.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.259+0000 7feafaffd700 1 -- 172.21.15.112:0/2898204934 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb000045f0 con 0x7feb040d2410 2023-09-12T16:08:21.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.259+0000 7feb0c7ff700 1 -- 172.21.15.112:0/2898204934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb040c7ad0 con 0x7feb040d2410 2023-09-12T16:08:21.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.261+0000 7feb0c7ff700 1 -- 172.21.15.112:0/2898204934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb04073ea0 con 0x7feb040d2410 2023-09-12T16:08:21.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.261+0000 7feafaffd700 1 -- 172.21.15.112:0/2898204934 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7feb00003c80 con 0x7feb040d2410 2023-09-12T16:08:21.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.262+0000 7feafaffd700 1 --2- 172.21.15.112:0/2898204934 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7feae806a580 0x7feae806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:21.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.262+0000 7feafaffd700 1 -- 172.21.15.112:0/2898204934 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6778+0+0 (secure 0 0 0) 0x7feb0008a6b0 con 0x7feb040d2410 2023-09-12T16:08:21.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.262+0000 7feb09d9a700 1 --2- 172.21.15.112:0/2898204934 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7feae806a580 0x7feae806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:21.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.263+0000 7feb09d9a700 1 --2- 172.21.15.112:0/2898204934 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7feae806a580 0x7feae806ca40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feaf4005950 tx=0x7feaf40058e0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:21.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.267+0000 7feafaffd700 1 -- 172.21.15.112:0/2898204934 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7feb00055810 con 0x7feb040d2410 2023-09-12T16:08:21.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:21.466+0000 7feb0c7ff700 1 -- 172.21.15.112:0/2898204934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7feb040b3e40 con 0x7feb040d2410 2023-09-12T16:08:22.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.031+0000 7feafaffd700 1 -- 172.21.15.112:0/2898204934 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7feb00058e30 con 0x7feb040d2410 2023-09-12T16:08:22.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.035+0000 7feb0c7ff700 1 -- 172.21.15.112:0/2898204934 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7feae806a580 msgr2=0x7feae806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:22.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.035+0000 7feb0c7ff700 1 --2- 172.21.15.112:0/2898204934 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7feae806a580 0x7feae806ca40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feaf4005950 tx=0x7feaf40058e0 comp rx=0 tx=0).stop 2023-09-12T16:08:22.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.035+0000 7feb0c7ff700 1 -- 172.21.15.112:0/2898204934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb040d2410 msgr2=0x7feb0414f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:22.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.035+0000 7feb0c7ff700 1 --2- 172.21.15.112:0/2898204934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb040d2410 0x7feb0414f030 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7feb0408af50 tx=0x7feb0000be90 comp rx=0 tx=0).stop 2023-09-12T16:08:22.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.036+0000 7feb0c7ff700 1 -- 172.21.15.112:0/2898204934 shutdown_connections 2023-09-12T16:08:22.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.036+0000 7feb0c7ff700 1 --2- 172.21.15.112:0/2898204934 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7feae806a580 0x7feae806ca40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:22.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.036+0000 7feb0c7ff700 1 --2- 172.21.15.112:0/2898204934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feb0415fa70 0x7feb040ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:22.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.036+0000 7feb0c7ff700 1 --2- 172.21.15.112:0/2898204934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb040d2410 0x7feb0414f030 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:22.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.036+0000 7feb0c7ff700 1 --2- 172.21.15.112:0/2898204934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb0415bb40 0x7feb040c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:22.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.036+0000 7feb0c7ff700 1 -- 172.21.15.112:0/2898204934 >> 172.21.15.112:0/2898204934 conn(0x7feb0409aa90 msgr2=0x7feb0406c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:22.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.036+0000 7feb0c7ff700 1 -- 172.21.15.112:0/2898204934 shutdown_connections 2023-09-12T16:08:22.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.036+0000 7feb0c7ff700 1 -- 172.21.15.112:0/2898204934 wait complete. 2023-09-12T16:08:22.039 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2023-09-12T16:08:22.060 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-12T16:08:22.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.271+0000 7f3e413ff700 1 -- 172.21.15.112:0/730576216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e240051d0 msgr2=0x7f3e2400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:22.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.271+0000 7f3e413ff700 1 --2- 172.21.15.112:0/730576216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e240051d0 0x7f3e2400ba10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3e34001e10 tx=0x7f3e24005880 comp rx=0 tx=0).stop 2023-09-12T16:08:22.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.271+0000 7f3e3b7fe700 1 -- 172.21.15.112:0/730576216 reap_dead start 2023-09-12T16:08:22.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.271+0000 7f3e413ff700 1 -- 172.21.15.112:0/730576216 shutdown_connections 2023-09-12T16:08:22.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.271+0000 7f3e413ff700 1 -- 172.21.15.112:0/730576216 >> 172.21.15.112:0/730576216 conn(0x7f3e3c0d17d0 msgr2=0x7f3e3c0d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:22.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.271+0000 7f3e413ff700 1 -- 172.21.15.112:0/730576216 shutdown_connections 2023-09-12T16:08:22.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.271+0000 7f3e413ff700 1 -- 172.21.15.112:0/730576216 wait complete. 2023-09-12T16:08:22.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.273+0000 7f3e413ff700 1 Processor -- start 2023-09-12T16:08:22.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.274+0000 7f3e413ff700 1 -- start start 2023-09-12T16:08:22.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.275+0000 7f3e413ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e240051d0 0x7f3e3c152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:22.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.275+0000 7f3e413ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e3c153c10 0x7f3e3c0c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:22.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.275+0000 7f3e413ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e3c09cb00 0x7f3e3c0c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:22.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.275+0000 7f3e413ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0c6930 con 0x7f3e3c153c10 2023-09-12T16:08:22.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.275+0000 7f3e413ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0c6c10 con 0x7f3e3c09cb00 2023-09-12T16:08:22.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.275+0000 7f3e413ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c155650 con 0x7f3e240051d0 2023-09-12T16:08:22.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.275+0000 7f3e3a7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e3c153c10 0x7f3e3c0c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:22.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.275+0000 7f3e3a7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e3c153c10 0x7f3e3c0c7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60718/0 (socket says 172.21.15.112:60718) 2023-09-12T16:08:22.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.275+0000 7f3e3a7fc700 1 -- 172.21.15.112:0/3366175351 learned_addr learned my addr 172.21.15.112:0/3366175351 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:22.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.275+0000 7f3e3affd700 1 --2- 172.21.15.112:0/3366175351 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e240051d0 0x7f3e3c152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:22.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.275+0000 7f3e3b7fe700 1 --2- 172.21.15.112:0/3366175351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e3c09cb00 0x7f3e3c0c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:22.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.276+0000 7f3e3a7fc700 1 -- 172.21.15.112:0/3366175351 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e240051d0 msgr2=0x7f3e3c152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:22.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.276+0000 7f3e3a7fc700 1 --2- 172.21.15.112:0/3366175351 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e240051d0 0x7f3e3c152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:22.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.276+0000 7f3e3a7fc700 1 -- 172.21.15.112:0/3366175351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e3c09cb00 msgr2=0x7f3e3c0c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:22.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.276+0000 7f3e3a7fc700 1 --2- 172.21.15.112:0/3366175351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e3c09cb00 0x7f3e3c0c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:22.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.276+0000 7f3e3a7fc700 1 -- 172.21.15.112:0/3366175351 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c155930 con 0x7f3e3c153c10 2023-09-12T16:08:22.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.276+0000 7f3e3a7fc700 1 --2- 172.21.15.112:0/3366175351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e3c153c10 0x7f3e3c0c7060 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3e30011ae0 tx=0x7f3e30011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:22.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.276+0000 7f3e237fe700 1 -- 172.21.15.112:0/3366175351 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30004440 con 0x7f3e3c153c10 2023-09-12T16:08:22.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.276+0000 7f3e237fe700 1 -- 172.21.15.112:0/3366175351 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3e300045a0 con 0x7f3e3c153c10 2023-09-12T16:08:22.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.276+0000 7f3e413ff700 1 -- 172.21.15.112:0/3366175351 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3c155c10 con 0x7f3e3c153c10 2023-09-12T16:08:22.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.276+0000 7f3e237fe700 1 -- 172.21.15.112:0/3366175351 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3000faf0 con 0x7f3e3c153c10 2023-09-12T16:08:22.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.276+0000 7f3e413ff700 1 -- 172.21.15.112:0/3366175351 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3c153630 con 0x7f3e3c153c10 2023-09-12T16:08:22.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.277+0000 7f3e413ff700 1 -- 172.21.15.112:0/3366175351 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3c073ea0 con 0x7f3e3c153c10 2023-09-12T16:08:22.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.278+0000 7f3e237fe700 1 -- 172.21.15.112:0/3366175351 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f3e3000fc50 con 0x7f3e3c153c10 2023-09-12T16:08:22.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.279+0000 7f3e237fe700 1 --2- 172.21.15.112:0/3366175351 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3e2806a580 0x7f3e2806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:22.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.279+0000 7f3e237fe700 1 -- 172.21.15.112:0/3366175351 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6340+0+0 (secure 0 0 0) 0x7f3e30089c20 con 0x7f3e3c153c10 2023-09-12T16:08:22.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.279+0000 7f3e3affd700 1 --2- 172.21.15.112:0/3366175351 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3e2806a580 0x7f3e2806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:22.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.280+0000 7f3e3affd700 1 --2- 172.21.15.112:0/3366175351 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3e2806a580 0x7f3e2806ca40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c001ce0 tx=0x7f3e2c006040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:22.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.283+0000 7f3e237fe700 1 -- 172.21.15.112:0/3366175351 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f3e30054fb0 con 0x7f3e3c153c10 2023-09-12T16:08:22.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:22.480+0000 7f3e413ff700 1 -- 172.21.15.112:0/3366175351 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3e3c08b860 con 0x7f3e3c153c10 2023-09-12T16:08:23.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.037+0000 7f3e237fe700 1 -- 172.21.15.112:0/3366175351 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3e300585d0 con 0x7f3e3c153c10 2023-09-12T16:08:23.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.043+0000 7f3e413ff700 1 -- 172.21.15.112:0/3366175351 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3e2806a580 msgr2=0x7f3e2806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:23.045 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.043+0000 7f3e413ff700 1 --2- 172.21.15.112:0/3366175351 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3e2806a580 0x7f3e2806ca40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c001ce0 tx=0x7f3e2c006040 comp rx=0 tx=0).stop 2023-09-12T16:08:23.045 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.043+0000 7f3e413ff700 1 -- 172.21.15.112:0/3366175351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e3c153c10 msgr2=0x7f3e3c0c7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:23.045 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.043+0000 7f3e413ff700 1 --2- 172.21.15.112:0/3366175351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e3c153c10 0x7f3e3c0c7060 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3e30011ae0 tx=0x7f3e30011df0 comp rx=0 tx=0).stop 2023-09-12T16:08:23.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.044+0000 7f3e413ff700 1 -- 172.21.15.112:0/3366175351 shutdown_connections 2023-09-12T16:08:23.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.044+0000 7f3e413ff700 1 --2- 172.21.15.112:0/3366175351 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f3e2806a580 0x7f3e2806ca40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:23.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.044+0000 7f3e413ff700 1 --2- 172.21.15.112:0/3366175351 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e240051d0 0x7f3e3c152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:23.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.044+0000 7f3e413ff700 1 --2- 172.21.15.112:0/3366175351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e3c09cb00 0x7f3e3c0c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:23.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.044+0000 7f3e413ff700 1 --2- 172.21.15.112:0/3366175351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e3c153c10 0x7f3e3c0c7060 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:23.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.044+0000 7f3e413ff700 1 -- 172.21.15.112:0/3366175351 >> 172.21.15.112:0/3366175351 conn(0x7f3e3c0d17d0 msgr2=0x7f3e3c0ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:23.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.046+0000 7f3e413ff700 1 -- 172.21.15.112:0/3366175351 shutdown_connections 2023-09-12T16:08:23.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.046+0000 7f3e413ff700 1 -- 172.21.15.112:0/3366175351 wait complete. 2023-09-12T16:08:23.048 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2023-09-12T16:08:23.069 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-09-12T16:08:23.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.286+0000 7ff7c49ff700 1 -- 172.21.15.112:0/651140428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7c015bca0 msgr2=0x7ff7c015cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:23.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.286+0000 7ff7c49ff700 1 --2- 172.21.15.112:0/651140428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7c015bca0 0x7ff7c015cb90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0005fd0 tx=0x7ff7b0009c70 comp rx=0 tx=0).stop 2023-09-12T16:08:23.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.286+0000 7ff7c49ff700 1 -- 172.21.15.112:0/651140428 shutdown_connections 2023-09-12T16:08:23.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.286+0000 7ff7c49ff700 1 --2- 172.21.15.112:0/651140428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7c015bca0 0x7ff7c015cb90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:23.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.286+0000 7ff7c49ff700 1 -- 172.21.15.112:0/651140428 >> 172.21.15.112:0/651140428 conn(0x7ff7c00d17d0 msgr2=0x7ff7c00d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:23.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.286+0000 7ff7c49ff700 1 -- 172.21.15.112:0/651140428 shutdown_connections 2023-09-12T16:08:23.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.286+0000 7ff7c49ff700 1 -- 172.21.15.112:0/651140428 wait complete. 2023-09-12T16:08:23.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.287+0000 7ff7c49ff700 1 Processor -- start 2023-09-12T16:08:23.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.288+0000 7ff7c49ff700 1 -- start start 2023-09-12T16:08:23.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.288+0000 7ff7c49ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7c00cfdb0 0x7ff7c015fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:23.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.288+0000 7ff7c49ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7c015bca0 0x7ff7c0159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:23.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.288+0000 7ff7c49ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7c01f1cf0 0x7ff7c01f2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:23.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.288+0000 7ff7c49ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c015e6b0 con 0x7ff7c00cfdb0 2023-09-12T16:08:23.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.288+0000 7ff7c49ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c01602a0 con 0x7ff7c01f1cf0 2023-09-12T16:08:23.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.288+0000 7ff7c49ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c015dd10 con 0x7ff7c015bca0 2023-09-12T16:08:23.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.289+0000 7ff7be59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7c00cfdb0 0x7ff7c015fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:23.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.289+0000 7ff7be59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7c00cfdb0 0x7ff7c015fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60736/0 (socket says 172.21.15.112:60736) 2023-09-12T16:08:23.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.289+0000 7ff7be59c700 1 -- 172.21.15.112:0/723913764 learned_addr learned my addr 172.21.15.112:0/723913764 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:23.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.289+0000 7ff7b7fff700 1 --2- 172.21.15.112:0/723913764 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7c015bca0 0x7ff7c0159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:23.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.289+0000 7ff7bed9d700 1 --2- 172.21.15.112:0/723913764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7c01f1cf0 0x7ff7c01f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:23.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.289+0000 7ff7be59c700 1 -- 172.21.15.112:0/723913764 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7c015bca0 msgr2=0x7ff7c0159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:23.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.289+0000 7ff7be59c700 1 --2- 172.21.15.112:0/723913764 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7c015bca0 0x7ff7c0159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:23.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.289+0000 7ff7be59c700 1 -- 172.21.15.112:0/723913764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7c01f1cf0 msgr2=0x7ff7c01f2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:23.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.289+0000 7ff7be59c700 1 --2- 172.21.15.112:0/723913764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7c01f1cf0 0x7ff7c01f2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:23.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.289+0000 7ff7be59c700 1 -- 172.21.15.112:0/723913764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b00095f0 con 0x7ff7c00cfdb0 2023-09-12T16:08:23.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.289+0000 7ff7bed9d700 1 --2- 172.21.15.112:0/723913764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7c01f1cf0 0x7ff7c01f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:23.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.289+0000 7ff7be59c700 1 --2- 172.21.15.112:0/723913764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7c00cfdb0 0x7ff7c015fc00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff7c008a940 tx=0x7ff7b0004b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:23.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.289+0000 7ff7b6ffd700 1 -- 172.21.15.112:0/723913764 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b001c070 con 0x7ff7c00cfdb0 2023-09-12T16:08:23.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.290+0000 7ff7b6ffd700 1 -- 172.21.15.112:0/723913764 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff7b0004020 con 0x7ff7c00cfdb0 2023-09-12T16:08:23.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.290+0000 7ff7c49ff700 1 -- 172.21.15.112:0/723913764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c015dff0 con 0x7ff7c00cfdb0 2023-09-12T16:08:23.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.290+0000 7ff7b6ffd700 1 -- 172.21.15.112:0/723913764 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b00043d0 con 0x7ff7c00cfdb0 2023-09-12T16:08:23.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.290+0000 7ff7c49ff700 1 -- 172.21.15.112:0/723913764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c015ead0 con 0x7ff7c00cfdb0 2023-09-12T16:08:23.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.291+0000 7ff7c49ff700 1 -- 172.21.15.112:0/723913764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c015ecc0 con 0x7ff7c00cfdb0 2023-09-12T16:08:23.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.292+0000 7ff7b6ffd700 1 -- 172.21.15.112:0/723913764 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ff7b0005140 con 0x7ff7c00cfdb0 2023-09-12T16:08:23.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.292+0000 7ff7b6ffd700 1 --2- 172.21.15.112:0/723913764 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff7a006a580 0x7ff7a006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:23.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.293+0000 7ff7b6ffd700 1 -- 172.21.15.112:0/723913764 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7ff7b0089f40 con 0x7ff7c00cfdb0 2023-09-12T16:08:23.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.293+0000 7ff7b7fff700 1 --2- 172.21.15.112:0/723913764 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff7a006a580 0x7ff7a006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:23.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.293+0000 7ff7b7fff700 1 --2- 172.21.15.112:0/723913764 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff7a006a580 0x7ff7a006ca40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff7c015ac50 tx=0x7ff7a8009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:23.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.297+0000 7ff7b6ffd700 1 -- 172.21.15.112:0/723913764 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff7b0055460 con 0x7ff7c00cfdb0 2023-09-12T16:08:23.418 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:08:23.424 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:08:23.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:23.500+0000 7ff7c49ff700 1 -- 172.21.15.112:0/723913764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff7c0073ea0 con 0x7ff7c00cfdb0 2023-09-12T16:08:24.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.038+0000 7ff7b6ffd700 1 -- 172.21.15.112:0/723913764 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7ff7b0004530 con 0x7ff7c00cfdb0 2023-09-12T16:08:24.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.042+0000 7ff7c49ff700 1 -- 172.21.15.112:0/723913764 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff7a006a580 msgr2=0x7ff7a006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:24.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.042+0000 7ff7c49ff700 1 --2- 172.21.15.112:0/723913764 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff7a006a580 0x7ff7a006ca40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff7c015ac50 tx=0x7ff7a8009040 comp rx=0 tx=0).stop 2023-09-12T16:08:24.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.042+0000 7ff7c49ff700 1 -- 172.21.15.112:0/723913764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7c00cfdb0 msgr2=0x7ff7c015fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:24.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.042+0000 7ff7c49ff700 1 --2- 172.21.15.112:0/723913764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7c00cfdb0 0x7ff7c015fc00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff7c008a940 tx=0x7ff7b0004b10 comp rx=0 tx=0).stop 2023-09-12T16:08:24.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.042+0000 7ff7c49ff700 1 -- 172.21.15.112:0/723913764 shutdown_connections 2023-09-12T16:08:24.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.042+0000 7ff7c49ff700 1 --2- 172.21.15.112:0/723913764 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff7a006a580 0x7ff7a006ca40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:24.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.042+0000 7ff7c49ff700 1 --2- 172.21.15.112:0/723913764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7c01f1cf0 0x7ff7c01f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:24.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.042+0000 7ff7c49ff700 1 --2- 172.21.15.112:0/723913764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7c00cfdb0 0x7ff7c015fc00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:24.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.042+0000 7ff7c49ff700 1 --2- 172.21.15.112:0/723913764 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7c015bca0 0x7ff7c0159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.042+0000 7ff7c49ff700 1 -- 172.21.15.112:0/723913764 >> 172.21.15.112:0/723913764 conn(0x7ff7c00d17d0 msgr2=0x7ff7c00b70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.043+0000 7ff7c49ff700 1 -- 172.21.15.112:0/723913764 shutdown_connections 2023-09-12T16:08:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.043+0000 7ff7c49ff700 1 -- 172.21.15.112:0/723913764 wait complete. 2023-09-12T16:08:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data_ec' removed 2023-09-12T16:08:24.064 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-12T16:08:24.065 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-12T16:08:24.065 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-12T16:08:24.065 INFO:teuthology.orchestra.run:waiting for 300 2023-09-12T16:08:24.066 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-12T16:08:24.066 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-12T16:08:24.066 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-12T16:08:24.067 INFO:teuthology.orchestra.run:waiting for 300 2023-09-12T16:08:24.067 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-12T16:08:24.067 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-12T16:08:24.068 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-12T16:08:24.068 INFO:teuthology.orchestra.run:waiting for 300 2023-09-12T16:08:24.068 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-12T16:08:24.068 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-12T16:08:24.069 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-12T16:08:24.069 INFO:teuthology.orchestra.run:waiting for 300 2023-09-12T16:08:24.081 INFO:tasks.ceph.mds.a:Stopped 2023-09-12T16:08:24.081 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-12T16:08:24.082 INFO:tasks.ceph.mds.c:Stopped 2023-09-12T16:08:24.082 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-12T16:08:24.088 INFO:tasks.ceph.mds.b:Stopped 2023-09-12T16:08:24.089 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-12T16:08:24.090 INFO:tasks.ceph.mds.d:Stopped 2023-09-12T16:08:24.090 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-12T16:08:24.127 INFO:tasks.ceph.mds.a:Started 2023-09-12T16:08:24.127 DEBUG:teuthology.parallel:result is None 2023-09-12T16:08:24.130 INFO:tasks.ceph.mds.c:Started 2023-09-12T16:08:24.130 DEBUG:teuthology.parallel:result is None 2023-09-12T16:08:24.133 INFO:tasks.ceph.mds.b:Started 2023-09-12T16:08:24.133 DEBUG:teuthology.parallel:result is None 2023-09-12T16:08:24.135 INFO:tasks.ceph.mds.d:Started 2023-09-12T16:08:24.136 DEBUG:teuthology.parallel:result is None 2023-09-12T16:08:24.136 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-12T16:08:24.278 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2023-09-12T16:08:24.279 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2023-09-12T16:08:24.285 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-09-12T16:08:24.286 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-09-12T16:08:24.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.359+0000 7fca539ff700 1 -- 172.21.15.112:0/3563998363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca4c15f480 msgr2=0x7fca4c0cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:24.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.359+0000 7fca539ff700 1 --2- 172.21.15.112:0/3563998363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca4c15f480 0x7fca4c0cfe80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fca4c08baa0 tx=0x7fca48009c50 comp rx=0 tx=0).stop 2023-09-12T16:08:24.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.359+0000 7fca539ff700 1 -- 172.21.15.112:0/3563998363 shutdown_connections 2023-09-12T16:08:24.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.359+0000 7fca539ff700 1 --2- 172.21.15.112:0/3563998363 >> v2:172.21.15.144:3300/0 conn(0x7fca4c0b28f0 0x7fca4c0cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:24.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.359+0000 7fca539ff700 1 --2- 172.21.15.112:0/3563998363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca4c15f480 0x7fca4c0cfe80 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:24.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.359+0000 7fca539ff700 1 -- 172.21.15.112:0/3563998363 >> 172.21.15.112:0/3563998363 conn(0x7fca4c0d1930 msgr2=0x7fca4c0d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:24.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.359+0000 7fca539ff700 1 -- 172.21.15.112:0/3563998363 shutdown_connections 2023-09-12T16:08:24.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.359+0000 7fca539ff700 1 -- 172.21.15.112:0/3563998363 wait complete. 2023-09-12T16:08:24.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.361+0000 7fca539ff700 1 Processor -- start 2023-09-12T16:08:24.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.361+0000 7fca539ff700 1 -- start start 2023-09-12T16:08:24.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.362+0000 7fca539ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca4c0b28f0 0x7fca4c0cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:24.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.362+0000 7fca539ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca4c0cdfb0 0x7fca4c0b4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:24.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.362+0000 7fca539ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca4c15f480 0x7fca4c0b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:24.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.362+0000 7fca539ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c0b6b90 con 0x7fca4c0cdfb0 2023-09-12T16:08:24.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.362+0000 7fca539ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c09bf10 con 0x7fca4c15f480 2023-09-12T16:08:24.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.362+0000 7fca539ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c0b68b0 con 0x7fca4c0b28f0 2023-09-12T16:08:24.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.362+0000 7fca50f9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca4c0cdfb0 0x7fca4c0b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:24.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.362+0000 7fca50f9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca4c0cdfb0 0x7fca4c0b4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60778/0 (socket says 172.21.15.112:60778) 2023-09-12T16:08:24.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.362+0000 7fca50f9a700 1 -- 172.21.15.112:0/2813036347 learned_addr learned my addr 172.21.15.112:0/2813036347 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:24.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.362+0000 7fca5179b700 1 --2- 172.21.15.112:0/2813036347 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca4c0b28f0 0x7fca4c0cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:24.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.362+0000 7fca51f9c700 1 --2- 172.21.15.112:0/2813036347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca4c15f480 0x7fca4c0b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:24.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.362+0000 7fca50f9a700 1 -- 172.21.15.112:0/2813036347 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca4c0b28f0 msgr2=0x7fca4c0cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:24.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.362+0000 7fca50f9a700 1 --2- 172.21.15.112:0/2813036347 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca4c0b28f0 0x7fca4c0cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:24.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.362+0000 7fca50f9a700 1 -- 172.21.15.112:0/2813036347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca4c15f480 msgr2=0x7fca4c0b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:24.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.362+0000 7fca50f9a700 1 --2- 172.21.15.112:0/2813036347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca4c15f480 0x7fca4c0b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:24.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.362+0000 7fca50f9a700 1 -- 172.21.15.112:0/2813036347 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca48009580 con 0x7fca4c0cdfb0 2023-09-12T16:08:24.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.363+0000 7fca50f9a700 1 --2- 172.21.15.112:0/2813036347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca4c0cdfb0 0x7fca4c0b4550 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00c4e0 tx=0x7fca3c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:24.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.363+0000 7fca41ffb700 1 -- 172.21.15.112:0/2813036347 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c0052d0 con 0x7fca4c0cdfb0 2023-09-12T16:08:24.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.363+0000 7fca41ffb700 1 -- 172.21.15.112:0/2813036347 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fca3c005520 con 0x7fca4c0cdfb0 2023-09-12T16:08:24.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.363+0000 7fca41ffb700 1 -- 172.21.15.112:0/2813036347 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c0038e0 con 0x7fca4c0cdfb0 2023-09-12T16:08:24.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.363+0000 7fca539ff700 1 -- 172.21.15.112:0/2813036347 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4c09b850 con 0x7fca4c0cdfb0 2023-09-12T16:08:24.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.363+0000 7fca539ff700 1 -- 172.21.15.112:0/2813036347 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4c0cb2f0 con 0x7fca4c0cdfb0 2023-09-12T16:08:24.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.364+0000 7fca539ff700 1 -- 172.21.15.112:0/2813036347 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4c09b6b0 con 0x7fca4c0cdfb0 2023-09-12T16:08:24.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.365+0000 7fca41ffb700 1 -- 172.21.15.112:0/2813036347 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fca3c003a40 con 0x7fca4c0cdfb0 2023-09-12T16:08:24.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.366+0000 7fca41ffb700 1 --2- 172.21.15.112:0/2813036347 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fca3006a580 0x7fca3006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:24.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.366+0000 7fca41ffb700 1 -- 172.21.15.112:0/2813036347 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fca3c087e60 con 0x7fca4c0cdfb0 2023-09-12T16:08:24.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.366+0000 7fca5179b700 1 --2- 172.21.15.112:0/2813036347 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fca3006a580 0x7fca3006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:24.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.367+0000 7fca5179b700 1 --2- 172.21.15.112:0/2813036347 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fca3006a580 0x7fca3006ca40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fca48000c00 tx=0x7fca480047c0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:24.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.371+0000 7fca41ffb700 1 -- 172.21.15.112:0/2813036347 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fca4c09b6b0 con 0x7fca4c0cdfb0 2023-09-12T16:08:24.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:24.583+0000 7fca539ff700 1 -- 172.21.15.112:0/2813036347 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fca4c09b6b0 con 0x7fca4c0cdfb0 2023-09-12T16:08:25.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.057+0000 7fca41ffb700 1 -- 172.21.15.112:0/2813036347 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7fca4c09b6b0 con 0x7fca4c0cdfb0 2023-09-12T16:08:25.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.060+0000 7fca539ff700 1 -- 172.21.15.112:0/2813036347 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fca3006a580 msgr2=0x7fca3006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:25.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.060+0000 7fca539ff700 1 --2- 172.21.15.112:0/2813036347 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fca3006a580 0x7fca3006ca40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fca48000c00 tx=0x7fca480047c0 comp rx=0 tx=0).stop 2023-09-12T16:08:25.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.060+0000 7fca539ff700 1 -- 172.21.15.112:0/2813036347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca4c0cdfb0 msgr2=0x7fca4c0b4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:25.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.060+0000 7fca539ff700 1 --2- 172.21.15.112:0/2813036347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca4c0cdfb0 0x7fca4c0b4550 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00c4e0 tx=0x7fca3c00c7f0 comp rx=0 tx=0).stop 2023-09-12T16:08:25.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.061+0000 7fca539ff700 1 -- 172.21.15.112:0/2813036347 shutdown_connections 2023-09-12T16:08:25.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.061+0000 7fca539ff700 1 --2- 172.21.15.112:0/2813036347 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fca3006a580 0x7fca3006ca40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:25.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.061+0000 7fca539ff700 1 --2- 172.21.15.112:0/2813036347 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca4c0b28f0 0x7fca4c0cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:25.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.061+0000 7fca539ff700 1 --2- 172.21.15.112:0/2813036347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca4c15f480 0x7fca4c0b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:25.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.061+0000 7fca539ff700 1 --2- 172.21.15.112:0/2813036347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca4c0cdfb0 0x7fca4c0b4550 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:25.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.061+0000 7fca539ff700 1 -- 172.21.15.112:0/2813036347 >> 172.21.15.112:0/2813036347 conn(0x7fca4c0d1930 msgr2=0x7fca4c0cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:25.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.061+0000 7fca539ff700 1 -- 172.21.15.112:0/2813036347 shutdown_connections 2023-09-12T16:08:25.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.061+0000 7fca539ff700 1 -- 172.21.15.112:0/2813036347 wait complete. 2023-09-12T16:08:25.064 INFO:teuthology.orchestra.run.smithi112.stderr: removed all blocklist entries 2023-09-12T16:08:25.082 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-12T16:08:25.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.280+0000 7fedc83ff700 1 -- 172.21.15.112:0/265187315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedc00adc30 msgr2=0x7fedc00ce2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:25.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.280+0000 7fedc83ff700 1 --2- 172.21.15.112:0/265187315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedc00adc30 0x7fedc00ce2d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fedc00cf780 tx=0x7fedb800b380 comp rx=0 tx=0).stop 2023-09-12T16:08:25.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.281+0000 7fedc83ff700 1 -- 172.21.15.112:0/265187315 shutdown_connections 2023-09-12T16:08:25.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.281+0000 7fedc83ff700 1 --2- 172.21.15.112:0/265187315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedc00adc30 0x7fedc00ce2d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:25.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.281+0000 7fedc83ff700 1 --2- 172.21.15.112:0/265187315 >> v2:172.21.15.144:3300/0 conn(0x7fedc0159d80 0x7fedc00cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:25.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.281+0000 7fedc83ff700 1 -- 172.21.15.112:0/265187315 >> 172.21.15.112:0/265187315 conn(0x7fedc00cf7b0 msgr2=0x7fedc00cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:25.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.281+0000 7fedc83ff700 1 -- 172.21.15.112:0/265187315 shutdown_connections 2023-09-12T16:08:25.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.281+0000 7fedc83ff700 1 -- 172.21.15.112:0/265187315 wait complete. 2023-09-12T16:08:25.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.282+0000 7fedc83ff700 1 Processor -- start 2023-09-12T16:08:25.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.282+0000 7fedc83ff700 1 -- start start 2023-09-12T16:08:25.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.283+0000 7fedc83ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fedc00adc30 0x7fedc006c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:25.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.283+0000 7fedc83ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedc00cc880 0x7fedc00c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:25.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.283+0000 7fedc83ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedc0159d80 0x7fedc01f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:25.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.283+0000 7fedc83ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc0151740 con 0x7fedc0159d80 2023-09-12T16:08:25.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.283+0000 7fedc83ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc00c71d0 con 0x7fedc00cc880 2023-09-12T16:08:25.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.283+0000 7fedc83ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc015a570 con 0x7fedc00adc30 2023-09-12T16:08:25.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.283+0000 7fedc699c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedc0159d80 0x7fedc01f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:25.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.284+0000 7fedc699c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedc0159d80 0x7fedc01f19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60792/0 (socket says 172.21.15.112:60792) 2023-09-12T16:08:25.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.284+0000 7fedc699c700 1 -- 172.21.15.112:0/1611814010 learned_addr learned my addr 172.21.15.112:0/1611814010 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:25.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.284+0000 7fedc619b700 1 --2- 172.21.15.112:0/1611814010 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fedc00adc30 0x7fedc006c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:25.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.284+0000 7fedc599a700 1 --2- 172.21.15.112:0/1611814010 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedc00cc880 0x7fedc00c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:25.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.284+0000 7fedc699c700 1 -- 172.21.15.112:0/1611814010 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fedc00adc30 msgr2=0x7fedc006c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:25.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.284+0000 7fedc699c700 1 --2- 172.21.15.112:0/1611814010 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fedc00adc30 0x7fedc006c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:25.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.284+0000 7fedc699c700 1 -- 172.21.15.112:0/1611814010 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedc00cc880 msgr2=0x7fedc00c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:25.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.284+0000 7fedc699c700 1 --2- 172.21.15.112:0/1611814010 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedc00cc880 0x7fedc00c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:25.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.284+0000 7fedc699c700 1 -- 172.21.15.112:0/1611814010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb8009d00 con 0x7fedc0159d80 2023-09-12T16:08:25.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.284+0000 7fedc599a700 1 --2- 172.21.15.112:0/1611814010 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedc00cc880 0x7fedc00c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:08:25.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.284+0000 7fedc699c700 1 --2- 172.21.15.112:0/1611814010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedc0159d80 0x7fedc01f19c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fedb8015040 tx=0x7fedb800bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:25.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.284+0000 7fedb6ffd700 1 -- 172.21.15.112:0/1611814010 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb800e040 con 0x7fedc0159d80 2023-09-12T16:08:25.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.284+0000 7fedb6ffd700 1 -- 172.21.15.112:0/1611814010 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fedb8007b40 con 0x7fedc0159d80 2023-09-12T16:08:25.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.284+0000 7fedb6ffd700 1 -- 172.21.15.112:0/1611814010 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb8004030 con 0x7fedc0159d80 2023-09-12T16:08:25.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.284+0000 7fedc83ff700 1 -- 172.21.15.112:0/1611814010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc015a850 con 0x7fedc0159d80 2023-09-12T16:08:25.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.285+0000 7fedc83ff700 1 -- 172.21.15.112:0/1611814010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc006be20 con 0x7fedc0159d80 2023-09-12T16:08:25.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.286+0000 7fedc83ff700 1 -- 172.21.15.112:0/1611814010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc004e300 con 0x7fedc0159d80 2023-09-12T16:08:25.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.286+0000 7fedb6ffd700 1 -- 172.21.15.112:0/1611814010 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fedb8004190 con 0x7fedc0159d80 2023-09-12T16:08:25.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.287+0000 7fedb6ffd700 1 --2- 172.21.15.112:0/1611814010 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7feda406a580 0x7feda406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:25.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.287+0000 7fedb6ffd700 1 -- 172.21.15.112:0/1611814010 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fedb808a090 con 0x7fedc0159d80 2023-09-12T16:08:25.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.287+0000 7fedc619b700 1 --2- 172.21.15.112:0/1611814010 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7feda406a580 0x7feda406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:25.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.288+0000 7fedc619b700 1 --2- 172.21.15.112:0/1611814010 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7feda406a580 0x7feda406ca40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fedbc009970 tx=0x7fedbc009110 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:25.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.292+0000 7fedb6ffd700 1 -- 172.21.15.112:0/1611814010 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fedb8055810 con 0x7fedc0159d80 2023-09-12T16:08:25.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.565+0000 7fedc83ff700 1 -- 172.21.15.112:0/1611814010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fedc00c9c70 con 0x7fedc0159d80 2023-09-12T16:08:25.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.566+0000 7fedb6ffd700 1 -- 172.21.15.112:0/1611814010 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fedb8058e30 con 0x7fedc0159d80 2023-09-12T16:08:25.566 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:25.567 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-09-12T16:08:25.567 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_dump": [ 2023-09-12T16:08:25.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.567 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.a", 2023-09-12T16:08:25.567 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBkjABlcnI5IhAA4KjsiSlms0q15lYoehZrpA==", 2023-09-12T16:08:25.568 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.568 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-09-12T16:08:25.568 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-09-12T16:08:25.568 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-09-12T16:08:25.568 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-09-12T16:08:25.569 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.569 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.b", 2023-09-12T16:08:25.569 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBkjABllolFOhAAiGUCCZYXPwNOHlWOOdBmBg==", 2023-09-12T16:08:25.569 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.570 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-09-12T16:08:25.570 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-09-12T16:08:25.570 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-09-12T16:08:25.570 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-09-12T16:08:25.570 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.571 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.c", 2023-09-12T16:08:25.571 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBkjABlSEB7LhAAKj906Xw+a7p03uZdi7G/0w==", 2023-09-12T16:08:25.571 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.572 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-09-12T16:08:25.572 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-09-12T16:08:25.572 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-09-12T16:08:25.572 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-09-12T16:08:25.572 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.573 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.d", 2023-09-12T16:08:25.573 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBljABlMuxrChAAdgPVTKIGrdlkz1WX5clXRg==", 2023-09-12T16:08:25.573 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.574 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-09-12T16:08:25.574 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-09-12T16:08:25.574 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-09-12T16:08:25.574 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-09-12T16:08:25.574 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.575 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.0", 2023-09-12T16:08:25.575 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBpjABl5jhjDBAAO4mg8APpbTMqMiavi6+75Q==", 2023-09-12T16:08:25.575 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.575 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-09-12T16:08:25.576 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-09-12T16:08:25.576 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-09-12T16:08:25.576 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.577 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.1", 2023-09-12T16:08:25.577 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBsjABlfDAwERAAeOAvw+ROioCY8uTw0QuYHQ==", 2023-09-12T16:08:25.577 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.577 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-09-12T16:08:25.577 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-09-12T16:08:25.578 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-09-12T16:08:25.578 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.578 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.2", 2023-09-12T16:08:25.578 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBvjABlElx9FBAA//LK5Gz3B9uovoZa3RtdEA==", 2023-09-12T16:08:25.579 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.579 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-09-12T16:08:25.579 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-09-12T16:08:25.579 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-09-12T16:08:25.579 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.580 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.3", 2023-09-12T16:08:25.580 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQByjABlSSyeGBAAQ68qs/Xy5R/gCknRy4cmzA==", 2023-09-12T16:08:25.580 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.581 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-09-12T16:08:25.581 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-09-12T16:08:25.581 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-09-12T16:08:25.581 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.582 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.4", 2023-09-12T16:08:25.582 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQB4jABls22oMBAAIEWtvZaDd+nLjbEsBFqyjA==", 2023-09-12T16:08:25.582 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.582 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-09-12T16:08:25.583 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-09-12T16:08:25.583 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-09-12T16:08:25.583 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.583 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.5", 2023-09-12T16:08:25.584 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQB7jABl0zuoMxAArU9jOFhO+XkwBBEGXPQZkg==", 2023-09-12T16:08:25.584 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.584 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-09-12T16:08:25.584 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-09-12T16:08:25.584 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-09-12T16:08:25.584 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.585 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.6", 2023-09-12T16:08:25.585 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQB+jABlOcqZNxAA1xbcGjYt2yV3zE7vSB+Mtg==", 2023-09-12T16:08:25.585 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.586 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-09-12T16:08:25.586 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-09-12T16:08:25.586 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-09-12T16:08:25.586 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.587 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.7", 2023-09-12T16:08:25.587 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCBjABlM7oBOxAAiQm3vxPpzGFS/iihZdux2A==", 2023-09-12T16:08:25.587 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.587 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-09-12T16:08:25.587 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-09-12T16:08:25.588 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-09-12T16:08:25.588 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.588 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.0", 2023-09-12T16:08:25.589 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBljABl3NnCFBAAwqxLxKcPIqofg05riNxItA==", 2023-09-12T16:08:25.589 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.589 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-09-12T16:08:25.589 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2023-09-12T16:08:25.589 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2023-09-12T16:08:25.589 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2023-09-12T16:08:25.590 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.590 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.1", 2023-09-12T16:08:25.590 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBljABl0EDcIxAAxcXZKmXoV0YGuRy6fhqNqw==", 2023-09-12T16:08:25.591 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.591 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-09-12T16:08:25.591 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2023-09-12T16:08:25.591 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2023-09-12T16:08:25.591 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2023-09-12T16:08:25.592 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.592 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.2", 2023-09-12T16:08:25.592 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBljABlQtxGHBAAG3RVHWCbv47uaDSvO+P95g==", 2023-09-12T16:08:25.593 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.593 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-09-12T16:08:25.593 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2023-09-12T16:08:25.593 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2023-09-12T16:08:25.593 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2023-09-12T16:08:25.593 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.594 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.3", 2023-09-12T16:08:25.594 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBljABlsAtWKxAAe2kr/0FNktRRXWa7IRVXCQ==", 2023-09-12T16:08:25.594 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.595 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-09-12T16:08:25.595 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2023-09-12T16:08:25.595 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2023-09-12T16:08:25.595 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2023-09-12T16:08:25.595 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.596 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.admin", 2023-09-12T16:08:25.596 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg==", 2023-09-12T16:08:25.596 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.596 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2023-09-12T16:08:25.597 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-09-12T16:08:25.597 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-09-12T16:08:25.597 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-09-12T16:08:25.597 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.598 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-mds", 2023-09-12T16:08:25.598 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCJjABl8MseNxAAlkD9LbB4/FHlINO/r8D99A==", 2023-09-12T16:08:25.598 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.598 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-mds" 2023-09-12T16:08:25.598 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.599 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-mgr", 2023-09-12T16:08:25.599 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCJjABlMd8eNxAAJJWnujhX8hfRkiuiXGQ/og==", 2023-09-12T16:08:25.599 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.600 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-mgr" 2023-09-12T16:08:25.600 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.600 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-osd", 2023-09-12T16:08:25.600 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCJjABlnPEeNxAA19xw9dwXmf10Ta82bgDkKg==", 2023-09-12T16:08:25.601 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.601 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-osd" 2023-09-12T16:08:25.601 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.602 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-rbd", 2023-09-12T16:08:25.602 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCJjABlAgUfNxAAZXE4b2S4Mj2qg3wjL8DbxA==", 2023-09-12T16:08:25.602 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.602 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-rbd" 2023-09-12T16:08:25.602 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.603 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-09-12T16:08:25.603 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCJjABl5xQfNxAAFWNiF2dgNSVKHQvSr2UsYA==", 2023-09-12T16:08:25.603 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.604 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-09-12T16:08:25.604 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.604 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-rgw", 2023-09-12T16:08:25.604 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCJjABlrCQfNxAANoqxyz6sJ8CH+dmAJQhpkA==", 2023-09-12T16:08:25.605 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.605 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-rgw" 2023-09-12T16:08:25.605 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.605 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.x", 2023-09-12T16:08:25.606 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBkjABld3pVGhAAla9C2ULbpQGFmMOCTXS8Ew==", 2023-09-12T16:08:25.606 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.606 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2023-09-12T16:08:25.606 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2023-09-12T16:08:25.606 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-09-12T16:08:25.607 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-09-12T16:08:25.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:25.607 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.y", 2023-09-12T16:08:25.607 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBkjABl+vBDEhAA4guEAd/rB5VT70uNSD4lyQ==", 2023-09-12T16:08:25.607 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-09-12T16:08:25.608 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2023-09-12T16:08:25.608 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2023-09-12T16:08:25.608 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-09-12T16:08:25.608 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.608 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:25.609 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2023-09-12T16:08:25.609 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-09-12T16:08:25.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.568+0000 7fedc83ff700 1 -- 172.21.15.112:0/1611814010 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7feda406a580 msgr2=0x7feda406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:25.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.568+0000 7fedc83ff700 1 --2- 172.21.15.112:0/1611814010 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7feda406a580 0x7feda406ca40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fedbc009970 tx=0x7fedbc009110 comp rx=0 tx=0).stop 2023-09-12T16:08:25.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.568+0000 7fedc83ff700 1 -- 172.21.15.112:0/1611814010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedc0159d80 msgr2=0x7fedc01f19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:25.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.568+0000 7fedc83ff700 1 --2- 172.21.15.112:0/1611814010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedc0159d80 0x7fedc01f19c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fedb8015040 tx=0x7fedb800bf20 comp rx=0 tx=0).stop 2023-09-12T16:08:25.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.568+0000 7fedc83ff700 1 -- 172.21.15.112:0/1611814010 shutdown_connections 2023-09-12T16:08:25.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.568+0000 7fedc83ff700 1 --2- 172.21.15.112:0/1611814010 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7feda406a580 0x7feda406ca40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:25.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.568+0000 7fedc83ff700 1 --2- 172.21.15.112:0/1611814010 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fedc00adc30 0x7fedc006c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:25.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.568+0000 7fedc83ff700 1 --2- 172.21.15.112:0/1611814010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedc0159d80 0x7fedc01f19c0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:25.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.568+0000 7fedc83ff700 1 --2- 172.21.15.112:0/1611814010 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedc00cc880 0x7fedc00c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:25.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.568+0000 7fedc83ff700 1 -- 172.21.15.112:0/1611814010 >> 172.21.15.112:0/1611814010 conn(0x7fedc00cf7b0 msgr2=0x7fedc00b12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:25.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.568+0000 7fedc83ff700 1 -- 172.21.15.112:0/1611814010 shutdown_connections 2023-09-12T16:08:25.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.568+0000 7fedc83ff700 1 -- 172.21.15.112:0/1611814010 wait complete. 2023-09-12T16:08:25.613 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-09-12T16:08:25.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.813+0000 7f7cdadff700 1 -- 172.21.15.112:0/1995849093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cd40c9ac0 msgr2=0x7f7cd40cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:25.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.813+0000 7f7cdadff700 1 --2- 172.21.15.112:0/1995849093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cd40c9ac0 0x7f7cd40cd980 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0005fd0 tx=0x7f7cc0009c70 comp rx=0 tx=0).stop 2023-09-12T16:08:25.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.813+0000 7f7cdadff700 1 -- 172.21.15.112:0/1995849093 shutdown_connections 2023-09-12T16:08:25.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.813+0000 7f7cdadff700 1 --2- 172.21.15.112:0/1995849093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7cd4159af0 0x7f7cd40cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:25.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.813+0000 7f7cdadff700 1 --2- 172.21.15.112:0/1995849093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cd40c9ac0 0x7f7cd40cd980 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:25.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.813+0000 7f7cdadff700 1 -- 172.21.15.112:0/1995849093 >> 172.21.15.112:0/1995849093 conn(0x7f7cd406a650 msgr2=0x7f7cd406c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:25.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.813+0000 7f7cdadff700 1 -- 172.21.15.112:0/1995849093 shutdown_connections 2023-09-12T16:08:25.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.813+0000 7f7cdadff700 1 -- 172.21.15.112:0/1995849093 wait complete. 2023-09-12T16:08:25.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.815+0000 7f7cdadff700 1 Processor -- start 2023-09-12T16:08:25.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.815+0000 7f7cdadff700 1 -- start start 2023-09-12T16:08:25.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.816+0000 7f7cdadff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7cd4070e00 0x7f7cd415b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:25.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.816+0000 7f7cdadff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cd4159af0 0x7f7cd414d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:25.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.816+0000 7f7cdadff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7cd414d9e0 0x7f7cd40c3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:25.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.816+0000 7f7cdadff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd41491d0 con 0x7f7cd4159af0 2023-09-12T16:08:25.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.816+0000 7f7cdadff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd415bb00 con 0x7f7cd4070e00 2023-09-12T16:08:25.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.816+0000 7f7cdadff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd415bde0 con 0x7f7cd414d9e0 2023-09-12T16:08:25.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.816+0000 7f7cd3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cd4159af0 0x7f7cd414d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:25.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.816+0000 7f7cd3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cd4159af0 0x7f7cd414d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60810/0 (socket says 172.21.15.112:60810) 2023-09-12T16:08:25.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.816+0000 7f7cd3fff700 1 -- 172.21.15.112:0/1363330006 learned_addr learned my addr 172.21.15.112:0/1363330006 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:25.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.816+0000 7f7cd8b9b700 1 --2- 172.21.15.112:0/1363330006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7cd4070e00 0x7f7cd415b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:25.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.816+0000 7f7cd939c700 1 --2- 172.21.15.112:0/1363330006 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7cd414d9e0 0x7f7cd40c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:25.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.817+0000 7f7cd3fff700 1 -- 172.21.15.112:0/1363330006 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7cd414d9e0 msgr2=0x7f7cd40c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:25.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.817+0000 7f7cd3fff700 1 --2- 172.21.15.112:0/1363330006 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7cd414d9e0 0x7f7cd40c3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:25.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.817+0000 7f7cd3fff700 1 -- 172.21.15.112:0/1363330006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7cd4070e00 msgr2=0x7f7cd415b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:25.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.817+0000 7f7cd3fff700 1 --2- 172.21.15.112:0/1363330006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7cd4070e00 0x7f7cd415b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:25.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.817+0000 7f7cd3fff700 1 -- 172.21.15.112:0/1363330006 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc00095f0 con 0x7f7cd4159af0 2023-09-12T16:08:25.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.817+0000 7f7cd3fff700 1 --2- 172.21.15.112:0/1363330006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cd4159af0 0x7f7cd414d4a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00098e0 tx=0x7f7cc0003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:25.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.817+0000 7f7cd17fa700 1 -- 172.21.15.112:0/1363330006 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc001d070 con 0x7f7cd4159af0 2023-09-12T16:08:25.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.817+0000 7f7cd17fa700 1 -- 172.21.15.112:0/1363330006 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7cc000b820 con 0x7f7cd4159af0 2023-09-12T16:08:25.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.817+0000 7f7cdadff700 1 -- 172.21.15.112:0/1363330006 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd415c0c0 con 0x7f7cd4159af0 2023-09-12T16:08:25.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.817+0000 7f7cd17fa700 1 -- 172.21.15.112:0/1363330006 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc000bc10 con 0x7f7cd4159af0 2023-09-12T16:08:25.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.817+0000 7f7cdadff700 1 -- 172.21.15.112:0/1363330006 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd415b7f0 con 0x7f7cd4159af0 2023-09-12T16:08:25.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.818+0000 7f7cdadff700 1 -- 172.21.15.112:0/1363330006 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd404e300 con 0x7f7cd4159af0 2023-09-12T16:08:25.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.819+0000 7f7cd17fa700 1 -- 172.21.15.112:0/1363330006 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f7cc000bd70 con 0x7f7cd4159af0 2023-09-12T16:08:25.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.821+0000 7f7cd17fa700 1 --2- 172.21.15.112:0/1363330006 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7cb806a580 0x7f7cb806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:25.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.821+0000 7f7cd17fa700 1 -- 172.21.15.112:0/1363330006 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7cc0089eb0 con 0x7f7cd4159af0 2023-09-12T16:08:25.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.821+0000 7f7cd8b9b700 1 --2- 172.21.15.112:0/1363330006 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7cb806a580 0x7f7cb806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:25.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.822+0000 7f7cd8b9b700 1 --2- 172.21.15.112:0/1363330006 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7cb806a580 0x7f7cb806ca40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8009c60 tx=0x7f7cc8009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:25.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:25.825+0000 7f7cd17fa700 1 -- 172.21.15.112:0/1363330006 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f7cc0055630 con 0x7f7cd4159af0 2023-09-12T16:08:26.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.107+0000 7f7cdadff700 1 -- 172.21.15.112:0/1363330006 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f7cd406d0d0 con 0x7f7cd4159af0 2023-09-12T16:08:26.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.110+0000 7f7cd17fa700 1 -- 172.21.15.112:0/1363330006 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7cc005de60 con 0x7f7cd4159af0 2023-09-12T16:08:26.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.112+0000 7f7cdadff700 1 -- 172.21.15.112:0/1363330006 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7cb806a580 msgr2=0x7f7cb806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:26.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.112+0000 7f7cdadff700 1 --2- 172.21.15.112:0/1363330006 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7cb806a580 0x7f7cb806ca40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8009c60 tx=0x7f7cc8009260 comp rx=0 tx=0).stop 2023-09-12T16:08:26.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.112+0000 7f7cdadff700 1 -- 172.21.15.112:0/1363330006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cd4159af0 msgr2=0x7f7cd414d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:26.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.112+0000 7f7cdadff700 1 --2- 172.21.15.112:0/1363330006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cd4159af0 0x7f7cd414d4a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00098e0 tx=0x7f7cc0003d00 comp rx=0 tx=0).stop 2023-09-12T16:08:26.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.112+0000 7f7cdadff700 1 -- 172.21.15.112:0/1363330006 shutdown_connections 2023-09-12T16:08:26.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.112+0000 7f7cdadff700 1 --2- 172.21.15.112:0/1363330006 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f7cb806a580 0x7f7cb806ca40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:26.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.112+0000 7f7cdadff700 1 --2- 172.21.15.112:0/1363330006 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7cd414d9e0 0x7f7cd40c3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:26.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.112+0000 7f7cdadff700 1 --2- 172.21.15.112:0/1363330006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7cd4070e00 0x7f7cd415b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:26.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.112+0000 7f7cdadff700 1 --2- 172.21.15.112:0/1363330006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cd4159af0 0x7f7cd414d4a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:26.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.112+0000 7f7cdadff700 1 -- 172.21.15.112:0/1363330006 >> 172.21.15.112:0/1363330006 conn(0x7f7cd406a650 msgr2=0x7f7cd4151dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:26.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.113+0000 7f7cdadff700 1 -- 172.21.15.112:0/1363330006 shutdown_connections 2023-09-12T16:08:26.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.113+0000 7f7cdadff700 1 -- 172.21.15.112:0/1363330006 wait complete. 2023-09-12T16:08:26.130 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-09-12T16:08:26.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.330+0000 7ff63efff700 1 -- 172.21.15.112:0/3155391820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff628004d90 msgr2=0x7ff628005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:26.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.330+0000 7ff63efff700 1 --2- 172.21.15.112:0/3155391820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff628004d90 0x7ff628005210 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff63000e320 tx=0x7ff628005880 comp rx=0 tx=0).stop 2023-09-12T16:08:26.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.330+0000 7ff63d59c700 1 -- 172.21.15.112:0/3155391820 reap_dead start 2023-09-12T16:08:26.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.330+0000 7ff63efff700 1 -- 172.21.15.112:0/3155391820 shutdown_connections 2023-09-12T16:08:26.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.330+0000 7ff63efff700 1 -- 172.21.15.112:0/3155391820 >> 172.21.15.112:0/3155391820 conn(0x7ff6380d1930 msgr2=0x7ff6380d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:26.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.330+0000 7ff63efff700 1 -- 172.21.15.112:0/3155391820 shutdown_connections 2023-09-12T16:08:26.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.330+0000 7ff63efff700 1 -- 172.21.15.112:0/3155391820 wait complete. 2023-09-12T16:08:26.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.332+0000 7ff63efff700 1 Processor -- start 2023-09-12T16:08:26.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.332+0000 7ff63efff700 1 -- start start 2023-09-12T16:08:26.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.333+0000 7ff63efff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff628004d90 0x7ff63814f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:26.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.333+0000 7ff63efff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff63815b330 0x7ff63809ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:26.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.333+0000 7ff63efff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff6380b14f0 0x7ff6380b1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:26.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.333+0000 7ff63efff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff638150040 con 0x7ff628004d90 2023-09-12T16:08:26.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.333+0000 7ff63efff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff638150320 con 0x7ff63815b330 2023-09-12T16:08:26.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.333+0000 7ff63efff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff638150600 con 0x7ff6380b14f0 2023-09-12T16:08:26.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.333+0000 7ff63cd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff628004d90 0x7ff63814f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:26.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.334+0000 7ff63cd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff628004d90 0x7ff63814f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34512/0 (socket says 172.21.15.112:34512) 2023-09-12T16:08:26.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.334+0000 7ff63cd9b700 1 -- 172.21.15.112:0/3298226341 learned_addr learned my addr 172.21.15.112:0/3298226341 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:26.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.334+0000 7ff63d59c700 1 --2- 172.21.15.112:0/3298226341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff6380b14f0 0x7ff6380b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:26.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.334+0000 7ff637fff700 1 --2- 172.21.15.112:0/3298226341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff63815b330 0x7ff63809ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:26.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.334+0000 7ff63cd9b700 1 -- 172.21.15.112:0/3298226341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff6380b14f0 msgr2=0x7ff6380b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:26.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.334+0000 7ff63cd9b700 1 --2- 172.21.15.112:0/3298226341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff6380b14f0 0x7ff6380b1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:26.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.334+0000 7ff63cd9b700 1 -- 172.21.15.112:0/3298226341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff63815b330 msgr2=0x7ff63809ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:26.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.334+0000 7ff63cd9b700 1 --2- 172.21.15.112:0/3298226341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff63815b330 0x7ff63809ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:26.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.334+0000 7ff63cd9b700 1 -- 172.21.15.112:0/3298226341 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6381508e0 con 0x7ff628004d90 2023-09-12T16:08:26.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.334+0000 7ff63cd9b700 1 --2- 172.21.15.112:0/3298226341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff628004d90 0x7ff63814f7f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff62c006da0 tx=0x7ff62c004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:26.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.334+0000 7ff6357fa700 1 -- 172.21.15.112:0/3298226341 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c011660 con 0x7ff628004d90 2023-09-12T16:08:26.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.334+0000 7ff6357fa700 1 -- 172.21.15.112:0/3298226341 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff62c0118d0 con 0x7ff628004d90 2023-09-12T16:08:26.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.334+0000 7ff6357fa700 1 -- 172.21.15.112:0/3298226341 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c011ce0 con 0x7ff628004d90 2023-09-12T16:08:26.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.334+0000 7ff63efff700 1 -- 172.21.15.112:0/3298226341 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff638150bc0 con 0x7ff628004d90 2023-09-12T16:08:26.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.335+0000 7ff63efff700 1 -- 172.21.15.112:0/3298226341 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6380b1eb0 con 0x7ff628004d90 2023-09-12T16:08:26.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.336+0000 7ff63efff700 1 -- 172.21.15.112:0/3298226341 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff638150f30 con 0x7ff628004d90 2023-09-12T16:08:26.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.336+0000 7ff6357fa700 1 -- 172.21.15.112:0/3298226341 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ff62c01a400 con 0x7ff628004d90 2023-09-12T16:08:26.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.337+0000 7ff6357fa700 1 --2- 172.21.15.112:0/3298226341 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff61c06a580 0x7ff61c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:26.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.338+0000 7ff6357fa700 1 -- 172.21.15.112:0/3298226341 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff62c089700 con 0x7ff628004d90 2023-09-12T16:08:26.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.338+0000 7ff637fff700 1 --2- 172.21.15.112:0/3298226341 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff61c06a580 0x7ff61c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:26.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.338+0000 7ff637fff700 1 --2- 172.21.15.112:0/3298226341 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff61c06a580 0x7ff61c06ca40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff6380ceb70 tx=0x7ff624009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:26.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.341+0000 7ff6357fa700 1 -- 172.21.15.112:0/3298226341 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff62c054df0 con 0x7ff628004d90 2023-09-12T16:08:26.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.616+0000 7ff63efff700 1 -- 172.21.15.112:0/3298226341 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7ff638066f00 con 0x7ff628004d90 2023-09-12T16:08:26.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.619+0000 7ff6357fa700 1 -- 172.21.15.112:0/3298226341 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff62c015020 con 0x7ff628004d90 2023-09-12T16:08:26.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.622+0000 7ff63efff700 1 -- 172.21.15.112:0/3298226341 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff61c06a580 msgr2=0x7ff61c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:26.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.622+0000 7ff63efff700 1 --2- 172.21.15.112:0/3298226341 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff61c06a580 0x7ff61c06ca40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff6380ceb70 tx=0x7ff624009260 comp rx=0 tx=0).stop 2023-09-12T16:08:26.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.622+0000 7ff63efff700 1 -- 172.21.15.112:0/3298226341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff628004d90 msgr2=0x7ff63814f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:26.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.622+0000 7ff63efff700 1 --2- 172.21.15.112:0/3298226341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff628004d90 0x7ff63814f7f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff62c006da0 tx=0x7ff62c004970 comp rx=0 tx=0).stop 2023-09-12T16:08:26.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.622+0000 7ff63efff700 1 -- 172.21.15.112:0/3298226341 shutdown_connections 2023-09-12T16:08:26.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.622+0000 7ff63efff700 1 --2- 172.21.15.112:0/3298226341 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff61c06a580 0x7ff61c06ca40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:26.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.622+0000 7ff63efff700 1 --2- 172.21.15.112:0/3298226341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff6380b14f0 0x7ff6380b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:26.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.622+0000 7ff63efff700 1 --2- 172.21.15.112:0/3298226341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff628004d90 0x7ff63814f7f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:26.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.622+0000 7ff63efff700 1 --2- 172.21.15.112:0/3298226341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff63815b330 0x7ff63809ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:26.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.622+0000 7ff63efff700 1 -- 172.21.15.112:0/3298226341 >> 172.21.15.112:0/3298226341 conn(0x7ff6380d1930 msgr2=0x7ff63815bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:26.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.622+0000 7ff63efff700 1 -- 172.21.15.112:0/3298226341 shutdown_connections 2023-09-12T16:08:26.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.622+0000 7ff63efff700 1 -- 172.21.15.112:0/3298226341 wait complete. 2023-09-12T16:08:26.640 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-09-12T16:08:26.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.840+0000 7ffb11dff700 1 -- 172.21.15.112:0/3821369139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb0c0b3890 msgr2=0x7ffb0c0cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:26.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.840+0000 7ffb11dff700 1 --2- 172.21.15.112:0/3821369139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb0c0b3890 0x7ffb0c0cc3c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c08b9a0 tx=0x7ffb0400b380 comp rx=0 tx=0).stop 2023-09-12T16:08:26.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.840+0000 7ffb11dff700 1 -- 172.21.15.112:0/3821369139 shutdown_connections 2023-09-12T16:08:26.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.840+0000 7ffb11dff700 1 --2- 172.21.15.112:0/3821369139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb0c0b3890 0x7ffb0c0cc3c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:26.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.840+0000 7ffb11dff700 1 --2- 172.21.15.112:0/3821369139 >> v2:172.21.15.144:3300/0 conn(0x7ffb0c15f0d0 0x7ffb0c0cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:26.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.840+0000 7ffb11dff700 1 --2- 172.21.15.112:0/3821369139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb0c0d21f0 0x7ffb0c0b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:26.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.840+0000 7ffb11dff700 1 -- 172.21.15.112:0/3821369139 >> 172.21.15.112:0/3821369139 conn(0x7ffb0c09abe0 msgr2=0x7ffb0c0d18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:26.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.840+0000 7ffb11dff700 1 -- 172.21.15.112:0/3821369139 shutdown_connections 2023-09-12T16:08:26.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.840+0000 7ffb11dff700 1 -- 172.21.15.112:0/3821369139 wait complete. 2023-09-12T16:08:26.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.842+0000 7ffb11dff700 1 Processor -- start 2023-09-12T16:08:26.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.842+0000 7ffb11dff700 1 -- start start 2023-09-12T16:08:26.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.843+0000 7ffb11dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb0c0b3890 0x7ffb0c0c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:26.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.843+0000 7ffb11dff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb0c0d21f0 0x7ffb0c0cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:26.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.843+0000 7ffb11dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb0c15f0d0 0x7ffb0c14bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:26.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.843+0000 7ffb11dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0cb900 con 0x7ffb0c15f0d0 2023-09-12T16:08:26.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.843+0000 7ffb11dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c14c2e0 con 0x7ffb0c0b3890 2023-09-12T16:08:26.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.843+0000 7ffb11dff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0c8f60 con 0x7ffb0c0d21f0 2023-09-12T16:08:26.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.843+0000 7ffb0bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb0c15f0d0 0x7ffb0c14bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:26.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.843+0000 7ffb0bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb0c15f0d0 0x7ffb0c14bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34526/0 (socket says 172.21.15.112:34526) 2023-09-12T16:08:26.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.843+0000 7ffb0bfff700 1 -- 172.21.15.112:0/1262245840 learned_addr learned my addr 172.21.15.112:0/1262245840 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:26.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.843+0000 7ffb0b7fe700 1 --2- 172.21.15.112:0/1262245840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb0c0b3890 0x7ffb0c0c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:26.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.843+0000 7ffb0affd700 1 --2- 172.21.15.112:0/1262245840 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb0c0d21f0 0x7ffb0c0cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:26.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.843+0000 7ffb0bfff700 1 -- 172.21.15.112:0/1262245840 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb0c0d21f0 msgr2=0x7ffb0c0cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:26.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.843+0000 7ffb0bfff700 1 --2- 172.21.15.112:0/1262245840 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb0c0d21f0 0x7ffb0c0cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:26.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.843+0000 7ffb0bfff700 1 -- 172.21.15.112:0/1262245840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb0c0b3890 msgr2=0x7ffb0c0c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:26.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.843+0000 7ffb0bfff700 1 --2- 172.21.15.112:0/1262245840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb0c0b3890 0x7ffb0c0c5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:26.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.843+0000 7ffb0bfff700 1 -- 172.21.15.112:0/1262245840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb04009d00 con 0x7ffb0c15f0d0 2023-09-12T16:08:26.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.843+0000 7ffb0b7fe700 1 --2- 172.21.15.112:0/1262245840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb0c0b3890 0x7ffb0c0c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:08:26.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.844+0000 7ffb0bfff700 1 --2- 172.21.15.112:0/1262245840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb0c15f0d0 0x7ffb0c14bda0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009fd0 tx=0x7ffb04007c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:26.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.844+0000 7ffaf3fff700 1 -- 172.21.15.112:0/1262245840 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0400e040 con 0x7ffb0c15f0d0 2023-09-12T16:08:26.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.844+0000 7ffaf3fff700 1 -- 172.21.15.112:0/1262245840 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ffb0401d890 con 0x7ffb0c15f0d0 2023-09-12T16:08:26.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.844+0000 7ffaf3fff700 1 -- 172.21.15.112:0/1262245840 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0401dce0 con 0x7ffb0c15f0d0 2023-09-12T16:08:26.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.844+0000 7ffb11dff700 1 -- 172.21.15.112:0/1262245840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0c0c6340 con 0x7ffb0c15f0d0 2023-09-12T16:08:26.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.844+0000 7ffb11dff700 1 -- 172.21.15.112:0/1262245840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0c0c8910 con 0x7ffb0c15f0d0 2023-09-12T16:08:26.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.845+0000 7ffb11dff700 1 -- 172.21.15.112:0/1262245840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0c04e300 con 0x7ffb0c15f0d0 2023-09-12T16:08:26.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.846+0000 7ffaf3fff700 1 -- 172.21.15.112:0/1262245840 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ffb0401b450 con 0x7ffb0c15f0d0 2023-09-12T16:08:26.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.847+0000 7ffaf3fff700 1 --2- 172.21.15.112:0/1262245840 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ffaf806a580 0x7ffaf806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:26.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.848+0000 7ffaf3fff700 1 -- 172.21.15.112:0/1262245840 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ffb0408a930 con 0x7ffb0c15f0d0 2023-09-12T16:08:26.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.848+0000 7ffb0b7fe700 1 --2- 172.21.15.112:0/1262245840 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ffaf806a580 0x7ffaf806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:26.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.848+0000 7ffb0b7fe700 1 --2- 172.21.15.112:0/1262245840 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ffaf806a580 0x7ffaf806ca40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffafc00bbc0 tx=0x7ffafc005f70 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:26.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:26.852+0000 7ffaf3fff700 1 -- 172.21.15.112:0/1262245840 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ffb04056150 con 0x7ffb0c15f0d0 2023-09-12T16:08:27.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.129+0000 7ffb11dff700 1 -- 172.21.15.112:0/1262245840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7ffb0c0b6320 con 0x7ffb0c15f0d0 2023-09-12T16:08:27.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.131+0000 7ffaf3fff700 1 -- 172.21.15.112:0/1262245840 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7ffb04021020 con 0x7ffb0c15f0d0 2023-09-12T16:08:27.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.134+0000 7ffb11dff700 1 -- 172.21.15.112:0/1262245840 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ffaf806a580 msgr2=0x7ffaf806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:27.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.134+0000 7ffb11dff700 1 --2- 172.21.15.112:0/1262245840 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ffaf806a580 0x7ffaf806ca40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffafc00bbc0 tx=0x7ffafc005f70 comp rx=0 tx=0).stop 2023-09-12T16:08:27.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.134+0000 7ffb11dff700 1 -- 172.21.15.112:0/1262245840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb0c15f0d0 msgr2=0x7ffb0c14bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:27.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.134+0000 7ffb11dff700 1 --2- 172.21.15.112:0/1262245840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb0c15f0d0 0x7ffb0c14bda0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009fd0 tx=0x7ffb04007c10 comp rx=0 tx=0).stop 2023-09-12T16:08:27.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.134+0000 7ffb11dff700 1 -- 172.21.15.112:0/1262245840 shutdown_connections 2023-09-12T16:08:27.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.134+0000 7ffb11dff700 1 --2- 172.21.15.112:0/1262245840 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ffaf806a580 0x7ffaf806ca40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:27.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.134+0000 7ffb11dff700 1 --2- 172.21.15.112:0/1262245840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb0c15f0d0 0x7ffb0c14bda0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:27.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.134+0000 7ffb11dff700 1 --2- 172.21.15.112:0/1262245840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb0c0b3890 0x7ffb0c0c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:27.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.134+0000 7ffb11dff700 1 --2- 172.21.15.112:0/1262245840 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb0c0d21f0 0x7ffb0c0cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:27.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.134+0000 7ffb11dff700 1 -- 172.21.15.112:0/1262245840 >> 172.21.15.112:0/1262245840 conn(0x7ffb0c09abe0 msgr2=0x7ffb0c15d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:27.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.134+0000 7ffb11dff700 1 -- 172.21.15.112:0/1262245840 shutdown_connections 2023-09-12T16:08:27.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.134+0000 7ffb11dff700 1 -- 172.21.15.112:0/1262245840 wait complete. 2023-09-12T16:08:27.152 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-09-12T16:08:27.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.353+0000 7fb5ae3ff700 1 -- 172.21.15.112:0/3094905675 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5a815be30 msgr2=0x7fb5a80ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:27.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.353+0000 7fb5ae3ff700 1 --2- 172.21.15.112:0/3094905675 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5a815be30 0x7fb5a80ca7d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb598005fd0 tx=0x7fb598009c70 comp rx=0 tx=0).stop 2023-09-12T16:08:27.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.353+0000 7fb5ae3ff700 1 -- 172.21.15.112:0/3094905675 shutdown_connections 2023-09-12T16:08:27.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.353+0000 7fb5ae3ff700 1 --2- 172.21.15.112:0/3094905675 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5a815be30 0x7fb5a80ca7d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:27.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.353+0000 7fb5ae3ff700 1 --2- 172.21.15.112:0/3094905675 >> v2:172.21.15.144:3300/0 conn(0x7fb5a80b0c20 0x7fb5a80720b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:27.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.353+0000 7fb5ae3ff700 1 -- 172.21.15.112:0/3094905675 >> 172.21.15.112:0/3094905675 conn(0x7fb5a806b760 msgr2=0x7fb5a806d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:27.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.353+0000 7fb5ae3ff700 1 -- 172.21.15.112:0/3094905675 shutdown_connections 2023-09-12T16:08:27.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.353+0000 7fb5ae3ff700 1 -- 172.21.15.112:0/3094905675 wait complete. 2023-09-12T16:08:27.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.354+0000 7fb5ae3ff700 1 Processor -- start 2023-09-12T16:08:27.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.355+0000 7fb5ae3ff700 1 -- start start 2023-09-12T16:08:27.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.356+0000 7fb5ae3ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5a806a020 0x7fb5a80b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:27.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.356+0000 7fb5ae3ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5a80b0c20 0x7fb5a81446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:27.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.356+0000 7fb5ae3ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a815be30 0x7fb5a8147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:27.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.356+0000 7fb5ae3ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a80b3590 con 0x7fb5a815be30 2023-09-12T16:08:27.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.356+0000 7fb5ae3ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a8144c20 con 0x7fb5a80b0c20 2023-09-12T16:08:27.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.356+0000 7fb5ae3ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a8147e40 con 0x7fb5a806a020 2023-09-12T16:08:27.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.356+0000 7fb5ac99c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a815be30 0x7fb5a8147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:27.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.356+0000 7fb5ac99c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a815be30 0x7fb5a8147900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34532/0 (socket says 172.21.15.112:34532) 2023-09-12T16:08:27.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.356+0000 7fb5ac99c700 1 -- 172.21.15.112:0/3600834474 learned_addr learned my addr 172.21.15.112:0/3600834474 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:27.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.356+0000 7fb5a77fe700 1 --2- 172.21.15.112:0/3600834474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5a80b0c20 0x7fb5a81446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:27.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.356+0000 7fb5a7fff700 1 --2- 172.21.15.112:0/3600834474 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5a806a020 0x7fb5a80b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:27.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.356+0000 7fb5ac99c700 1 -- 172.21.15.112:0/3600834474 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5a806a020 msgr2=0x7fb5a80b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:27.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.356+0000 7fb5ac99c700 1 --2- 172.21.15.112:0/3600834474 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5a806a020 0x7fb5a80b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:27.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.356+0000 7fb5ac99c700 1 -- 172.21.15.112:0/3600834474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5a80b0c20 msgr2=0x7fb5a81446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:27.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.356+0000 7fb5ac99c700 1 --2- 172.21.15.112:0/3600834474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5a80b0c20 0x7fb5a81446e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:27.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.356+0000 7fb5ac99c700 1 -- 172.21.15.112:0/3600834474 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5980095f0 con 0x7fb5a815be30 2023-09-12T16:08:27.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.357+0000 7fb5ac99c700 1 --2- 172.21.15.112:0/3600834474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a815be30 0x7fb5a8147900 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000cc80 tx=0x7fb5a000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:27.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.357+0000 7fb5a4ff9700 1 -- 172.21.15.112:0/3600834474 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0003c00 con 0x7fb5a815be30 2023-09-12T16:08:27.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.357+0000 7fb5a4ff9700 1 -- 172.21.15.112:0/3600834474 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb5a0003d60 con 0x7fb5a815be30 2023-09-12T16:08:27.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.357+0000 7fb5ae3ff700 1 -- 172.21.15.112:0/3600834474 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a815c3b0 con 0x7fb5a815be30 2023-09-12T16:08:27.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.357+0000 7fb5a4ff9700 1 -- 172.21.15.112:0/3600834474 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a000aac0 con 0x7fb5a815be30 2023-09-12T16:08:27.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.357+0000 7fb5ae3ff700 1 -- 172.21.15.112:0/3600834474 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a80b3a80 con 0x7fb5a815be30 2023-09-12T16:08:27.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.358+0000 7fb5ae3ff700 1 -- 172.21.15.112:0/3600834474 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a804e300 con 0x7fb5a815be30 2023-09-12T16:08:27.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.359+0000 7fb5a4ff9700 1 -- 172.21.15.112:0/3600834474 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fb5a000ac20 con 0x7fb5a815be30 2023-09-12T16:08:27.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.360+0000 7fb5a4ff9700 1 --2- 172.21.15.112:0/3600834474 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb59406a580 0x7fb59406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:27.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.360+0000 7fb5a4ff9700 1 -- 172.21.15.112:0/3600834474 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb5a0088960 con 0x7fb5a815be30 2023-09-12T16:08:27.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.360+0000 7fb5a7fff700 1 --2- 172.21.15.112:0/3600834474 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb59406a580 0x7fb59406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:27.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.360+0000 7fb5a7fff700 1 --2- 172.21.15.112:0/3600834474 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb59406a580 0x7fb59406ca40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb5980098e0 tx=0x7fb598019040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:27.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.364+0000 7fb5a4ff9700 1 -- 172.21.15.112:0/3600834474 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb5a00540e0 con 0x7fb5a815be30 2023-09-12T16:08:27.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.635+0000 7fb5ae3ff700 1 -- 172.21.15.112:0/3600834474 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fb5a8144ea0 con 0x7fb5a815be30 2023-09-12T16:08:27.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.639+0000 7fb5a4ff9700 1 -- 172.21.15.112:0/3600834474 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb5a8144ea0 con 0x7fb5a815be30 2023-09-12T16:08:27.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.642+0000 7fb5ae3ff700 1 -- 172.21.15.112:0/3600834474 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb59406a580 msgr2=0x7fb59406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:27.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.642+0000 7fb5ae3ff700 1 --2- 172.21.15.112:0/3600834474 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb59406a580 0x7fb59406ca40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb5980098e0 tx=0x7fb598019040 comp rx=0 tx=0).stop 2023-09-12T16:08:27.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.642+0000 7fb5ae3ff700 1 -- 172.21.15.112:0/3600834474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a815be30 msgr2=0x7fb5a8147900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:27.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.642+0000 7fb5ae3ff700 1 --2- 172.21.15.112:0/3600834474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a815be30 0x7fb5a8147900 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000cc80 tx=0x7fb5a000cf90 comp rx=0 tx=0).stop 2023-09-12T16:08:27.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.642+0000 7fb5ae3ff700 1 -- 172.21.15.112:0/3600834474 shutdown_connections 2023-09-12T16:08:27.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.642+0000 7fb5ae3ff700 1 --2- 172.21.15.112:0/3600834474 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb59406a580 0x7fb59406ca40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:27.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.642+0000 7fb5ae3ff700 1 --2- 172.21.15.112:0/3600834474 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5a806a020 0x7fb5a80b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:27.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.642+0000 7fb5ae3ff700 1 --2- 172.21.15.112:0/3600834474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a815be30 0x7fb5a8147900 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:27.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.642+0000 7fb5ae3ff700 1 --2- 172.21.15.112:0/3600834474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5a80b0c20 0x7fb5a81446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:27.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.642+0000 7fb5ae3ff700 1 -- 172.21.15.112:0/3600834474 >> 172.21.15.112:0/3600834474 conn(0x7fb5a806b760 msgr2=0x7fb5a8158a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:27.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.642+0000 7fb5ae3ff700 1 -- 172.21.15.112:0/3600834474 shutdown_connections 2023-09-12T16:08:27.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.642+0000 7fb5ae3ff700 1 -- 172.21.15.112:0/3600834474 wait complete. 2023-09-12T16:08:27.660 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-09-12T16:08:27.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.860+0000 7fc29a9ff700 1 -- 172.21.15.112:0/3319194390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2940b3a60 msgr2=0x7fc2940cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:27.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.860+0000 7fc29a9ff700 1 --2- 172.21.15.112:0/3319194390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2940b3a60 0x7fc2940cfe20 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc2940cbe20 tx=0x7fc288009ba0 comp rx=0 tx=0).stop 2023-09-12T16:08:27.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.861+0000 7fc29a9ff700 1 -- 172.21.15.112:0/3319194390 shutdown_connections 2023-09-12T16:08:27.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.861+0000 7fc29a9ff700 1 --2- 172.21.15.112:0/3319194390 >> v2:172.21.15.144:3300/0 conn(0x7fc2940d21f0 0x7fc2940b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:27.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.861+0000 7fc29a9ff700 1 --2- 172.21.15.112:0/3319194390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2940b3a60 0x7fc2940cfe20 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:27.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.861+0000 7fc29a9ff700 1 -- 172.21.15.112:0/3319194390 >> 172.21.15.112:0/3319194390 conn(0x7fc29409abe0 msgr2=0x7fc2940d18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:27.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.861+0000 7fc29a9ff700 1 -- 172.21.15.112:0/3319194390 shutdown_connections 2023-09-12T16:08:27.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.861+0000 7fc29a9ff700 1 -- 172.21.15.112:0/3319194390 wait complete. 2023-09-12T16:08:27.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.862+0000 7fc29a9ff700 1 Processor -- start 2023-09-12T16:08:27.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.863+0000 7fc29a9ff700 1 -- start start 2023-09-12T16:08:27.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.864+0000 7fc29a9ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2940b3a60 0x7fc294156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:27.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.864+0000 7fc29a9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2940d21f0 0x7fc2941579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:27.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.864+0000 7fc29a9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc29415f0d0 0x7fc294157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:27.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.864+0000 7fc29a9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29415dea0 con 0x7fc2940d21f0 2023-09-12T16:08:27.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.864+0000 7fc29a9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2940c8910 con 0x7fc29415f0d0 2023-09-12T16:08:27.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.864+0000 7fc29a9ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc294156a40 con 0x7fc2940b3a60 2023-09-12T16:08:27.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.864+0000 7fc2937fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2940d21f0 0x7fc2941579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:27.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.864+0000 7fc2937fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2940d21f0 0x7fc2941579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34546/0 (socket says 172.21.15.112:34546) 2023-09-12T16:08:27.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.864+0000 7fc2937fe700 1 -- 172.21.15.112:0/2469213080 learned_addr learned my addr 172.21.15.112:0/2469213080 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:27.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.864+0000 7fc298f9c700 1 --2- 172.21.15.112:0/2469213080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc29415f0d0 0x7fc294157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:27.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.864+0000 7fc2937fe700 1 -- 172.21.15.112:0/2469213080 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2940b3a60 msgr2=0x7fc294156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:27.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.864+0000 7fc293fff700 1 --2- 172.21.15.112:0/2469213080 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2940b3a60 0x7fc294156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:27.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.864+0000 7fc2937fe700 1 --2- 172.21.15.112:0/2469213080 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2940b3a60 0x7fc294156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:27.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.864+0000 7fc2937fe700 1 -- 172.21.15.112:0/2469213080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc29415f0d0 msgr2=0x7fc294157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:27.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.864+0000 7fc2937fe700 1 --2- 172.21.15.112:0/2469213080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc29415f0d0 0x7fc294157f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:27.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.864+0000 7fc2937fe700 1 -- 172.21.15.112:0/2469213080 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc288009520 con 0x7fc2940d21f0 2023-09-12T16:08:27.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.864+0000 7fc298f9c700 1 --2- 172.21.15.112:0/2469213080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc29415f0d0 0x7fc294157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:27.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.864+0000 7fc293fff700 1 --2- 172.21.15.112:0/2469213080 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2940b3a60 0x7fc294156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:27.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.865+0000 7fc2937fe700 1 --2- 172.21.15.112:0/2469213080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2940d21f0 0x7fc2941579f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc288009fa0 tx=0x7fc288017630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:27.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.865+0000 7fc290ff9700 1 -- 172.21.15.112:0/2469213080 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28801c070 con 0x7fc2940d21f0 2023-09-12T16:08:27.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.865+0000 7fc290ff9700 1 -- 172.21.15.112:0/2469213080 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc288017be0 con 0x7fc2940d21f0 2023-09-12T16:08:27.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.865+0000 7fc290ff9700 1 -- 172.21.15.112:0/2469213080 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc288004050 con 0x7fc2940d21f0 2023-09-12T16:08:27.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.865+0000 7fc29a9ff700 1 -- 172.21.15.112:0/2469213080 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2940c8b60 con 0x7fc2940d21f0 2023-09-12T16:08:27.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.865+0000 7fc29a9ff700 1 -- 172.21.15.112:0/2469213080 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2940c9120 con 0x7fc2940d21f0 2023-09-12T16:08:27.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.866+0000 7fc29a9ff700 1 -- 172.21.15.112:0/2469213080 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2940c4fb0 con 0x7fc2940d21f0 2023-09-12T16:08:27.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.867+0000 7fc290ff9700 1 -- 172.21.15.112:0/2469213080 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fc2880041d0 con 0x7fc2940d21f0 2023-09-12T16:08:27.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.868+0000 7fc290ff9700 1 --2- 172.21.15.112:0/2469213080 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc28006a580 0x7fc28006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:27.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.868+0000 7fc290ff9700 1 -- 172.21.15.112:0/2469213080 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc288089940 con 0x7fc2940d21f0 2023-09-12T16:08:27.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.868+0000 7fc293fff700 1 --2- 172.21.15.112:0/2469213080 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc28006a580 0x7fc28006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:27.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.868+0000 7fc293fff700 1 --2- 172.21.15.112:0/2469213080 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc28006a580 0x7fc28006ca40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc29415add0 tx=0x7fc284009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:27.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:27.872+0000 7fc290ff9700 1 -- 172.21.15.112:0/2469213080 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fc2880550c0 con 0x7fc2940d21f0 2023-09-12T16:08:28.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.147+0000 7fc29a9ff700 1 -- 172.21.15.112:0/2469213080 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fc29404e300 con 0x7fc2940d21f0 2023-09-12T16:08:28.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.151+0000 7fc290ff9700 1 -- 172.21.15.112:0/2469213080 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc2880586e0 con 0x7fc2940d21f0 2023-09-12T16:08:28.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.154+0000 7fc29a9ff700 1 -- 172.21.15.112:0/2469213080 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc28006a580 msgr2=0x7fc28006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:28.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.154+0000 7fc29a9ff700 1 --2- 172.21.15.112:0/2469213080 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc28006a580 0x7fc28006ca40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc29415add0 tx=0x7fc284009040 comp rx=0 tx=0).stop 2023-09-12T16:08:28.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.154+0000 7fc29a9ff700 1 -- 172.21.15.112:0/2469213080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2940d21f0 msgr2=0x7fc2941579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:28.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.154+0000 7fc29a9ff700 1 --2- 172.21.15.112:0/2469213080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2940d21f0 0x7fc2941579f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc288009fa0 tx=0x7fc288017630 comp rx=0 tx=0).stop 2023-09-12T16:08:28.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.154+0000 7fc29a9ff700 1 -- 172.21.15.112:0/2469213080 shutdown_connections 2023-09-12T16:08:28.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.154+0000 7fc29a9ff700 1 --2- 172.21.15.112:0/2469213080 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fc28006a580 0x7fc28006ca40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:28.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.154+0000 7fc29a9ff700 1 --2- 172.21.15.112:0/2469213080 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2940b3a60 0x7fc294156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:28.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.154+0000 7fc29a9ff700 1 --2- 172.21.15.112:0/2469213080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc29415f0d0 0x7fc294157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:28.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.154+0000 7fc29a9ff700 1 --2- 172.21.15.112:0/2469213080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2940d21f0 0x7fc2941579f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:28.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.154+0000 7fc29a9ff700 1 -- 172.21.15.112:0/2469213080 >> 172.21.15.112:0/2469213080 conn(0x7fc29409abe0 msgr2=0x7fc29406b270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:28.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.154+0000 7fc29a9ff700 1 -- 172.21.15.112:0/2469213080 shutdown_connections 2023-09-12T16:08:28.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.155+0000 7fc29a9ff700 1 -- 172.21.15.112:0/2469213080 wait complete. 2023-09-12T16:08:28.172 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-09-12T16:08:28.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.373+0000 7f55205ff700 1 -- 172.21.15.112:0/3320533213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55180d0590 msgr2=0x7f55180cc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:28.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.373+0000 7f55205ff700 1 --2- 172.21.15.112:0/3320533213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55180d0590 0x7f55180cc8f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5510009f60 tx=0x7f5510009f90 comp rx=0 tx=0).stop 2023-09-12T16:08:28.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.373+0000 7f55205ff700 1 -- 172.21.15.112:0/3320533213 shutdown_connections 2023-09-12T16:08:28.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.373+0000 7f55205ff700 1 --2- 172.21.15.112:0/3320533213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55180d0590 0x7f55180cc8f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:28.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.373+0000 7f55205ff700 1 --2- 172.21.15.112:0/3320533213 >> v2:172.21.15.144:3300/0 conn(0x7f55180cdfb0 0x7f55180cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:28.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.373+0000 7f55205ff700 1 -- 172.21.15.112:0/3320533213 >> 172.21.15.112:0/3320533213 conn(0x7f55180d1930 msgr2=0x7f55180d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:28.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.373+0000 7f55205ff700 1 -- 172.21.15.112:0/3320533213 shutdown_connections 2023-09-12T16:08:28.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.373+0000 7f55205ff700 1 -- 172.21.15.112:0/3320533213 wait complete. 2023-09-12T16:08:28.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.374+0000 7f55205ff700 1 Processor -- start 2023-09-12T16:08:28.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.375+0000 7f55205ff700 1 -- start start 2023-09-12T16:08:28.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.375+0000 7f55205ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55180cdfb0 0x7f55181539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:28.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.376+0000 7f55205ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55180d0590 0x7f55181573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:28.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.376+0000 7f55205ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f551815f480 0x7f55181f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:28.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.376+0000 7f55205ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55181f5440 con 0x7f55180cdfb0 2023-09-12T16:08:28.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.376+0000 7f55205ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551815d910 con 0x7f551815f480 2023-09-12T16:08:28.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.376+0000 7f55205ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551815dbf0 con 0x7f55180d0590 2023-09-12T16:08:28.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.376+0000 7f551e39b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55180cdfb0 0x7f55181539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:28.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.376+0000 7f551e39b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55180cdfb0 0x7f55181539a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34554/0 (socket says 172.21.15.112:34554) 2023-09-12T16:08:28.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.376+0000 7f551e39b700 1 -- 172.21.15.112:0/1625566215 learned_addr learned my addr 172.21.15.112:0/1625566215 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:28.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.376+0000 7f551eb9c700 1 --2- 172.21.15.112:0/1625566215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f551815f480 0x7f55181f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:28.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.376+0000 7f551db9a700 1 --2- 172.21.15.112:0/1625566215 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55180d0590 0x7f55181573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:28.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.376+0000 7f551e39b700 1 -- 172.21.15.112:0/1625566215 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55180d0590 msgr2=0x7f55181573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:28.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.376+0000 7f551e39b700 1 --2- 172.21.15.112:0/1625566215 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55180d0590 0x7f55181573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:28.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.376+0000 7f551e39b700 1 -- 172.21.15.112:0/1625566215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f551815f480 msgr2=0x7f55181f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:28.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.376+0000 7f551e39b700 1 --2- 172.21.15.112:0/1625566215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f551815f480 0x7f55181f5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:28.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.376+0000 7f551e39b700 1 -- 172.21.15.112:0/1625566215 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5508009520 con 0x7f55180cdfb0 2023-09-12T16:08:28.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.376+0000 7f551eb9c700 1 --2- 172.21.15.112:0/1625566215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f551815f480 0x7f55181f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:08:28.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.376+0000 7f551e39b700 1 --2- 172.21.15.112:0/1625566215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55180cdfb0 0x7f55181539a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f551400c500 tx=0x7f551400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:28.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.377+0000 7f550effd700 1 -- 172.21.15.112:0/1625566215 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55140054e0 con 0x7f55180cdfb0 2023-09-12T16:08:28.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.377+0000 7f550effd700 1 -- 172.21.15.112:0/1625566215 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5514003680 con 0x7f55180cdfb0 2023-09-12T16:08:28.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.377+0000 7f55205ff700 1 -- 172.21.15.112:0/1625566215 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5510009c40 con 0x7f55180cdfb0 2023-09-12T16:08:28.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.377+0000 7f550effd700 1 -- 172.21.15.112:0/1625566215 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5514003a70 con 0x7f55180cdfb0 2023-09-12T16:08:28.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.377+0000 7f55205ff700 1 -- 172.21.15.112:0/1625566215 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55180b2ba0 con 0x7f55180cdfb0 2023-09-12T16:08:28.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.378+0000 7f55205ff700 1 -- 172.21.15.112:0/1625566215 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551804e300 con 0x7f55180cdfb0 2023-09-12T16:08:28.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.379+0000 7f550effd700 1 -- 172.21.15.112:0/1625566215 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f5514003bd0 con 0x7f55180cdfb0 2023-09-12T16:08:28.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.379+0000 7f550effd700 1 --2- 172.21.15.112:0/1625566215 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f54fc06a580 0x7f54fc06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:28.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.380+0000 7f550effd700 1 -- 172.21.15.112:0/1625566215 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f5514087f20 con 0x7f55180cdfb0 2023-09-12T16:08:28.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.380+0000 7f551db9a700 1 --2- 172.21.15.112:0/1625566215 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f54fc06a580 0x7f54fc06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:28.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.380+0000 7f551db9a700 1 --2- 172.21.15.112:0/1625566215 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f54fc06a580 0x7f54fc06ca40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f55181571b0 tx=0x7f5508009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:28.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.384+0000 7f550effd700 1 -- 172.21.15.112:0/1625566215 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f55140536a0 con 0x7f55180cdfb0 2023-09-12T16:08:28.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.657+0000 7f55205ff700 1 -- 172.21.15.112:0/1625566215 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f55181f5770 con 0x7f55180cdfb0 2023-09-12T16:08:28.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.662+0000 7f550effd700 1 -- 172.21.15.112:0/1625566215 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5514017020 con 0x7f55180cdfb0 2023-09-12T16:08:28.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.664+0000 7f55205ff700 1 -- 172.21.15.112:0/1625566215 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f54fc06a580 msgr2=0x7f54fc06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:28.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.664+0000 7f55205ff700 1 --2- 172.21.15.112:0/1625566215 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f54fc06a580 0x7f54fc06ca40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f55181571b0 tx=0x7f5508009260 comp rx=0 tx=0).stop 2023-09-12T16:08:28.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.664+0000 7f55205ff700 1 -- 172.21.15.112:0/1625566215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55180cdfb0 msgr2=0x7f55181539a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:28.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.664+0000 7f55205ff700 1 --2- 172.21.15.112:0/1625566215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55180cdfb0 0x7f55181539a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f551400c500 tx=0x7f551400c8c0 comp rx=0 tx=0).stop 2023-09-12T16:08:28.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.664+0000 7f55205ff700 1 -- 172.21.15.112:0/1625566215 shutdown_connections 2023-09-12T16:08:28.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.664+0000 7f55205ff700 1 --2- 172.21.15.112:0/1625566215 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f54fc06a580 0x7f54fc06ca40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:28.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.664+0000 7f55205ff700 1 --2- 172.21.15.112:0/1625566215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f551815f480 0x7f55181f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:28.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.664+0000 7f55205ff700 1 --2- 172.21.15.112:0/1625566215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55180cdfb0 0x7f55181539a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:28.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.664+0000 7f55205ff700 1 --2- 172.21.15.112:0/1625566215 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55180d0590 0x7f55181573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:28.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.664+0000 7f55205ff700 1 -- 172.21.15.112:0/1625566215 >> 172.21.15.112:0/1625566215 conn(0x7f55180d1930 msgr2=0x7f551815bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:28.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.664+0000 7f55205ff700 1 -- 172.21.15.112:0/1625566215 shutdown_connections 2023-09-12T16:08:28.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.664+0000 7f55205ff700 1 -- 172.21.15.112:0/1625566215 wait complete. 2023-09-12T16:08:28.682 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:08:28.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.882+0000 7f7833fff700 1 -- 172.21.15.112:0/2313329932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f782c0b3a60 msgr2=0x7f782c0cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:28.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.882+0000 7f7833fff700 1 --2- 172.21.15.112:0/2313329932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f782c0b3a60 0x7f782c0cfe20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f781c005fd0 tx=0x7f781c009c70 comp rx=0 tx=0).stop 2023-09-12T16:08:28.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.882+0000 7f7833fff700 1 -- 172.21.15.112:0/2313329932 shutdown_connections 2023-09-12T16:08:28.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.882+0000 7f7833fff700 1 --2- 172.21.15.112:0/2313329932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f782c0b3a60 0x7f782c0cfe20 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:28.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.882+0000 7f7833fff700 1 -- 172.21.15.112:0/2313329932 >> 172.21.15.112:0/2313329932 conn(0x7f782c09abe0 msgr2=0x7f782c0d18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:28.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.882+0000 7f7833fff700 1 -- 172.21.15.112:0/2313329932 shutdown_connections 2023-09-12T16:08:28.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.882+0000 7f7833fff700 1 -- 172.21.15.112:0/2313329932 wait complete. 2023-09-12T16:08:28.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.883+0000 7f7833fff700 1 Processor -- start 2023-09-12T16:08:28.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.884+0000 7f7833fff700 1 -- start start 2023-09-12T16:08:28.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.885+0000 7f7833fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f782c0b3a60 0x7f782c153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:28.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.885+0000 7f7833fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f782c0d21f0 0x7f782c0b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:28.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.885+0000 7f7833fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f782c15f0d0 0x7f782c1e44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:28.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.885+0000 7f7833fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c0c58d0 con 0x7f782c0d21f0 2023-09-12T16:08:28.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.885+0000 7f7833fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c0ca880 con 0x7f782c0b3a60 2023-09-12T16:08:28.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.885+0000 7f7833fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c0cab60 con 0x7f782c15f0d0 2023-09-12T16:08:28.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.885+0000 7f783159a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f782c0d21f0 0x7f782c0b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:28.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.885+0000 7f783159a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f782c0d21f0 0x7f782c0b6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34568/0 (socket says 172.21.15.112:34568) 2023-09-12T16:08:28.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.885+0000 7f783159a700 1 -- 172.21.15.112:0/3414183358 learned_addr learned my addr 172.21.15.112:0/3414183358 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:28.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.885+0000 7f783259c700 1 --2- 172.21.15.112:0/3414183358 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f782c15f0d0 0x7f782c1e44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:28.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.885+0000 7f7831d9b700 1 --2- 172.21.15.112:0/3414183358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f782c0b3a60 0x7f782c153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:28.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.885+0000 7f783159a700 1 -- 172.21.15.112:0/3414183358 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f782c15f0d0 msgr2=0x7f782c1e44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:28.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.885+0000 7f783159a700 1 --2- 172.21.15.112:0/3414183358 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f782c15f0d0 0x7f782c1e44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:28.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.885+0000 7f783159a700 1 -- 172.21.15.112:0/3414183358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f782c0b3a60 msgr2=0x7f782c153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:28.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.885+0000 7f783159a700 1 --2- 172.21.15.112:0/3414183358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f782c0b3a60 0x7f782c153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:28.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.885+0000 7f783159a700 1 -- 172.21.15.112:0/3414183358 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c0095f0 con 0x7f782c0d21f0 2023-09-12T16:08:28.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.885+0000 7f783159a700 1 --2- 172.21.15.112:0/3414183358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f782c0d21f0 0x7f782c0b6cc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f781c005e00 tx=0x7f781c00bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:28.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.886+0000 7f78227fc700 1 -- 172.21.15.112:0/3414183358 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c01d070 con 0x7f782c0d21f0 2023-09-12T16:08:28.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.886+0000 7f78227fc700 1 -- 172.21.15.112:0/3414183358 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f781c005140 con 0x7f782c0d21f0 2023-09-12T16:08:28.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.886+0000 7f7833fff700 1 -- 172.21.15.112:0/3414183358 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782c0cae40 con 0x7f782c0d21f0 2023-09-12T16:08:28.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.886+0000 7f78227fc700 1 -- 172.21.15.112:0/3414183358 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c005530 con 0x7f782c0d21f0 2023-09-12T16:08:28.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.886+0000 7f7833fff700 1 -- 172.21.15.112:0/3414183358 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782c153ff0 con 0x7f782c0d21f0 2023-09-12T16:08:28.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.887+0000 7f7833fff700 1 -- 172.21.15.112:0/3414183358 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782c0c5a80 con 0x7f782c0d21f0 2023-09-12T16:08:28.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.888+0000 7f78227fc700 1 -- 172.21.15.112:0/3414183358 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f781c00f460 con 0x7f782c0d21f0 2023-09-12T16:08:28.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.889+0000 7f78227fc700 1 --2- 172.21.15.112:0/3414183358 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f781006a580 0x7f781006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:28.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.889+0000 7f78227fc700 1 -- 172.21.15.112:0/3414183358 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f781c08a1d0 con 0x7f782c0d21f0 2023-09-12T16:08:28.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.889+0000 7f7831d9b700 1 --2- 172.21.15.112:0/3414183358 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f781006a580 0x7f781006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:28.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.889+0000 7f7831d9b700 1 --2- 172.21.15.112:0/3414183358 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f781006a580 0x7f781006ca40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f782c1e5a50 tx=0x7f7828009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:28.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:28.893+0000 7f78227fc700 1 -- 172.21.15.112:0/3414183358 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f782c0c5a80 con 0x7f782c0d21f0 2023-09-12T16:08:29.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.094+0000 7f7833fff700 1 -- 172.21.15.112:0/3414183358 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f782c0b59c0 con 0x7f782c0d21f0 2023-09-12T16:08:29.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.095+0000 7f78227fc700 1 -- 172.21.15.112:0/3414183358 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+13098 (secure 0 0 0) 0x7f781c027090 con 0x7f782c0d21f0 2023-09-12T16:08:29.096 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:29.096 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":34,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:08:25.065607+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:08:29.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.098+0000 7f7833fff700 1 -- 172.21.15.112:0/3414183358 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f781006a580 msgr2=0x7f781006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:29.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.098+0000 7f7833fff700 1 --2- 172.21.15.112:0/3414183358 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f781006a580 0x7f781006ca40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f782c1e5a50 tx=0x7f7828009040 comp rx=0 tx=0).stop 2023-09-12T16:08:29.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.098+0000 7f7833fff700 1 -- 172.21.15.112:0/3414183358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f782c0d21f0 msgr2=0x7f782c0b6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:29.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.098+0000 7f7833fff700 1 --2- 172.21.15.112:0/3414183358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f782c0d21f0 0x7f782c0b6cc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f781c005e00 tx=0x7f781c00bfc0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.098+0000 7f7833fff700 1 -- 172.21.15.112:0/3414183358 shutdown_connections 2023-09-12T16:08:29.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.098+0000 7f7833fff700 1 --2- 172.21.15.112:0/3414183358 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f781006a580 0x7f781006ca40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.098+0000 7f7833fff700 1 --2- 172.21.15.112:0/3414183358 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f782c15f0d0 0x7f782c1e44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.098+0000 7f7833fff700 1 --2- 172.21.15.112:0/3414183358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f782c0b3a60 0x7f782c153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.098+0000 7f7833fff700 1 --2- 172.21.15.112:0/3414183358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f782c0d21f0 0x7f782c0b6cc0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.098+0000 7f7833fff700 1 -- 172.21.15.112:0/3414183358 >> 172.21.15.112:0/3414183358 conn(0x7f782c09abe0 msgr2=0x7f782c0cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:29.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.098+0000 7f7833fff700 1 -- 172.21.15.112:0/3414183358 shutdown_connections 2023-09-12T16:08:29.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.098+0000 7f7833fff700 1 -- 172.21.15.112:0/3414183358 wait complete. 2023-09-12T16:08:29.116 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-12T16:06:48.871680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-12T16:08:29.116 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-12T16:08:29.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.317+0000 7f208f9ff700 1 -- 172.21.15.112:0/89634534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20880cf5b0 msgr2=0x7f20880cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:29.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.317+0000 7f208f9ff700 1 --2- 172.21.15.112:0/89634534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20880cf5b0 0x7f20880cebc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f208808abe0 tx=0x7f2078009c70 comp rx=0 tx=0).stop 2023-09-12T16:08:29.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.318+0000 7f208f9ff700 1 -- 172.21.15.112:0/89634534 shutdown_connections 2023-09-12T16:08:29.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.318+0000 7f208f9ff700 1 --2- 172.21.15.112:0/89634534 >> v2:172.21.15.144:3300/0 conn(0x7f20880cfdb0 0x7f20880d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.318+0000 7f208f9ff700 1 --2- 172.21.15.112:0/89634534 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f208815bca0 0x7f208815cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.318+0000 7f208f9ff700 1 --2- 172.21.15.112:0/89634534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20880cf5b0 0x7f20880cebc0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.318+0000 7f208f9ff700 1 -- 172.21.15.112:0/89634534 >> 172.21.15.112:0/89634534 conn(0x7f20880d17d0 msgr2=0x7f20880d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:29.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.318+0000 7f208f9ff700 1 -- 172.21.15.112:0/89634534 shutdown_connections 2023-09-12T16:08:29.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.318+0000 7f208f9ff700 1 -- 172.21.15.112:0/89634534 wait complete. 2023-09-12T16:08:29.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.320+0000 7f208f9ff700 1 Processor -- start 2023-09-12T16:08:29.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.320+0000 7f208f9ff700 1 -- start start 2023-09-12T16:08:29.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.321+0000 7f208f9ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20880cfdb0 0x7f2088157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:29.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.321+0000 7f208f9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f208815bca0 0x7f20880caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:29.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.321+0000 7f208f9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20880caf40 0x7f2088157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:29.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.321+0000 7f208f9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20880cb3d0 con 0x7f208815bca0 2023-09-12T16:08:29.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.321+0000 7f208f9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2088159550 con 0x7f20880caf40 2023-09-12T16:08:29.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.321+0000 7f208f9ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2088158cb0 con 0x7f20880cfdb0 2023-09-12T16:08:29.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.322+0000 7f208cf9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f208815bca0 0x7f20880caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:29.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.322+0000 7f208cf9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f208815bca0 0x7f20880caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34596/0 (socket says 172.21.15.112:34596) 2023-09-12T16:08:29.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.322+0000 7f208cf9a700 1 -- 172.21.15.112:0/279029139 learned_addr learned my addr 172.21.15.112:0/279029139 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:29.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.322+0000 7f208cf9a700 1 -- 172.21.15.112:0/279029139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20880cfdb0 msgr2=0x7f2088157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:29.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.322+0000 7f208cf9a700 1 --2- 172.21.15.112:0/279029139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20880cfdb0 0x7f2088157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.322+0000 7f208cf9a700 1 -- 172.21.15.112:0/279029139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20880caf40 msgr2=0x7f2088157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:29.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.322+0000 7f208cf9a700 1 --2- 172.21.15.112:0/279029139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20880caf40 0x7f2088157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.322+0000 7f208cf9a700 1 -- 172.21.15.112:0/279029139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20780095f0 con 0x7f208815bca0 2023-09-12T16:08:29.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.322+0000 7f208cf9a700 1 --2- 172.21.15.112:0/279029139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f208815bca0 0x7f20880caa00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f208808a940 tx=0x7f20780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:29.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.323+0000 7f207dffb700 1 -- 172.21.15.112:0/279029139 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207801d070 con 0x7f208815bca0 2023-09-12T16:08:29.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.323+0000 7f207dffb700 1 -- 172.21.15.112:0/279029139 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2078003890 con 0x7f208815bca0 2023-09-12T16:08:29.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.323+0000 7f207dffb700 1 -- 172.21.15.112:0/279029139 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20780045f0 con 0x7f208815bca0 2023-09-12T16:08:29.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.323+0000 7f208f9ff700 1 -- 172.21.15.112:0/279029139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2088158f90 con 0x7f208815bca0 2023-09-12T16:08:29.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.323+0000 7f208f9ff700 1 -- 172.21.15.112:0/279029139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20880c89d0 con 0x7f208815bca0 2023-09-12T16:08:29.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.324+0000 7f208f9ff700 1 -- 172.21.15.112:0/279029139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2088073ea0 con 0x7f208815bca0 2023-09-12T16:08:29.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.325+0000 7f207dffb700 1 -- 172.21.15.112:0/279029139 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f2078003ca0 con 0x7f208815bca0 2023-09-12T16:08:29.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.325+0000 7f207dffb700 1 --2- 172.21.15.112:0/279029139 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f206c06a580 0x7f206c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:29.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.326+0000 7f207dffb700 1 -- 172.21.15.112:0/279029139 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2078089ff0 con 0x7f208815bca0 2023-09-12T16:08:29.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.326+0000 7f208d79b700 1 --2- 172.21.15.112:0/279029139 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f206c06a580 0x7f206c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:29.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.326+0000 7f208d79b700 1 --2- 172.21.15.112:0/279029139 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f206c06a580 0x7f206c06ca40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2084005950 tx=0x7f20840058e0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:29.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.330+0000 7f207dffb700 1 -- 172.21.15.112:0/279029139 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f20780bc9b0 con 0x7f208815bca0 2023-09-12T16:08:29.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.525+0000 7f208f9ff700 1 -- 172.21.15.112:0/279029139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f20880c8bf0 con 0x7f208815bca0 2023-09-12T16:08:29.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.525+0000 7f207dffb700 1 -- 172.21.15.112:0/279029139 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2078055960 con 0x7f208815bca0 2023-09-12T16:08:29.526 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-09-12T16:08:29.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.528+0000 7f208f9ff700 1 -- 172.21.15.112:0/279029139 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f206c06a580 msgr2=0x7f206c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:29.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.528+0000 7f208f9ff700 1 --2- 172.21.15.112:0/279029139 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f206c06a580 0x7f206c06ca40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2084005950 tx=0x7f20840058e0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.528+0000 7f208f9ff700 1 -- 172.21.15.112:0/279029139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f208815bca0 msgr2=0x7f20880caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:29.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.528+0000 7f208f9ff700 1 --2- 172.21.15.112:0/279029139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f208815bca0 0x7f20880caa00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f208808a940 tx=0x7f20780042f0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.528+0000 7f208f9ff700 1 -- 172.21.15.112:0/279029139 shutdown_connections 2023-09-12T16:08:29.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.528+0000 7f208f9ff700 1 --2- 172.21.15.112:0/279029139 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f206c06a580 0x7f206c06ca40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.528+0000 7f208f9ff700 1 --2- 172.21.15.112:0/279029139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20880cfdb0 0x7f2088157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.528+0000 7f208f9ff700 1 --2- 172.21.15.112:0/279029139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20880caf40 0x7f2088157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.528+0000 7f208f9ff700 1 --2- 172.21.15.112:0/279029139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f208815bca0 0x7f20880caa00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.528+0000 7f208f9ff700 1 -- 172.21.15.112:0/279029139 >> 172.21.15.112:0/279029139 conn(0x7f20880d17d0 msgr2=0x7f208815adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:29.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.528+0000 7f208f9ff700 1 -- 172.21.15.112:0/279029139 shutdown_connections 2023-09-12T16:08:29.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.528+0000 7f208f9ff700 1 -- 172.21.15.112:0/279029139 wait complete. 2023-09-12T16:08:29.546 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-12T16:08:29.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.745+0000 7fb769bff700 1 -- 172.21.15.112:0/1481717593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7640d0400 msgr2=0x7fb76415f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:29.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.745+0000 7fb769bff700 1 --2- 172.21.15.112:0/1481717593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7640d0400 0x7fb76415f600 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb76409f880 tx=0x7fb75c00b380 comp rx=0 tx=0).stop 2023-09-12T16:08:29.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.745+0000 7fb769bff700 1 -- 172.21.15.112:0/1481717593 shutdown_connections 2023-09-12T16:08:29.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.745+0000 7fb769bff700 1 --2- 172.21.15.112:0/1481717593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7640d0400 0x7fb76415f600 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.745+0000 7fb769bff700 1 --2- 172.21.15.112:0/1481717593 >> v2:172.21.15.144:3300/0 conn(0x7fb76415ba80 0x7fb7640cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.745+0000 7fb769bff700 1 --2- 172.21.15.112:0/1481717593 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7640cfa10 0x7fb7640cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.745+0000 7fb769bff700 1 -- 172.21.15.112:0/1481717593 >> 172.21.15.112:0/1481717593 conn(0x7fb764088ff0 msgr2=0x7fb7640d1900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:29.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.745+0000 7fb769bff700 1 -- 172.21.15.112:0/1481717593 shutdown_connections 2023-09-12T16:08:29.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.745+0000 7fb769bff700 1 -- 172.21.15.112:0/1481717593 wait complete. 2023-09-12T16:08:29.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.747+0000 7fb769bff700 1 Processor -- start 2023-09-12T16:08:29.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.747+0000 7fb769bff700 1 -- start start 2023-09-12T16:08:29.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.748+0000 7fb769bff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7640cfa10 0x7fb76415e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:29.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.748+0000 7fb769bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7640d0400 0x7fb7640b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:29.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.748+0000 7fb769bff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb76415ba80 0x7fb7640b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:29.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.748+0000 7fb769bff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76415f0b0 con 0x7fb76415ba80 2023-09-12T16:08:29.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.748+0000 7fb769bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7640b7250 con 0x7fb7640d0400 2023-09-12T16:08:29.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.748+0000 7fb769bff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7640c7100 con 0x7fb7640cfa10 2023-09-12T16:08:29.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.748+0000 7fb763fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb76415ba80 0x7fb7640b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:29.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.748+0000 7fb763fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb76415ba80 0x7fb7640b6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34618/0 (socket says 172.21.15.112:34618) 2023-09-12T16:08:29.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.748+0000 7fb763fff700 1 -- 172.21.15.112:0/2038296066 learned_addr learned my addr 172.21.15.112:0/2038296066 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:29.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.748+0000 7fb762ffd700 1 --2- 172.21.15.112:0/2038296066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7640d0400 0x7fb7640b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:29.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.748+0000 7fb7637fe700 1 --2- 172.21.15.112:0/2038296066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7640cfa10 0x7fb76415e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:29.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.748+0000 7fb763fff700 1 -- 172.21.15.112:0/2038296066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7640cfa10 msgr2=0x7fb76415e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:29.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.748+0000 7fb763fff700 1 --2- 172.21.15.112:0/2038296066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7640cfa10 0x7fb76415e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.748+0000 7fb763fff700 1 -- 172.21.15.112:0/2038296066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7640d0400 msgr2=0x7fb7640b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:29.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.748+0000 7fb763fff700 1 --2- 172.21.15.112:0/2038296066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7640d0400 0x7fb7640b5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.748+0000 7fb763fff700 1 -- 172.21.15.112:0/2038296066 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c009d00 con 0x7fb76415ba80 2023-09-12T16:08:29.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.748+0000 7fb762ffd700 1 --2- 172.21.15.112:0/2038296066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7640d0400 0x7fb7640b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:29.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.748+0000 7fb7637fe700 1 --2- 172.21.15.112:0/2038296066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7640cfa10 0x7fb76415e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:29.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.749+0000 7fb763fff700 1 --2- 172.21.15.112:0/2038296066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb76415ba80 0x7fb7640b6090 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb76408b8d0 tx=0x7fb75c007c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:29.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.749+0000 7fb74bfff700 1 -- 172.21.15.112:0/2038296066 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c00e040 con 0x7fb76415ba80 2023-09-12T16:08:29.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.749+0000 7fb74bfff700 1 -- 172.21.15.112:0/2038296066 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb75c01d890 con 0x7fb76415ba80 2023-09-12T16:08:29.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.749+0000 7fb74bfff700 1 -- 172.21.15.112:0/2038296066 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c01dce0 con 0x7fb76415ba80 2023-09-12T16:08:29.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.749+0000 7fb769bff700 1 -- 172.21.15.112:0/2038296066 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7640b6920 con 0x7fb76415ba80 2023-09-12T16:08:29.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.749+0000 7fb769bff700 1 -- 172.21.15.112:0/2038296066 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7640b6ee0 con 0x7fb76415ba80 2023-09-12T16:08:29.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.750+0000 7fb769bff700 1 -- 172.21.15.112:0/2038296066 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb76404e300 con 0x7fb76415ba80 2023-09-12T16:08:29.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.751+0000 7fb74bfff700 1 -- 172.21.15.112:0/2038296066 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fb75c01b450 con 0x7fb76415ba80 2023-09-12T16:08:29.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.752+0000 7fb74bfff700 1 --2- 172.21.15.112:0/2038296066 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb75006a580 0x7fb75006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:29.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.752+0000 7fb74bfff700 1 -- 172.21.15.112:0/2038296066 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb75c08a820 con 0x7fb76415ba80 2023-09-12T16:08:29.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.752+0000 7fb7637fe700 1 --2- 172.21.15.112:0/2038296066 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb75006a580 0x7fb75006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:29.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.753+0000 7fb7637fe700 1 --2- 172.21.15.112:0/2038296066 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb75006a580 0x7fb75006ca40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb754005d30 tx=0x7fb754009530 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:29.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.757+0000 7fb74bfff700 1 -- 172.21.15.112:0/2038296066 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb75c056040 con 0x7fb76415ba80 2023-09-12T16:08:29.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.953+0000 7fb769bff700 1 -- 172.21.15.112:0/2038296066 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb7640cbc30 con 0x7fb76415ba80 2023-09-12T16:08:29.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.954+0000 7fb74bfff700 1 -- 172.21.15.112:0/2038296066 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb75c021020 con 0x7fb76415ba80 2023-09-12T16:08:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:29.955 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2023-09-12T16:08:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-09-12T16:08:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2023-09-12T16:08:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2023-09-12T16:08:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-09-12T16:08:29.956 INFO:teuthology.orchestra.run.smithi112.stdout:] 2023-09-12T16:08:29.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.956+0000 7fb769bff700 1 -- 172.21.15.112:0/2038296066 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb75006a580 msgr2=0x7fb75006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:29.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.956+0000 7fb769bff700 1 --2- 172.21.15.112:0/2038296066 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb75006a580 0x7fb75006ca40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb754005d30 tx=0x7fb754009530 comp rx=0 tx=0).stop 2023-09-12T16:08:29.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.956+0000 7fb769bff700 1 -- 172.21.15.112:0/2038296066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb76415ba80 msgr2=0x7fb7640b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:29.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.956+0000 7fb769bff700 1 --2- 172.21.15.112:0/2038296066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb76415ba80 0x7fb7640b6090 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb76408b8d0 tx=0x7fb75c007c10 comp rx=0 tx=0).stop 2023-09-12T16:08:29.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.956+0000 7fb769bff700 1 -- 172.21.15.112:0/2038296066 shutdown_connections 2023-09-12T16:08:29.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.956+0000 7fb769bff700 1 --2- 172.21.15.112:0/2038296066 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb75006a580 0x7fb75006ca40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.956+0000 7fb769bff700 1 --2- 172.21.15.112:0/2038296066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7640cfa10 0x7fb76415e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.956+0000 7fb769bff700 1 --2- 172.21.15.112:0/2038296066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb76415ba80 0x7fb7640b6090 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.956+0000 7fb769bff700 1 --2- 172.21.15.112:0/2038296066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7640d0400 0x7fb7640b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:29.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.956+0000 7fb769bff700 1 -- 172.21.15.112:0/2038296066 >> 172.21.15.112:0/2038296066 conn(0x7fb764088ff0 msgr2=0x7fb7640ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:29.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.956+0000 7fb769bff700 1 -- 172.21.15.112:0/2038296066 shutdown_connections 2023-09-12T16:08:29.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:29.956+0000 7fb769bff700 1 -- 172.21.15.112:0/2038296066 wait complete. 2023-09-12T16:08:29.974 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-12T16:08:29.974 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-12T16:08:30.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.179+0000 7fdfae5ff700 1 -- 172.21.15.112:0/1752367317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf90005210 msgr2=0x7fdf9000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:30.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.179+0000 7fdfae5ff700 1 --2- 172.21.15.112:0/1752367317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf90005210 0x7fdf9000ba10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0009db0 tx=0x7fdf90005880 comp rx=0 tx=0).stop 2023-09-12T16:08:30.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.180+0000 7fdfae5ff700 1 -- 172.21.15.112:0/1752367317 shutdown_connections 2023-09-12T16:08:30.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.180+0000 7fdfae5ff700 1 --2- 172.21.15.112:0/1752367317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf90005210 0x7fdf9000ba10 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:30.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.180+0000 7fdfae5ff700 1 -- 172.21.15.112:0/1752367317 >> 172.21.15.112:0/1752367317 conn(0x7fdfa80d17d0 msgr2=0x7fdfa80d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:30.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.180+0000 7fdfae5ff700 1 -- 172.21.15.112:0/1752367317 shutdown_connections 2023-09-12T16:08:30.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.180+0000 7fdfae5ff700 1 -- 172.21.15.112:0/1752367317 wait complete. 2023-09-12T16:08:30.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.181+0000 7fdfae5ff700 1 Processor -- start 2023-09-12T16:08:30.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.181+0000 7fdfae5ff700 1 -- start start 2023-09-12T16:08:30.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.182+0000 7fdfae5ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf90005210 0x7fdfa80c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:30.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.182+0000 7fdfae5ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfa8158d10 0x7fdfa814cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:30.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.182+0000 7fdfae5ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfa80af5c0 0x7fdfa80afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:30.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.182+0000 7fdfae5ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa814d160 con 0x7fdfa80af5c0 2023-09-12T16:08:30.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.182+0000 7fdfae5ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa80aff90 con 0x7fdfa8158d10 2023-09-12T16:08:30.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.182+0000 7fdfae5ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa81f5100 con 0x7fdf90005210 2023-09-12T16:08:30.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.183+0000 7fdfacb9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfa80af5c0 0x7fdfa80afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:30.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.183+0000 7fdfacb9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfa80af5c0 0x7fdfa80afa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34644/0 (socket says 172.21.15.112:34644) 2023-09-12T16:08:30.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.183+0000 7fdfacb9c700 1 -- 172.21.15.112:0/2604600415 learned_addr learned my addr 172.21.15.112:0/2604600415 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:30.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.183+0000 7fdfa77fe700 1 --2- 172.21.15.112:0/2604600415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfa8158d10 0x7fdfa814cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:30.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.183+0000 7fdfa7fff700 1 --2- 172.21.15.112:0/2604600415 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf90005210 0x7fdfa80c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:30.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.183+0000 7fdfacb9c700 1 -- 172.21.15.112:0/2604600415 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf90005210 msgr2=0x7fdfa80c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:30.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.183+0000 7fdfacb9c700 1 --2- 172.21.15.112:0/2604600415 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf90005210 0x7fdfa80c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:30.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.183+0000 7fdfacb9c700 1 -- 172.21.15.112:0/2604600415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfa8158d10 msgr2=0x7fdfa814cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:30.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.183+0000 7fdfacb9c700 1 --2- 172.21.15.112:0/2604600415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfa8158d10 0x7fdfa814cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:30.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.183+0000 7fdfacb9c700 1 -- 172.21.15.112:0/2604600415 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa81f53e0 con 0x7fdfa80af5c0 2023-09-12T16:08:30.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.183+0000 7fdfa77fe700 1 --2- 172.21.15.112:0/2604600415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfa8158d10 0x7fdfa814cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:30.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.183+0000 7fdfa7fff700 1 --2- 172.21.15.112:0/2604600415 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf90005210 0x7fdfa80c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:30.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.183+0000 7fdfacb9c700 1 --2- 172.21.15.112:0/2604600415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfa80af5c0 0x7fdfa80afa50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdfa808abe0 tx=0x7fdfa0013d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:30.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.184+0000 7fdfa4ff9700 1 -- 172.21.15.112:0/2604600415 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0006000 con 0x7fdfa80af5c0 2023-09-12T16:08:30.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.184+0000 7fdfa4ff9700 1 -- 172.21.15.112:0/2604600415 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdfa001c840 con 0x7fdfa80af5c0 2023-09-12T16:08:30.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.184+0000 7fdfae5ff700 1 -- 172.21.15.112:0/2604600415 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa81f56c0 con 0x7fdfa80af5c0 2023-09-12T16:08:30.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.184+0000 7fdfa4ff9700 1 -- 172.21.15.112:0/2604600415 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa001cc50 con 0x7fdfa80af5c0 2023-09-12T16:08:30.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.184+0000 7fdfae5ff700 1 -- 172.21.15.112:0/2604600415 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa81f5c80 con 0x7fdfa80af5c0 2023-09-12T16:08:30.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.185+0000 7fdfae5ff700 1 -- 172.21.15.112:0/2604600415 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa81f5e70 con 0x7fdfa80af5c0 2023-09-12T16:08:30.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.186+0000 7fdfa4ff9700 1 -- 172.21.15.112:0/2604600415 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fdfa001a040 con 0x7fdfa80af5c0 2023-09-12T16:08:30.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.187+0000 7fdfa4ff9700 1 --2- 172.21.15.112:0/2604600415 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdf9406a580 0x7fdf9406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:30.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.187+0000 7fdfa4ff9700 1 -- 172.21.15.112:0/2604600415 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fdfa0089910 con 0x7fdfa80af5c0 2023-09-12T16:08:30.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.187+0000 7fdfa7fff700 1 --2- 172.21.15.112:0/2604600415 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdf9406a580 0x7fdf9406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:30.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.188+0000 7fdfa7fff700 1 --2- 172.21.15.112:0/2604600415 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdf9406a580 0x7fdf9406ca40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdf980017a0 tx=0x7fdf98000fc0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:30.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.191+0000 7fdfa4ff9700 1 -- 172.21.15.112:0/2604600415 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fdfa0055090 con 0x7fdfa80af5c0 2023-09-12T16:08:30.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:30.389+0000 7fdfae5ff700 1 -- 172.21.15.112:0/2604600415 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fdfa8073ea0 con 0x7fdfa80af5c0 2023-09-12T16:08:31.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.076+0000 7fdfa4ff9700 1 -- 172.21.15.112:0/2604600415 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7fdfa002a0b0 con 0x7fdfa80af5c0 2023-09-12T16:08:31.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.081+0000 7fdfae5ff700 1 -- 172.21.15.112:0/2604600415 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdf9406a580 msgr2=0x7fdf9406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:31.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.081+0000 7fdfae5ff700 1 --2- 172.21.15.112:0/2604600415 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdf9406a580 0x7fdf9406ca40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdf980017a0 tx=0x7fdf98000fc0 comp rx=0 tx=0).stop 2023-09-12T16:08:31.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.081+0000 7fdfae5ff700 1 -- 172.21.15.112:0/2604600415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfa80af5c0 msgr2=0x7fdfa80afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:31.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.081+0000 7fdfae5ff700 1 --2- 172.21.15.112:0/2604600415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfa80af5c0 0x7fdfa80afa50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdfa808abe0 tx=0x7fdfa0013d60 comp rx=0 tx=0).stop 2023-09-12T16:08:31.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.082+0000 7fdfae5ff700 1 -- 172.21.15.112:0/2604600415 shutdown_connections 2023-09-12T16:08:31.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.082+0000 7fdfae5ff700 1 --2- 172.21.15.112:0/2604600415 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fdf9406a580 0x7fdf9406ca40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:31.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.082+0000 7fdfae5ff700 1 --2- 172.21.15.112:0/2604600415 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf90005210 0x7fdfa80c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:31.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.082+0000 7fdfae5ff700 1 --2- 172.21.15.112:0/2604600415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfa80af5c0 0x7fdfa80afa50 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:31.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.082+0000 7fdfae5ff700 1 --2- 172.21.15.112:0/2604600415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfa8158d10 0x7fdfa814cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:31.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.082+0000 7fdfae5ff700 1 -- 172.21.15.112:0/2604600415 >> 172.21.15.112:0/2604600415 conn(0x7fdfa80d17d0 msgr2=0x7fdfa80cacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:31.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.082+0000 7fdfae5ff700 1 -- 172.21.15.112:0/2604600415 shutdown_connections 2023-09-12T16:08:31.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.082+0000 7fdfae5ff700 1 -- 172.21.15.112:0/2604600415 wait complete. 2023-09-12T16:08:31.086 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2023-09-12T16:08:31.107 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-12T16:08:31.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.317+0000 7f07e7dff700 1 -- 172.21.15.112:0/1191501240 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07cc005210 msgr2=0x7f07cc00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:31.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.317+0000 7f07e7dff700 1 --2- 172.21.15.112:0/1191501240 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07cc005210 0x7f07cc00ba10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f07d800e470 tx=0x7f07cc005880 comp rx=0 tx=0).stop 2023-09-12T16:08:31.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.317+0000 7f07e639c700 1 -- 172.21.15.112:0/1191501240 reap_dead start 2023-09-12T16:08:31.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.317+0000 7f07e7dff700 1 -- 172.21.15.112:0/1191501240 shutdown_connections 2023-09-12T16:08:31.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.317+0000 7f07e7dff700 1 -- 172.21.15.112:0/1191501240 >> 172.21.15.112:0/1191501240 conn(0x7f07e008b190 msgr2=0x7f07e009aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:31.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.317+0000 7f07e7dff700 1 -- 172.21.15.112:0/1191501240 shutdown_connections 2023-09-12T16:08:31.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.317+0000 7f07e7dff700 1 -- 172.21.15.112:0/1191501240 wait complete. 2023-09-12T16:08:31.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.319+0000 7f07e7dff700 1 Processor -- start 2023-09-12T16:08:31.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.319+0000 7f07e7dff700 1 -- start start 2023-09-12T16:08:31.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.320+0000 7f07e7dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07cc005210 0x7f07e00c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:31.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.320+0000 7f07e7dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07e01f1ac0 0x7f07e00ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:31.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.320+0000 7f07e7dff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07e00c5cc0 0x7f07e006b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:31.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.320+0000 7f07e7dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e01f1f40 con 0x7f07e01f1ac0 2023-09-12T16:08:31.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.320+0000 7f07e7dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e0154820 con 0x7f07cc005210 2023-09-12T16:08:31.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.320+0000 7f07e7dff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e00c6c20 con 0x7f07e00c5cc0 2023-09-12T16:08:31.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.320+0000 7f07e539a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07e01f1ac0 0x7f07e00ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:31.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.320+0000 7f07e539a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07e01f1ac0 0x7f07e00ca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34658/0 (socket says 172.21.15.112:34658) 2023-09-12T16:08:31.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.320+0000 7f07e539a700 1 -- 172.21.15.112:0/25558881 learned_addr learned my addr 172.21.15.112:0/25558881 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:31.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.320+0000 7f07e5b9b700 1 --2- 172.21.15.112:0/25558881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07cc005210 0x7f07e00c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:31.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.321+0000 7f07e639c700 1 --2- 172.21.15.112:0/25558881 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07e00c5cc0 0x7f07e006b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:31.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.321+0000 7f07e539a700 1 -- 172.21.15.112:0/25558881 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07e00c5cc0 msgr2=0x7f07e006b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:31.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.321+0000 7f07e539a700 1 --2- 172.21.15.112:0/25558881 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07e00c5cc0 0x7f07e006b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:31.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.321+0000 7f07e539a700 1 -- 172.21.15.112:0/25558881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07cc005210 msgr2=0x7f07e00c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:31.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.321+0000 7f07e539a700 1 --2- 172.21.15.112:0/25558881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07cc005210 0x7f07e00c6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:31.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.321+0000 7f07e539a700 1 -- 172.21.15.112:0/25558881 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e00c6f00 con 0x7f07e01f1ac0 2023-09-12T16:08:31.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.321+0000 7f07e639c700 1 --2- 172.21.15.112:0/25558881 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07e00c5cc0 0x7f07e006b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:31.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.321+0000 7f07e539a700 1 --2- 172.21.15.112:0/25558881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07e01f1ac0 0x7f07e00ca440 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f07d00066b0 tx=0x7f07d0003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:31.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.321+0000 7f07d67fc700 1 -- 172.21.15.112:0/25558881 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d0011900 con 0x7f07e01f1ac0 2023-09-12T16:08:31.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.321+0000 7f07d67fc700 1 -- 172.21.15.112:0/25558881 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f07d0011a60 con 0x7f07e01f1ac0 2023-09-12T16:08:31.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.321+0000 7f07e7dff700 1 -- 172.21.15.112:0/25558881 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e00c54c0 con 0x7f07e01f1ac0 2023-09-12T16:08:31.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.321+0000 7f07d67fc700 1 -- 172.21.15.112:0/25558881 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d0011e70 con 0x7f07e01f1ac0 2023-09-12T16:08:31.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.321+0000 7f07e7dff700 1 -- 172.21.15.112:0/25558881 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e00ca980 con 0x7f07e01f1ac0 2023-09-12T16:08:31.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.322+0000 7f07e7dff700 1 -- 172.21.15.112:0/25558881 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e00c7140 con 0x7f07e01f1ac0 2023-09-12T16:08:31.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.323+0000 7f07d67fc700 1 -- 172.21.15.112:0/25558881 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f07d00103c0 con 0x7f07e01f1ac0 2023-09-12T16:08:31.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.324+0000 7f07d67fc700 1 --2- 172.21.15.112:0/25558881 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f07c406a580 0x7f07c406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:31.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.324+0000 7f07d67fc700 1 -- 172.21.15.112:0/25558881 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f07d0089b90 con 0x7f07e01f1ac0 2023-09-12T16:08:31.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.324+0000 7f07e5b9b700 1 --2- 172.21.15.112:0/25558881 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f07c406a580 0x7f07c406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:31.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.325+0000 7f07e5b9b700 1 --2- 172.21.15.112:0/25558881 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f07c406a580 0x7f07c406ca40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f07dc000fb0 tx=0x7f07dc000f40 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:31.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.329+0000 7f07d67fc700 1 -- 172.21.15.112:0/25558881 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f07e00c7140 con 0x7f07e01f1ac0 2023-09-12T16:08:31.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:31.524+0000 7f07e7dff700 1 -- 172.21.15.112:0/25558881 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f07e00c7140 con 0x7f07e01f1ac0 2023-09-12T16:08:32.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.079+0000 7f07d67fc700 1 -- 172.21.15.112:0/25558881 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7f07e00c7140 con 0x7f07e01f1ac0 2023-09-12T16:08:32.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.083+0000 7f07e7dff700 1 -- 172.21.15.112:0/25558881 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f07c406a580 msgr2=0x7f07c406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:32.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.083+0000 7f07e7dff700 1 --2- 172.21.15.112:0/25558881 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f07c406a580 0x7f07c406ca40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f07dc000fb0 tx=0x7f07dc000f40 comp rx=0 tx=0).stop 2023-09-12T16:08:32.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.083+0000 7f07e7dff700 1 -- 172.21.15.112:0/25558881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07e01f1ac0 msgr2=0x7f07e00ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:32.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.083+0000 7f07e7dff700 1 --2- 172.21.15.112:0/25558881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07e01f1ac0 0x7f07e00ca440 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f07d00066b0 tx=0x7f07d0003960 comp rx=0 tx=0).stop 2023-09-12T16:08:32.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.084+0000 7f07e7dff700 1 -- 172.21.15.112:0/25558881 shutdown_connections 2023-09-12T16:08:32.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.084+0000 7f07e7dff700 1 --2- 172.21.15.112:0/25558881 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f07c406a580 0x7f07c406ca40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:32.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.084+0000 7f07e7dff700 1 --2- 172.21.15.112:0/25558881 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07e00c5cc0 0x7f07e006b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:32.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.084+0000 7f07e7dff700 1 --2- 172.21.15.112:0/25558881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07cc005210 0x7f07e00c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:32.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.084+0000 7f07e7dff700 1 --2- 172.21.15.112:0/25558881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07e01f1ac0 0x7f07e00ca440 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:32.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.084+0000 7f07e7dff700 1 -- 172.21.15.112:0/25558881 >> 172.21.15.112:0/25558881 conn(0x7f07e008b190 msgr2=0x7f07e00ceb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:32.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.085+0000 7f07e7dff700 1 -- 172.21.15.112:0/25558881 shutdown_connections 2023-09-12T16:08:32.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.086+0000 7f07e7dff700 1 -- 172.21.15.112:0/25558881 wait complete. 2023-09-12T16:08:32.098 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2023-09-12T16:08:32.119 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-12T16:08:32.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.321+0000 7f94a359d700 1 -- 172.21.15.112:0/2154123185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9488003f80 msgr2=0x7f9488004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:32.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.322+0000 7f94a359d700 1 --2- 172.21.15.112:0/2154123185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9488003f80 0x7f9488004850 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f948c00c2e0 tx=0x7f9488005880 comp rx=0 tx=0).stop 2023-09-12T16:08:32.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.322+0000 7f94a2d9c700 1 -- 172.21.15.112:0/2154123185 reap_dead start 2023-09-12T16:08:32.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.322+0000 7f94a359d700 1 -- 172.21.15.112:0/2154123185 shutdown_connections 2023-09-12T16:08:32.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.322+0000 7f94a359d700 1 -- 172.21.15.112:0/2154123185 >> 172.21.15.112:0/2154123185 conn(0x7f949c071930 msgr2=0x7f949c071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:32.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.322+0000 7f94a359d700 1 -- 172.21.15.112:0/2154123185 shutdown_connections 2023-09-12T16:08:32.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.322+0000 7f94a359d700 1 -- 172.21.15.112:0/2154123185 wait complete. 2023-09-12T16:08:32.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.324+0000 7f94a359d700 1 Processor -- start 2023-09-12T16:08:32.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.324+0000 7f94a359d700 1 -- start start 2023-09-12T16:08:32.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.325+0000 7f94a359d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9488003f80 0x7f949c1f0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:32.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.325+0000 7f94a359d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f949c0caac0 0x7f949c0ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:32.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.325+0000 7f94a359d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f949c0caf40 0x7f949c0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:32.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.326+0000 7f94a359d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c0c5db0 con 0x7f949c0caac0 2023-09-12T16:08:32.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.326+0000 7f94a359d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c1f1390 con 0x7f949c0caf40 2023-09-12T16:08:32.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.326+0000 7f94a359d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949c0c51a0 con 0x7f9488003f80 2023-09-12T16:08:32.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.326+0000 7f94a1d9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f949c0caac0 0x7f949c0ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:32.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.326+0000 7f94a1d9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f949c0caac0 0x7f949c0ce2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34676/0 (socket says 172.21.15.112:34676) 2023-09-12T16:08:32.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.326+0000 7f94a1d9a700 1 -- 172.21.15.112:0/4161947063 learned_addr learned my addr 172.21.15.112:0/4161947063 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:32.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.326+0000 7f94a2d9c700 1 --2- 172.21.15.112:0/4161947063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f949c0caf40 0x7f949c0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:32.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.326+0000 7f94a259b700 1 --2- 172.21.15.112:0/4161947063 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9488003f80 0x7f949c1f0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:32.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.326+0000 7f94a1d9a700 1 -- 172.21.15.112:0/4161947063 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9488003f80 msgr2=0x7f949c1f0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:32.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.326+0000 7f94a1d9a700 1 --2- 172.21.15.112:0/4161947063 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9488003f80 0x7f949c1f0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:32.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.326+0000 7f94a1d9a700 1 -- 172.21.15.112:0/4161947063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f949c0caf40 msgr2=0x7f949c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:32.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.326+0000 7f94a1d9a700 1 --2- 172.21.15.112:0/4161947063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f949c0caf40 0x7f949c0ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:32.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.326+0000 7f94a1d9a700 1 -- 172.21.15.112:0/4161947063 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c0c5480 con 0x7f949c0caac0 2023-09-12T16:08:32.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.326+0000 7f94a1d9a700 1 --2- 172.21.15.112:0/4161947063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f949c0caac0 0x7f949c0ce2e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f948c000c00 tx=0x7f948c000fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:32.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.327+0000 7f9492ffd700 1 -- 172.21.15.112:0/4161947063 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c006560 con 0x7f949c0caac0 2023-09-12T16:08:32.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.327+0000 7f9492ffd700 1 -- 172.21.15.112:0/4161947063 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f948c003680 con 0x7f949c0caac0 2023-09-12T16:08:32.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.327+0000 7f94a359d700 1 -- 172.21.15.112:0/4161947063 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949c0c5760 con 0x7f949c0caac0 2023-09-12T16:08:32.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.327+0000 7f9492ffd700 1 -- 172.21.15.112:0/4161947063 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c003a90 con 0x7f949c0caac0 2023-09-12T16:08:32.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.327+0000 7f94a359d700 1 -- 172.21.15.112:0/4161947063 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949c0c4e50 con 0x7f949c0caac0 2023-09-12T16:08:32.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.328+0000 7f94a359d700 1 -- 172.21.15.112:0/4161947063 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949c0c5f20 con 0x7f949c0caac0 2023-09-12T16:08:32.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.329+0000 7f9492ffd700 1 -- 172.21.15.112:0/4161947063 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f948c022070 con 0x7f949c0caac0 2023-09-12T16:08:32.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.330+0000 7f9492ffd700 1 --2- 172.21.15.112:0/4161947063 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f948006a5b0 0x7f948006ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:32.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.330+0000 7f9492ffd700 1 -- 172.21.15.112:0/4161947063 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f948c08ab10 con 0x7f949c0caac0 2023-09-12T16:08:32.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.330+0000 7f94a259b700 1 --2- 172.21.15.112:0/4161947063 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f948006a5b0 0x7f948006ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:32.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.331+0000 7f94a259b700 1 --2- 172.21.15.112:0/4161947063 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f948006a5b0 0x7f948006ca70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9498009c60 tx=0x7f9498009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:32.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.335+0000 7f9492ffd700 1 -- 172.21.15.112:0/4161947063 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f948c055fa0 con 0x7f949c0caac0 2023-09-12T16:08:32.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:32.571+0000 7f94a359d700 1 -- 172.21.15.112:0/4161947063 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f949c04eb50 con 0x7f949c0caac0 2023-09-12T16:08:33.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.108+0000 7f9492ffd700 1 -- 172.21.15.112:0/4161947063 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f948c02a020 con 0x7f949c0caac0 2023-09-12T16:08:33.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.121+0000 7f94a359d700 1 -- 172.21.15.112:0/4161947063 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f948006a5b0 msgr2=0x7f948006ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:33.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.121+0000 7f94a359d700 1 --2- 172.21.15.112:0/4161947063 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f948006a5b0 0x7f948006ca70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9498009c60 tx=0x7f9498009260 comp rx=0 tx=0).stop 2023-09-12T16:08:33.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.121+0000 7f94a359d700 1 -- 172.21.15.112:0/4161947063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f949c0caac0 msgr2=0x7f949c0ce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:33.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.121+0000 7f94a359d700 1 --2- 172.21.15.112:0/4161947063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f949c0caac0 0x7f949c0ce2e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f948c000c00 tx=0x7f948c000fc0 comp rx=0 tx=0).stop 2023-09-12T16:08:33.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.121+0000 7f94a359d700 1 -- 172.21.15.112:0/4161947063 shutdown_connections 2023-09-12T16:08:33.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.121+0000 7f94a359d700 1 --2- 172.21.15.112:0/4161947063 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f948006a5b0 0x7f948006ca70 secure :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9498009c60 tx=0x7f9498009260 comp rx=0 tx=0).stop 2023-09-12T16:08:33.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.121+0000 7f94a359d700 1 --2- 172.21.15.112:0/4161947063 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9488003f80 0x7f949c1f0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:33.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.121+0000 7f94a359d700 1 --2- 172.21.15.112:0/4161947063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f949c0caf40 0x7f949c0ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:33.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.121+0000 7f94a359d700 1 --2- 172.21.15.112:0/4161947063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f949c0caac0 0x7f949c0ce2e0 secure :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f948c000c00 tx=0x7f948c000fc0 comp rx=0 tx=0).stop 2023-09-12T16:08:33.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.121+0000 7f94a359d700 1 -- 172.21.15.112:0/4161947063 >> 172.21.15.112:0/4161947063 conn(0x7f949c071930 msgr2=0x7f949c14f680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:33.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.125+0000 7f94a359d700 1 -- 172.21.15.112:0/4161947063 shutdown_connections 2023-09-12T16:08:33.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.127+0000 7f94a359d700 1 -- 172.21.15.112:0/4161947063 wait complete. 2023-09-12T16:08:33.129 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 5 and data pool 6 2023-09-12T16:08:33.148 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:08:33.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.348+0000 7f6bad5ff700 1 -- 172.21.15.112:0/1736652552 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba80b28f0 msgr2=0x7f6ba80cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:33.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.348+0000 7f6bad5ff700 1 --2- 172.21.15.112:0/1736652552 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba80b28f0 0x7f6ba80cd3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009fd0 tx=0x7f6ba000b380 comp rx=0 tx=0).stop 2023-09-12T16:08:33.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.348+0000 7f6bad5ff700 1 -- 172.21.15.112:0/1736652552 shutdown_connections 2023-09-12T16:08:33.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.348+0000 7f6bad5ff700 1 --2- 172.21.15.112:0/1736652552 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba80b28f0 0x7f6ba80cd3c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:33.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.348+0000 7f6bad5ff700 1 --2- 172.21.15.112:0/1736652552 >> v2:172.21.15.144:3300/0 conn(0x7f6ba815f480 0x7f6ba80cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:33.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.348+0000 7f6bad5ff700 1 -- 172.21.15.112:0/1736652552 >> 172.21.15.112:0/1736652552 conn(0x7f6ba80d1930 msgr2=0x7f6ba80d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:33.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.348+0000 7f6bad5ff700 1 -- 172.21.15.112:0/1736652552 shutdown_connections 2023-09-12T16:08:33.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.348+0000 7f6bad5ff700 1 -- 172.21.15.112:0/1736652552 wait complete. 2023-09-12T16:08:33.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.350+0000 7f6bad5ff700 1 Processor -- start 2023-09-12T16:08:33.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.351+0000 7f6bad5ff700 1 -- start start 2023-09-12T16:08:33.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.352+0000 7f6bad5ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ba80b28f0 0x7f6ba8156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:33.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.352+0000 7f6bad5ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba80cdfb0 0x7f6ba815cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:33.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.352+0000 7f6bad5ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba815f480 0x7f6ba8157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:33.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.352+0000 7f6bad5ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80c92a0 con 0x7f6ba80b28f0 2023-09-12T16:08:33.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.352+0000 7f6bad5ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba8156fa0 con 0x7f6ba815f480 2023-09-12T16:08:33.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.352+0000 7f6bad5ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba815d8e0 con 0x7f6ba80cdfb0 2023-09-12T16:08:33.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.352+0000 7f6ba6ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ba80b28f0 0x7f6ba8156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:33.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.352+0000 7f6ba6ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ba80b28f0 0x7f6ba8156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34690/0 (socket says 172.21.15.112:34690) 2023-09-12T16:08:33.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.352+0000 7f6ba6ffd700 1 -- 172.21.15.112:0/1108771980 learned_addr learned my addr 172.21.15.112:0/1108771980 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:33.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.353+0000 7f6ba67fc700 1 --2- 172.21.15.112:0/1108771980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba80cdfb0 0x7f6ba815cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:33.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.353+0000 7f6ba77fe700 1 --2- 172.21.15.112:0/1108771980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba815f480 0x7f6ba8157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:33.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.353+0000 7f6ba6ffd700 1 -- 172.21.15.112:0/1108771980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba80cdfb0 msgr2=0x7f6ba815cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:33.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.353+0000 7f6ba6ffd700 1 --2- 172.21.15.112:0/1108771980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba80cdfb0 0x7f6ba815cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:33.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.353+0000 7f6ba6ffd700 1 -- 172.21.15.112:0/1108771980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba815f480 msgr2=0x7f6ba8157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:33.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.353+0000 7f6ba6ffd700 1 --2- 172.21.15.112:0/1108771980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba815f480 0x7f6ba8157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:33.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.353+0000 7f6ba6ffd700 1 -- 172.21.15.112:0/1108771980 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba0009d00 con 0x7f6ba80b28f0 2023-09-12T16:08:33.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.353+0000 7f6ba77fe700 1 --2- 172.21.15.112:0/1108771980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba815f480 0x7f6ba8157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:33.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.353+0000 7f6ba67fc700 1 --2- 172.21.15.112:0/1108771980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba80cdfb0 0x7f6ba815cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:33.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.353+0000 7f6ba6ffd700 1 --2- 172.21.15.112:0/1108771980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ba80b28f0 0x7f6ba8156a60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800e9f0 tx=0x7f6b9800edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:33.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.353+0000 7f6b8f7fe700 1 -- 172.21.15.112:0/1108771980 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9800cbd0 con 0x7f6ba80b28f0 2023-09-12T16:08:33.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.353+0000 7f6b8f7fe700 1 -- 172.21.15.112:0/1108771980 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6b9800ce20 con 0x7f6ba80b28f0 2023-09-12T16:08:33.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.353+0000 7f6b8f7fe700 1 -- 172.21.15.112:0/1108771980 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b98010690 con 0x7f6ba80b28f0 2023-09-12T16:08:33.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.353+0000 7f6bad5ff700 1 -- 172.21.15.112:0/1108771980 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba80c8970 con 0x7f6ba80b28f0 2023-09-12T16:08:33.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.353+0000 7f6bad5ff700 1 -- 172.21.15.112:0/1108771980 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba80c8f30 con 0x7f6ba80b28f0 2023-09-12T16:08:33.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.354+0000 7f6bad5ff700 1 -- 172.21.15.112:0/1108771980 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba804e300 con 0x7f6ba80b28f0 2023-09-12T16:08:33.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.355+0000 7f6b8f7fe700 1 -- 172.21.15.112:0/1108771980 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f6b980107f0 con 0x7f6ba80b28f0 2023-09-12T16:08:33.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.356+0000 7f6b8f7fe700 1 --2- 172.21.15.112:0/1108771980 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6b9406a580 0x7f6b9406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:33.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.356+0000 7f6b8f7fe700 1 -- 172.21.15.112:0/1108771980 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6b98014070 con 0x7f6ba80b28f0 2023-09-12T16:08:33.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.356+0000 7f6ba67fc700 1 --2- 172.21.15.112:0/1108771980 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6b9406a580 0x7f6b9406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:33.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.357+0000 7f6ba67fc700 1 --2- 172.21.15.112:0/1108771980 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6b9406a580 0x7f6b9406ca40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6ba815ba80 tx=0x7f6b9c009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:33.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.360+0000 7f6b8f7fe700 1 -- 172.21.15.112:0/1108771980 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6b980519b0 con 0x7f6ba80b28f0 2023-09-12T16:08:33.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.559+0000 7f6bad5ff700 1 -- 172.21.15.112:0/1108771980 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ba80b4300 con 0x7f6ba80b28f0 2023-09-12T16:08:33.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.561+0000 7f6b8f7fe700 1 -- 172.21.15.112:0/1108771980 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16823 (secure 0 0 0) 0x7f6b98054a80 con 0x7f6ba80b28f0 2023-09-12T16:08:33.561 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:33.561 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":37,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:08:32.573060+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:08:30.428559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-12T16:08:31.564145+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:08:33.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.563+0000 7f6bad5ff700 1 -- 172.21.15.112:0/1108771980 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6b9406a580 msgr2=0x7f6b9406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:33.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.563+0000 7f6bad5ff700 1 --2- 172.21.15.112:0/1108771980 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6b9406a580 0x7f6b9406ca40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6ba815ba80 tx=0x7f6b9c009040 comp rx=0 tx=0).stop 2023-09-12T16:08:33.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.563+0000 7f6bad5ff700 1 -- 172.21.15.112:0/1108771980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ba80b28f0 msgr2=0x7f6ba8156a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:33.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.563+0000 7f6bad5ff700 1 --2- 172.21.15.112:0/1108771980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ba80b28f0 0x7f6ba8156a60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800e9f0 tx=0x7f6b9800edb0 comp rx=0 tx=0).stop 2023-09-12T16:08:33.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.563+0000 7f6bad5ff700 1 -- 172.21.15.112:0/1108771980 shutdown_connections 2023-09-12T16:08:33.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.563+0000 7f6bad5ff700 1 --2- 172.21.15.112:0/1108771980 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f6b9406a580 0x7f6b9406ca40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:33.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.563+0000 7f6bad5ff700 1 --2- 172.21.15.112:0/1108771980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba815f480 0x7f6ba8157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:33.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.563+0000 7f6bad5ff700 1 --2- 172.21.15.112:0/1108771980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ba80b28f0 0x7f6ba8156a60 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:33.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.563+0000 7f6bad5ff700 1 --2- 172.21.15.112:0/1108771980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba80cdfb0 0x7f6ba815cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:33.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.563+0000 7f6bad5ff700 1 -- 172.21.15.112:0/1108771980 >> 172.21.15.112:0/1108771980 conn(0x7f6ba80d1930 msgr2=0x7f6ba815c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:33.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.563+0000 7f6bad5ff700 1 -- 172.21.15.112:0/1108771980 shutdown_connections 2023-09-12T16:08:33.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.563+0000 7f6bad5ff700 1 -- 172.21.15.112:0/1108771980 wait complete. 2023-09-12T16:08:33.582 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:08:33.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.782+0000 7fd345fff700 1 -- 172.21.15.112:0/3013594257 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3400ca980 msgr2=0x7fd3400af590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:33.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.782+0000 7fd345fff700 1 --2- 172.21.15.112:0/3013594257 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3400ca980 0x7fd3400af590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd338009f60 tx=0x7fd338009f90 comp rx=0 tx=0).stop 2023-09-12T16:08:33.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.782+0000 7fd345fff700 1 -- 172.21.15.112:0/3013594257 shutdown_connections 2023-09-12T16:08:33.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.782+0000 7fd345fff700 1 --2- 172.21.15.112:0/3013594257 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3400ca980 0x7fd3400af590 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:33.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.782+0000 7fd345fff700 1 --2- 172.21.15.112:0/3013594257 >> v2:172.21.15.144:3300/0 conn(0x7fd3400cfa80 0x7fd3400ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:33.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.782+0000 7fd345fff700 1 -- 172.21.15.112:0/3013594257 >> 172.21.15.112:0/3013594257 conn(0x7fd340088ff0 msgr2=0x7fd340098a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:33.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.782+0000 7fd345fff700 1 -- 172.21.15.112:0/3013594257 shutdown_connections 2023-09-12T16:08:33.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.782+0000 7fd345fff700 1 -- 172.21.15.112:0/3013594257 wait complete. 2023-09-12T16:08:33.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.783+0000 7fd345fff700 1 Processor -- start 2023-09-12T16:08:33.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.784+0000 7fd345fff700 1 -- start start 2023-09-12T16:08:33.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.785+0000 7fd345fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3400ca980 0x7fd340153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:33.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.785+0000 7fd345fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3400cfa80 0x7fd34015c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:33.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.785+0000 7fd345fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd340159b60 0x7fd34015aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:33.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.785+0000 7fd345fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3400c9360 con 0x7fd3400ca980 2023-09-12T16:08:33.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.785+0000 7fd345fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34015a5d0 con 0x7fd3400cfa80 2023-09-12T16:08:33.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.785+0000 7fd345fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3400c9b30 con 0x7fd340159b60 2023-09-12T16:08:33.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.785+0000 7fd33f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3400ca980 0x7fd340153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:33.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.785+0000 7fd33f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3400ca980 0x7fd340153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34702/0 (socket says 172.21.15.112:34702) 2023-09-12T16:08:33.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.785+0000 7fd33f7fe700 1 -- 172.21.15.112:0/3228023287 learned_addr learned my addr 172.21.15.112:0/3228023287 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:33.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.785+0000 7fd33effd700 1 --2- 172.21.15.112:0/3228023287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3400cfa80 0x7fd34015c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:33.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.785+0000 7fd33ffff700 1 --2- 172.21.15.112:0/3228023287 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd340159b60 0x7fd34015aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:33.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.785+0000 7fd33f7fe700 1 -- 172.21.15.112:0/3228023287 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd340159b60 msgr2=0x7fd34015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:33.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.785+0000 7fd33f7fe700 1 --2- 172.21.15.112:0/3228023287 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd340159b60 0x7fd34015aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:33.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.785+0000 7fd33f7fe700 1 -- 172.21.15.112:0/3228023287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3400cfa80 msgr2=0x7fd34015c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:33.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.785+0000 7fd33f7fe700 1 --2- 172.21.15.112:0/3228023287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3400cfa80 0x7fd34015c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:33.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.785+0000 7fd33f7fe700 1 -- 172.21.15.112:0/3228023287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd334009520 con 0x7fd3400ca980 2023-09-12T16:08:33.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.786+0000 7fd33f7fe700 1 --2- 172.21.15.112:0/3228023287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3400ca980 0x7fd340153870 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd33000c450 tx=0x7fd33000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:33.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.786+0000 7fd327fff700 1 -- 172.21.15.112:0/3228023287 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd330011790 con 0x7fd3400ca980 2023-09-12T16:08:33.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.786+0000 7fd327fff700 1 -- 172.21.15.112:0/3228023287 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd3300119e0 con 0x7fd3400ca980 2023-09-12T16:08:33.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.786+0000 7fd327fff700 1 -- 172.21.15.112:0/3228023287 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd330011dd0 con 0x7fd3400ca980 2023-09-12T16:08:33.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.786+0000 7fd345fff700 1 -- 172.21.15.112:0/3228023287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd338009c40 con 0x7fd3400ca980 2023-09-12T16:08:33.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.786+0000 7fd345fff700 1 -- 172.21.15.112:0/3228023287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3400c9850 con 0x7fd3400ca980 2023-09-12T16:08:33.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.787+0000 7fd345fff700 1 -- 172.21.15.112:0/3228023287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34004e300 con 0x7fd3400ca980 2023-09-12T16:08:33.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.788+0000 7fd327fff700 1 -- 172.21.15.112:0/3228023287 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fd33001c460 con 0x7fd3400ca980 2023-09-12T16:08:33.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.789+0000 7fd327fff700 1 --2- 172.21.15.112:0/3228023287 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd32c06a580 0x7fd32c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:33.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.789+0000 7fd327fff700 1 -- 172.21.15.112:0/3228023287 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd3300889c0 con 0x7fd3400ca980 2023-09-12T16:08:33.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.789+0000 7fd33effd700 1 --2- 172.21.15.112:0/3228023287 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd32c06a580 0x7fd32c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:33.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.789+0000 7fd33effd700 1 --2- 172.21.15.112:0/3228023287 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd32c06a580 0x7fd32c06ca40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd3400c9120 tx=0x7fd334009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:33.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.793+0000 7fd327fff700 1 -- 172.21.15.112:0/3228023287 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd330053df0 con 0x7fd3400ca980 2023-09-12T16:08:33.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.993+0000 7fd345fff700 1 -- 172.21.15.112:0/3228023287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd34015d280 con 0x7fd3400ca980 2023-09-12T16:08:33.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.994+0000 7fd327fff700 1 -- 172.21.15.112:0/3228023287 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16823 (secure 0 0 0) 0x7fd33000ce60 con 0x7fd3400ca980 2023-09-12T16:08:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:33.995 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":37,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:08:32.573060+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:08:30.428559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-12T16:08:31.564145+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:08:33.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.996+0000 7fd345fff700 1 -- 172.21.15.112:0/3228023287 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd32c06a580 msgr2=0x7fd32c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:33.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.996+0000 7fd345fff700 1 --2- 172.21.15.112:0/3228023287 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd32c06a580 0x7fd32c06ca40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd3400c9120 tx=0x7fd334009260 comp rx=0 tx=0).stop 2023-09-12T16:08:33.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.996+0000 7fd345fff700 1 -- 172.21.15.112:0/3228023287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3400ca980 msgr2=0x7fd340153870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:33.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.996+0000 7fd345fff700 1 --2- 172.21.15.112:0/3228023287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3400ca980 0x7fd340153870 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd33000c450 tx=0x7fd33000c760 comp rx=0 tx=0).stop 2023-09-12T16:08:33.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.997+0000 7fd345fff700 1 -- 172.21.15.112:0/3228023287 shutdown_connections 2023-09-12T16:08:33.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.997+0000 7fd345fff700 1 --2- 172.21.15.112:0/3228023287 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fd32c06a580 0x7fd32c06ca40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:33.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.997+0000 7fd345fff700 1 --2- 172.21.15.112:0/3228023287 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd340159b60 0x7fd34015aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:33.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.997+0000 7fd345fff700 1 --2- 172.21.15.112:0/3228023287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3400ca980 0x7fd340153870 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:33.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.997+0000 7fd345fff700 1 --2- 172.21.15.112:0/3228023287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3400cfa80 0x7fd34015c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:33.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.997+0000 7fd345fff700 1 -- 172.21.15.112:0/3228023287 >> 172.21.15.112:0/3228023287 conn(0x7fd340088ff0 msgr2=0x7fd34006ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:33.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.997+0000 7fd345fff700 1 -- 172.21.15.112:0/3228023287 shutdown_connections 2023-09-12T16:08:33.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:33.997+0000 7fd345fff700 1 -- 172.21.15.112:0/3228023287 wait complete. 2023-09-12T16:08:34.015 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-12T16:08:34.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.222+0000 7f81d37ff700 1 -- 172.21.15.112:0/2804050412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81b8004d90 msgr2=0x7f81b8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:34.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.222+0000 7f81d37ff700 1 --2- 172.21.15.112:0/2804050412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81b8004d90 0x7f81b8005210 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f81c400e350 tx=0x7f81b8005880 comp rx=0 tx=0).stop 2023-09-12T16:08:34.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.222+0000 7f81d1d9c700 1 -- 172.21.15.112:0/2804050412 reap_dead start 2023-09-12T16:08:34.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.222+0000 7f81d37ff700 1 -- 172.21.15.112:0/2804050412 shutdown_connections 2023-09-12T16:08:34.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.222+0000 7f81d37ff700 1 -- 172.21.15.112:0/2804050412 >> 172.21.15.112:0/2804050412 conn(0x7f81cc0cf660 msgr2=0x7f81cc0cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:34.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.222+0000 7f81d37ff700 1 -- 172.21.15.112:0/2804050412 shutdown_connections 2023-09-12T16:08:34.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.222+0000 7f81d37ff700 1 -- 172.21.15.112:0/2804050412 wait complete. 2023-09-12T16:08:34.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.224+0000 7f81d37ff700 1 Processor -- start 2023-09-12T16:08:34.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.224+0000 7f81d37ff700 1 -- start start 2023-09-12T16:08:34.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.225+0000 7f81d37ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81b8004d90 0x7f81cc0b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:34.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.225+0000 7f81d37ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81cc14dae0 0x7f81cc0b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:34.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.225+0000 7f81d37ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81cc0cb1d0 0x7f81cc0cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:34.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.225+0000 7f81d37ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc0cbb90 con 0x7f81cc14dae0 2023-09-12T16:08:34.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.225+0000 7f81d37ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc0b36a0 con 0x7f81cc0cb1d0 2023-09-12T16:08:34.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.225+0000 7f81d37ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc0b2a90 con 0x7f81b8004d90 2023-09-12T16:08:34.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.225+0000 7f81d0d9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81cc14dae0 0x7f81cc0b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:34.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.225+0000 7f81d0d9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81cc14dae0 0x7f81cc0b2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34724/0 (socket says 172.21.15.112:34724) 2023-09-12T16:08:34.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.225+0000 7f81d0d9a700 1 -- 172.21.15.112:0/927500680 learned_addr learned my addr 172.21.15.112:0/927500680 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:34.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.225+0000 7f81d159b700 1 --2- 172.21.15.112:0/927500680 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81b8004d90 0x7f81cc0b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:34.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.225+0000 7f81d1d9c700 1 --2- 172.21.15.112:0/927500680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81cc0cb1d0 0x7f81cc0cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:34.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.226+0000 7f81d0d9a700 1 -- 172.21.15.112:0/927500680 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81b8004d90 msgr2=0x7f81cc0b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:34.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.226+0000 7f81d0d9a700 1 --2- 172.21.15.112:0/927500680 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81b8004d90 0x7f81cc0b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:34.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.226+0000 7f81d0d9a700 1 -- 172.21.15.112:0/927500680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81cc0cb1d0 msgr2=0x7f81cc0cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:34.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.226+0000 7f81d0d9a700 1 --2- 172.21.15.112:0/927500680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81cc0cb1d0 0x7f81cc0cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:34.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.226+0000 7f81d0d9a700 1 -- 172.21.15.112:0/927500680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc0b2d70 con 0x7f81cc14dae0 2023-09-12T16:08:34.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.226+0000 7f81d0d9a700 1 --2- 172.21.15.112:0/927500680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81cc14dae0 0x7f81cc0b2240 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f81bc003f40 tx=0x7f81bc001540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:34.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.226+0000 7f81c1ffb700 1 -- 172.21.15.112:0/927500680 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc001d70 con 0x7f81cc14dae0 2023-09-12T16:08:34.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.226+0000 7f81c1ffb700 1 -- 172.21.15.112:0/927500680 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f81bc011430 con 0x7f81cc14dae0 2023-09-12T16:08:34.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.226+0000 7f81d37ff700 1 -- 172.21.15.112:0/927500680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81cc0b3050 con 0x7f81cc14dae0 2023-09-12T16:08:34.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.226+0000 7f81c1ffb700 1 -- 172.21.15.112:0/927500680 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc011820 con 0x7f81cc14dae0 2023-09-12T16:08:34.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.226+0000 7f81d37ff700 1 -- 172.21.15.112:0/927500680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81cc0b2780 con 0x7f81cc14dae0 2023-09-12T16:08:34.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.227+0000 7f81d37ff700 1 -- 172.21.15.112:0/927500680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81cc0b3810 con 0x7f81cc14dae0 2023-09-12T16:08:34.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.228+0000 7f81c1ffb700 1 -- 172.21.15.112:0/927500680 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f81bc011980 con 0x7f81cc14dae0 2023-09-12T16:08:34.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.230+0000 7f81c1ffb700 1 --2- 172.21.15.112:0/927500680 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f81b006a5b0 0x7f81b006ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:34.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.230+0000 7f81c1ffb700 1 -- 172.21.15.112:0/927500680 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f81bc089830 con 0x7f81cc14dae0 2023-09-12T16:08:34.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.230+0000 7f81d159b700 1 --2- 172.21.15.112:0/927500680 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f81b006a5b0 0x7f81b006ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:34.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.230+0000 7f81d159b700 1 --2- 172.21.15.112:0/927500680 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f81b006a5b0 0x7f81b006ca70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f81c8001090 tx=0x7f81c8001020 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:34.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.234+0000 7f81c1ffb700 1 -- 172.21.15.112:0/927500680 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f81bc054b40 con 0x7f81cc14dae0 2023-09-12T16:08:34.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:34.478+0000 7f81d37ff700 1 -- 172.21.15.112:0/927500680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f81cc073ea0 con 0x7f81cc14dae0 2023-09-12T16:08:35.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.115+0000 7f81c1ffb700 1 -- 172.21.15.112:0/927500680 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f81bc015070 con 0x7f81cc14dae0 2023-09-12T16:08:35.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.119+0000 7f81d37ff700 1 -- 172.21.15.112:0/927500680 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f81b006a5b0 msgr2=0x7f81b006ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:35.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.119+0000 7f81d37ff700 1 --2- 172.21.15.112:0/927500680 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f81b006a5b0 0x7f81b006ca70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f81c8001090 tx=0x7f81c8001020 comp rx=0 tx=0).stop 2023-09-12T16:08:35.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.119+0000 7f81d37ff700 1 -- 172.21.15.112:0/927500680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81cc14dae0 msgr2=0x7f81cc0b2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:35.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.119+0000 7f81d37ff700 1 --2- 172.21.15.112:0/927500680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81cc14dae0 0x7f81cc0b2240 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f81bc003f40 tx=0x7f81bc001540 comp rx=0 tx=0).stop 2023-09-12T16:08:35.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.119+0000 7f81d37ff700 1 -- 172.21.15.112:0/927500680 shutdown_connections 2023-09-12T16:08:35.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.119+0000 7f81d37ff700 1 --2- 172.21.15.112:0/927500680 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f81b006a5b0 0x7f81b006ca70 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:35.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.119+0000 7f81d37ff700 1 --2- 172.21.15.112:0/927500680 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81b8004d90 0x7f81cc0b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:35.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.119+0000 7f81d37ff700 1 --2- 172.21.15.112:0/927500680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81cc0cb1d0 0x7f81cc0cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:35.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.119+0000 7f81d37ff700 1 --2- 172.21.15.112:0/927500680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81cc14dae0 0x7f81cc0b2240 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:35.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.119+0000 7f81d37ff700 1 -- 172.21.15.112:0/927500680 >> 172.21.15.112:0/927500680 conn(0x7f81cc0cf660 msgr2=0x7f81cc0ca960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:35.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.119+0000 7f81d37ff700 1 -- 172.21.15.112:0/927500680 shutdown_connections 2023-09-12T16:08:35.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.119+0000 7f81d37ff700 1 -- 172.21.15.112:0/927500680 wait complete. 2023-09-12T16:08:35.140 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-12T16:08:35.140 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-12T16:08:35.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.346+0000 7f748abff700 1 -- 172.21.15.112:0/2506023910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f748406ef30 msgr2=0x7f74840ccd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:35.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.346+0000 7f748abff700 1 --2- 172.21.15.112:0/2506023910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f748406ef30 0x7f74840ccd90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f74700098c0 tx=0x7f7470009bd0 comp rx=0 tx=0).stop 2023-09-12T16:08:35.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.346+0000 7f748abff700 1 -- 172.21.15.112:0/2506023910 shutdown_connections 2023-09-12T16:08:35.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.346+0000 7f748abff700 1 --2- 172.21.15.112:0/2506023910 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f748406b740 0x7f74841595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:35.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.346+0000 7f748abff700 1 --2- 172.21.15.112:0/2506023910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f748406ef30 0x7f74840ccd90 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:35.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.346+0000 7f748abff700 1 -- 172.21.15.112:0/2506023910 >> 172.21.15.112:0/2506023910 conn(0x7f74840cdb80 msgr2=0x7f74840cdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:35.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.346+0000 7f748abff700 1 -- 172.21.15.112:0/2506023910 shutdown_connections 2023-09-12T16:08:35.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.346+0000 7f748abff700 1 -- 172.21.15.112:0/2506023910 wait complete. 2023-09-12T16:08:35.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.348+0000 7f748abff700 1 Processor -- start 2023-09-12T16:08:35.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.348+0000 7f748abff700 1 -- start start 2023-09-12T16:08:35.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.349+0000 7f748abff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f748406b740 0x7f74841533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:35.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.349+0000 7f748abff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f748406ef30 0x7f748414d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:35.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.349+0000 7f748abff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74840b1ad0 0x7f748414d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:35.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.349+0000 7f748abff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748414dd30 con 0x7f748406ef30 2023-09-12T16:08:35.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.349+0000 7f748abff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74840c9b10 con 0x7f748406b740 2023-09-12T16:08:35.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.349+0000 7f748abff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748414df80 con 0x7f74840b1ad0 2023-09-12T16:08:35.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.349+0000 7f7483fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f748406ef30 0x7f748414d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:35.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.349+0000 7f7483fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f748406ef30 0x7f748414d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34750/0 (socket says 172.21.15.112:34750) 2023-09-12T16:08:35.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.349+0000 7f7483fff700 1 -- 172.21.15.112:0/2980607949 learned_addr learned my addr 172.21.15.112:0/2980607949 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:35.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.349+0000 7f748919c700 1 --2- 172.21.15.112:0/2980607949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74840b1ad0 0x7f748414d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:35.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.349+0000 7f748899b700 1 --2- 172.21.15.112:0/2980607949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f748406b740 0x7f74841533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:35.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.349+0000 7f7483fff700 1 -- 172.21.15.112:0/2980607949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74840b1ad0 msgr2=0x7f748414d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:35.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.349+0000 7f7483fff700 1 --2- 172.21.15.112:0/2980607949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74840b1ad0 0x7f748414d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:35.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.349+0000 7f7483fff700 1 -- 172.21.15.112:0/2980607949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f748406b740 msgr2=0x7f74841533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:35.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.349+0000 7f7483fff700 1 --2- 172.21.15.112:0/2980607949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f748406b740 0x7f74841533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:35.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.349+0000 7f7483fff700 1 -- 172.21.15.112:0/2980607949 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7470009520 con 0x7f748406ef30 2023-09-12T16:08:35.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.349+0000 7f748919c700 1 --2- 172.21.15.112:0/2980607949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74840b1ad0 0x7f748414d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:35.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.349+0000 7f748899b700 1 --2- 172.21.15.112:0/2980607949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f748406b740 0x7f74841533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:35.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.350+0000 7f7483fff700 1 --2- 172.21.15.112:0/2980607949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f748406ef30 0x7f748414d1c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7470013000 tx=0x7f7470017630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:35.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.350+0000 7f74817fa700 1 -- 172.21.15.112:0/2980607949 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747001c070 con 0x7f748406ef30 2023-09-12T16:08:35.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.350+0000 7f74817fa700 1 -- 172.21.15.112:0/2980607949 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7470017c20 con 0x7f748406ef30 2023-09-12T16:08:35.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.350+0000 7f748abff700 1 -- 172.21.15.112:0/2980607949 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74840c9550 con 0x7f748406ef30 2023-09-12T16:08:35.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.350+0000 7f74817fa700 1 -- 172.21.15.112:0/2980607949 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7470004050 con 0x7f748406ef30 2023-09-12T16:08:35.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.350+0000 7f748abff700 1 -- 172.21.15.112:0/2980607949 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7484150560 con 0x7f748406ef30 2023-09-12T16:08:35.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.351+0000 7f748abff700 1 -- 172.21.15.112:0/2980607949 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74840b27b0 con 0x7f748406ef30 2023-09-12T16:08:35.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.352+0000 7f74817fa700 1 -- 172.21.15.112:0/2980607949 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f74700041b0 con 0x7f748406ef30 2023-09-12T16:08:35.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.354+0000 7f74817fa700 1 --2- 172.21.15.112:0/2980607949 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f746806a580 0x7f746806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:35.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.354+0000 7f74817fa700 1 -- 172.21.15.112:0/2980607949 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7470089cf0 con 0x7f748406ef30 2023-09-12T16:08:35.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.354+0000 7f748899b700 1 --2- 172.21.15.112:0/2980607949 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f746806a580 0x7f746806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:35.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.354+0000 7f748899b700 1 --2- 172.21.15.112:0/2980607949 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f746806a580 0x7f746806ca40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7478000f60 tx=0x7f7478009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:35.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.358+0000 7f74817fa700 1 -- 172.21.15.112:0/2980607949 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f7470055120 con 0x7f748406ef30 2023-09-12T16:08:35.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:35.600+0000 7f748abff700 1 -- 172.21.15.112:0/2980607949 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7484073ea0 con 0x7f748406ef30 2023-09-12T16:08:36.066 INFO:tasks.ceph.mds.c.smithi112.stderr:2023-09-12T16:08:36.065+0000 7f359ebf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-12T16:08:36.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.117+0000 7f74817fa700 1 -- 172.21.15.112:0/2980607949 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7470058740 con 0x7f748406ef30 2023-09-12T16:08:36.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.120+0000 7f748abff700 1 -- 172.21.15.112:0/2980607949 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f746806a580 msgr2=0x7f746806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:36.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.120+0000 7f748abff700 1 --2- 172.21.15.112:0/2980607949 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f746806a580 0x7f746806ca40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7478000f60 tx=0x7f7478009040 comp rx=0 tx=0).stop 2023-09-12T16:08:36.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.120+0000 7f748abff700 1 -- 172.21.15.112:0/2980607949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f748406ef30 msgr2=0x7f748414d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:36.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.120+0000 7f748abff700 1 --2- 172.21.15.112:0/2980607949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f748406ef30 0x7f748414d1c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7470013000 tx=0x7f7470017630 comp rx=0 tx=0).stop 2023-09-12T16:08:36.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.121+0000 7f748abff700 1 -- 172.21.15.112:0/2980607949 shutdown_connections 2023-09-12T16:08:36.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.121+0000 7f748abff700 1 --2- 172.21.15.112:0/2980607949 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f746806a580 0x7f746806ca40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:36.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.121+0000 7f748abff700 1 --2- 172.21.15.112:0/2980607949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74840b1ad0 0x7f748414d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:36.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.121+0000 7f748abff700 1 --2- 172.21.15.112:0/2980607949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f748406b740 0x7f74841533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:36.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.121+0000 7f748abff700 1 --2- 172.21.15.112:0/2980607949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f748406ef30 0x7f748414d1c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:36.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.121+0000 7f748abff700 1 -- 172.21.15.112:0/2980607949 >> 172.21.15.112:0/2980607949 conn(0x7f74840cdb80 msgr2=0x7f7484070980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:36.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.121+0000 7f748abff700 1 -- 172.21.15.112:0/2980607949 shutdown_connections 2023-09-12T16:08:36.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.121+0000 7f748abff700 1 -- 172.21.15.112:0/2980607949 wait complete. 2023-09-12T16:08:36.141 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-12T16:08:36.142 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-12T16:08:36.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.340+0000 7f8c855ff700 1 -- 172.21.15.112:0/1145845757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c800cdfb0 msgr2=0x7f8c800cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:36.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.340+0000 7f8c855ff700 1 --2- 172.21.15.112:0/1145845757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c800cdfb0 0x7f8c800cc3b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8c68005fd0 tx=0x7f8c68009c70 comp rx=0 tx=0).stop 2023-09-12T16:08:36.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.340+0000 7f8c855ff700 1 -- 172.21.15.112:0/1145845757 shutdown_connections 2023-09-12T16:08:36.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.340+0000 7f8c855ff700 1 --2- 172.21.15.112:0/1145845757 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c800d0590 0x7f8c800cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:36.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.340+0000 7f8c855ff700 1 --2- 172.21.15.112:0/1145845757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c800cdfb0 0x7f8c800cc3b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:36.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.340+0000 7f8c855ff700 1 -- 172.21.15.112:0/1145845757 >> 172.21.15.112:0/1145845757 conn(0x7f8c800d1930 msgr2=0x7f8c800d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:36.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.341+0000 7f8c855ff700 1 -- 172.21.15.112:0/1145845757 shutdown_connections 2023-09-12T16:08:36.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.341+0000 7f8c855ff700 1 -- 172.21.15.112:0/1145845757 wait complete. 2023-09-12T16:08:36.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.342+0000 7f8c855ff700 1 Processor -- start 2023-09-12T16:08:36.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.342+0000 7f8c855ff700 1 -- start start 2023-09-12T16:08:36.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.343+0000 7f8c855ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c800cdfb0 0x7f8c800cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:36.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.343+0000 7f8c855ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c800d0590 0x7f8c800b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:36.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.343+0000 7f8c855ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c8015f480 0x7f8c80159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:36.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.343+0000 7f8c855ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c800b5750 con 0x7f8c8015f480 2023-09-12T16:08:36.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.343+0000 7f8c855ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c800c98f0 con 0x7f8c800d0590 2023-09-12T16:08:36.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.343+0000 7f8c855ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c800b5930 con 0x7f8c800cdfb0 2023-09-12T16:08:36.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.344+0000 7f8c7f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c8015f480 0x7f8c80159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:36.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.344+0000 7f8c7f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c8015f480 0x7f8c80159960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59870/0 (socket says 172.21.15.112:59870) 2023-09-12T16:08:36.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.344+0000 7f8c7f7fe700 1 -- 172.21.15.112:0/2425955140 learned_addr learned my addr 172.21.15.112:0/2425955140 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:36.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.344+0000 7f8c7effd700 1 --2- 172.21.15.112:0/2425955140 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c800cdfb0 0x7f8c800cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:36.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.344+0000 7f8c77fff700 1 --2- 172.21.15.112:0/2425955140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c800d0590 0x7f8c800b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:36.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.344+0000 7f8c7f7fe700 1 -- 172.21.15.112:0/2425955140 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c800cdfb0 msgr2=0x7f8c800cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:36.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.344+0000 7f8c7f7fe700 1 --2- 172.21.15.112:0/2425955140 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c800cdfb0 0x7f8c800cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:36.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.344+0000 7f8c7f7fe700 1 -- 172.21.15.112:0/2425955140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c800d0590 msgr2=0x7f8c800b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:36.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.344+0000 7f8c7f7fe700 1 --2- 172.21.15.112:0/2425955140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c800d0590 0x7f8c800b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:36.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.344+0000 7f8c7f7fe700 1 -- 172.21.15.112:0/2425955140 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c680095f0 con 0x7f8c8015f480 2023-09-12T16:08:36.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.344+0000 7f8c77fff700 1 --2- 172.21.15.112:0/2425955140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c800d0590 0x7f8c800b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:36.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.344+0000 7f8c7f7fe700 1 --2- 172.21.15.112:0/2425955140 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c8015f480 0x7f8c80159960 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8c78007d30 tx=0x7f8c7800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:36.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.344+0000 7f8c777fe700 1 -- 172.21.15.112:0/2425955140 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7800ad40 con 0x7f8c8015f480 2023-09-12T16:08:36.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.344+0000 7f8c777fe700 1 -- 172.21.15.112:0/2425955140 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8c78003a00 con 0x7f8c8015f480 2023-09-12T16:08:36.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.344+0000 7f8c855ff700 1 -- 172.21.15.112:0/2425955140 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c800b2ba0 con 0x7f8c8015f480 2023-09-12T16:08:36.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.345+0000 7f8c777fe700 1 -- 172.21.15.112:0/2425955140 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c78003e10 con 0x7f8c8015f480 2023-09-12T16:08:36.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.345+0000 7f8c855ff700 1 -- 172.21.15.112:0/2425955140 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c800b5ef0 con 0x7f8c8015f480 2023-09-12T16:08:36.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.346+0000 7f8c855ff700 1 -- 172.21.15.112:0/2425955140 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c8004e300 con 0x7f8c8015f480 2023-09-12T16:08:36.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.347+0000 7f8c777fe700 1 -- 172.21.15.112:0/2425955140 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f8c78004030 con 0x7f8c8015f480 2023-09-12T16:08:36.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.347+0000 7f8c777fe700 1 --2- 172.21.15.112:0/2425955140 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8c6006a580 0x7f8c6006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:36.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.348+0000 7f8c777fe700 1 -- 172.21.15.112:0/2425955140 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8c780896a0 con 0x7f8c8015f480 2023-09-12T16:08:36.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.348+0000 7f8c7effd700 1 --2- 172.21.15.112:0/2425955140 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8c6006a580 0x7f8c6006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:36.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.348+0000 7f8c7effd700 1 --2- 172.21.15.112:0/2425955140 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8c6006a580 0x7f8c6006ca40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8c700016e0 tx=0x7f8c70009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:36.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.352+0000 7f8c777fe700 1 -- 172.21.15.112:0/2425955140 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f8c78054a40 con 0x7f8c8015f480 2023-09-12T16:08:36.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.589+0000 7f8c855ff700 1 -- 172.21.15.112:0/2425955140 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c800b6110 con 0x7f8c8015f480 2023-09-12T16:08:36.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.589+0000 7f8c777fe700 1 -- 172.21.15.112:0/2425955140 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f8c78007ae0 con 0x7f8c8015f480 2023-09-12T16:08:36.591 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:36.591 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/2998708372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2998708372},{"type":"v1","addr":"172.21.15.112:6836","nonce":2998708372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4976,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/645279320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645279320},{"type":"v1","addr":"172.21.15.144:6833","nonce":645279320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":4979,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1677723765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1677723765},{"type":"v1","addr":"172.21.15.144:6835","nonce":1677723765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-12T16:08:32.573410+0000","modified":"2023-09-12T16:08:35.602701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5370},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5370":{"gid":5370,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6837/4247846879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":4247846879},{"type":"v1","addr":"172.21.15.112:6837","nonce":4247846879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-12T16:08:36.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.592+0000 7f8c855ff700 1 -- 172.21.15.112:0/2425955140 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8c6006a580 msgr2=0x7f8c6006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:36.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.592+0000 7f8c855ff700 1 --2- 172.21.15.112:0/2425955140 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8c6006a580 0x7f8c6006ca40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8c700016e0 tx=0x7f8c70009040 comp rx=0 tx=0).stop 2023-09-12T16:08:36.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.592+0000 7f8c855ff700 1 -- 172.21.15.112:0/2425955140 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c8015f480 msgr2=0x7f8c80159960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:36.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.592+0000 7f8c855ff700 1 --2- 172.21.15.112:0/2425955140 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c8015f480 0x7f8c80159960 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8c78007d30 tx=0x7f8c7800a340 comp rx=0 tx=0).stop 2023-09-12T16:08:36.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.592+0000 7f8c855ff700 1 -- 172.21.15.112:0/2425955140 shutdown_connections 2023-09-12T16:08:36.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.592+0000 7f8c855ff700 1 --2- 172.21.15.112:0/2425955140 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8c6006a580 0x7f8c6006ca40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:36.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.592+0000 7f8c855ff700 1 --2- 172.21.15.112:0/2425955140 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c800cdfb0 0x7f8c800cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:36.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.592+0000 7f8c855ff700 1 --2- 172.21.15.112:0/2425955140 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c8015f480 0x7f8c80159960 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:36.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.592+0000 7f8c855ff700 1 --2- 172.21.15.112:0/2425955140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c800d0590 0x7f8c800b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:36.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.592+0000 7f8c855ff700 1 -- 172.21.15.112:0/2425955140 >> 172.21.15.112:0/2425955140 conn(0x7f8c800d1930 msgr2=0x7f8c8015bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:36.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.592+0000 7f8c855ff700 1 -- 172.21.15.112:0/2425955140 shutdown_connections 2023-09-12T16:08:36.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.592+0000 7f8c855ff700 1 -- 172.21.15.112:0/2425955140 wait complete. 2023-09-12T16:08:36.595 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 17 2023-09-12T16:08:36.611 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T16:08:36.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.809+0000 7ff0c6dff700 1 -- 172.21.15.112:0/1934980448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0c00b02a0 msgr2=0x7ff0c00d1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:36.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.809+0000 7ff0c6dff700 1 --2- 172.21.15.112:0/1934980448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0c00b02a0 0x7ff0c00d1cb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac005fd0 tx=0x7ff0ac009c70 comp rx=0 tx=0).stop 2023-09-12T16:08:36.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.809+0000 7ff0c6dff700 1 -- 172.21.15.112:0/1934980448 shutdown_connections 2023-09-12T16:08:36.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.809+0000 7ff0c6dff700 1 --2- 172.21.15.112:0/1934980448 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff0c00ce5f0 0x7ff0c00ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:36.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.809+0000 7ff0c6dff700 1 --2- 172.21.15.112:0/1934980448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0c00b02a0 0x7ff0c00d1cb0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:36.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.809+0000 7ff0c6dff700 1 -- 172.21.15.112:0/1934980448 >> 172.21.15.112:0/1934980448 conn(0x7ff0c0071ba0 msgr2=0x7ff0c0071fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:36.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.809+0000 7ff0c6dff700 1 -- 172.21.15.112:0/1934980448 shutdown_connections 2023-09-12T16:08:36.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.809+0000 7ff0c6dff700 1 -- 172.21.15.112:0/1934980448 wait complete. 2023-09-12T16:08:36.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.811+0000 7ff0c6dff700 1 Processor -- start 2023-09-12T16:08:36.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.811+0000 7ff0c6dff700 1 -- start start 2023-09-12T16:08:36.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.812+0000 7ff0c6dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0c00b02a0 0x7ff0c01e69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:36.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.812+0000 7ff0c6dff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff0c00ce5f0 0x7ff0c00b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:36.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.812+0000 7ff0c6dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0c00d21f0 0x7ff0c015d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:36.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.812+0000 7ff0c6dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c0156710 con 0x7ff0c00b02a0 2023-09-12T16:08:36.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.812+0000 7ff0c6dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c01569f0 con 0x7ff0c00d21f0 2023-09-12T16:08:36.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.812+0000 7ff0c6dff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c0156cd0 con 0x7ff0c00ce5f0 2023-09-12T16:08:36.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.812+0000 7ff0c4b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0c00b02a0 0x7ff0c01e69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:36.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.812+0000 7ff0c4b9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0c00b02a0 0x7ff0c01e69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59902/0 (socket says 172.21.15.112:59902) 2023-09-12T16:08:36.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.812+0000 7ff0c4b9b700 1 -- 172.21.15.112:0/635819476 learned_addr learned my addr 172.21.15.112:0/635819476 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:36.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.812+0000 7ff0bffff700 1 --2- 172.21.15.112:0/635819476 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff0c00ce5f0 0x7ff0c00b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:36.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.812+0000 7ff0c539c700 1 --2- 172.21.15.112:0/635819476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0c00d21f0 0x7ff0c015d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:36.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.812+0000 7ff0c4b9b700 1 -- 172.21.15.112:0/635819476 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff0c00ce5f0 msgr2=0x7ff0c00b6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:36.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.812+0000 7ff0c4b9b700 1 --2- 172.21.15.112:0/635819476 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff0c00ce5f0 0x7ff0c00b6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:36.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.812+0000 7ff0c4b9b700 1 -- 172.21.15.112:0/635819476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0c00d21f0 msgr2=0x7ff0c015d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:36.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.812+0000 7ff0c4b9b700 1 --2- 172.21.15.112:0/635819476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0c00d21f0 0x7ff0c015d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:36.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.813+0000 7ff0c4b9b700 1 -- 172.21.15.112:0/635819476 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ac0095f0 con 0x7ff0c00b02a0 2023-09-12T16:08:36.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.813+0000 7ff0c4b9b700 1 --2- 172.21.15.112:0/635819476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0c00b02a0 0x7ff0c01e69e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff0b400e9a0 tx=0x7ff0b400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:36.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.813+0000 7ff0bd7fa700 1 -- 172.21.15.112:0/635819476 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4009790 con 0x7ff0c00b02a0 2023-09-12T16:08:36.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.813+0000 7ff0bd7fa700 1 -- 172.21.15.112:0/635819476 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff0b400ccc0 con 0x7ff0c00b02a0 2023-09-12T16:08:36.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.813+0000 7ff0c6dff700 1 -- 172.21.15.112:0/635819476 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c0156fb0 con 0x7ff0c00b02a0 2023-09-12T16:08:36.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.813+0000 7ff0bd7fa700 1 -- 172.21.15.112:0/635819476 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4010690 con 0x7ff0c00b02a0 2023-09-12T16:08:36.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.813+0000 7ff0c6dff700 1 -- 172.21.15.112:0/635819476 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c00c8940 con 0x7ff0c00b02a0 2023-09-12T16:08:36.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.814+0000 7ff0c6dff700 1 -- 172.21.15.112:0/635819476 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c0073ea0 con 0x7ff0c00b02a0 2023-09-12T16:08:36.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.815+0000 7ff0bd7fa700 1 -- 172.21.15.112:0/635819476 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ff0b40107f0 con 0x7ff0c00b02a0 2023-09-12T16:08:36.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.817+0000 7ff0bd7fa700 1 --2- 172.21.15.112:0/635819476 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff0a406a580 0x7ff0a406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:36.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.817+0000 7ff0bd7fa700 1 -- 172.21.15.112:0/635819476 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff0b4014070 con 0x7ff0c00b02a0 2023-09-12T16:08:36.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.817+0000 7ff0bffff700 1 --2- 172.21.15.112:0/635819476 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff0a406a580 0x7ff0a406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:36.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.818+0000 7ff0bffff700 1 --2- 172.21.15.112:0/635819476 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff0a406a580 0x7ff0a406ca40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0098e0 tx=0x7ff0ac0047c0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:36.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:36.821+0000 7ff0bd7fa700 1 -- 172.21.15.112:0/635819476 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff0b40519b0 con 0x7ff0c00b02a0 2023-09-12T16:08:37.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.018+0000 7ff0c6dff700 1 -- 172.21.15.112:0/635819476 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0c01574d0 con 0x7ff0c00b02a0 2023-09-12T16:08:37.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.019+0000 7ff0bd7fa700 1 -- 172.21.15.112:0/635819476 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16810 (secure 0 0 0) 0x7ff0c01574d0 con 0x7ff0c00b02a0 2023-09-12T16:08:37.021 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:37.021 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":38,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T16:08:34.105195+0000","last_up_change":"2023-09-12T16:06:48.061924+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:08:30.428559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-12T16:08:31.564145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists","up"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T16:08:37.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.021+0000 7ff0c6dff700 1 -- 172.21.15.112:0/635819476 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff0a406a580 msgr2=0x7ff0a406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:37.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.021+0000 7ff0c6dff700 1 --2- 172.21.15.112:0/635819476 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff0a406a580 0x7ff0a406ca40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0098e0 tx=0x7ff0ac0047c0 comp rx=0 tx=0).stop 2023-09-12T16:08:37.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.021+0000 7ff0c6dff700 1 -- 172.21.15.112:0/635819476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0c00b02a0 msgr2=0x7ff0c01e69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:37.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.021+0000 7ff0c6dff700 1 --2- 172.21.15.112:0/635819476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0c00b02a0 0x7ff0c01e69e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff0b400e9a0 tx=0x7ff0b400ed60 comp rx=0 tx=0).stop 2023-09-12T16:08:37.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.021+0000 7ff0c6dff700 1 -- 172.21.15.112:0/635819476 shutdown_connections 2023-09-12T16:08:37.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.021+0000 7ff0c6dff700 1 --2- 172.21.15.112:0/635819476 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7ff0a406a580 0x7ff0a406ca40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:37.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.022+0000 7ff0c6dff700 1 --2- 172.21.15.112:0/635819476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0c00d21f0 0x7ff0c015d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:37.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.022+0000 7ff0c6dff700 1 --2- 172.21.15.112:0/635819476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0c00b02a0 0x7ff0c01e69e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:37.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.022+0000 7ff0c6dff700 1 --2- 172.21.15.112:0/635819476 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff0c00ce5f0 0x7ff0c00b6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:37.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.022+0000 7ff0c6dff700 1 -- 172.21.15.112:0/635819476 >> 172.21.15.112:0/635819476 conn(0x7ff0c0071ba0 msgr2=0x7ff0c015cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:37.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.022+0000 7ff0c6dff700 1 -- 172.21.15.112:0/635819476 shutdown_connections 2023-09-12T16:08:37.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.022+0000 7ff0c6dff700 1 -- 172.21.15.112:0/635819476 wait complete. 2023-09-12T16:08:37.040 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-12T16:08:37.041 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-12T16:08:37.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.239+0000 7f83117ff700 1 -- 172.21.15.112:0/1999912490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f830c15bdd0 msgr2=0x7f830c0d21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:37.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.239+0000 7f83117ff700 1 --2- 172.21.15.112:0/1999912490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f830c15bdd0 0x7f830c0d21c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f83000098c0 tx=0x7f8300009bd0 comp rx=0 tx=0).stop 2023-09-12T16:08:37.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.239+0000 7f83117ff700 1 -- 172.21.15.112:0/1999912490 shutdown_connections 2023-09-12T16:08:37.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.239+0000 7f83117ff700 1 --2- 172.21.15.112:0/1999912490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f830c15bdd0 0x7f830c0d21c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:37.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.239+0000 7f83117ff700 1 -- 172.21.15.112:0/1999912490 >> 172.21.15.112:0/1999912490 conn(0x7f830c09ab60 msgr2=0x7f830c0d1890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:37.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.239+0000 7f83117ff700 1 -- 172.21.15.112:0/1999912490 shutdown_connections 2023-09-12T16:08:37.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.239+0000 7f83117ff700 1 -- 172.21.15.112:0/1999912490 wait complete. 2023-09-12T16:08:37.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.241+0000 7f83117ff700 1 Processor -- start 2023-09-12T16:08:37.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.241+0000 7f83117ff700 1 -- start start 2023-09-12T16:08:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.242+0000 7f83117ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f830c0cf5e0 0x7f830c150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.242+0000 7f83117ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f830c0cfde0 0x7f830c14e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.242+0000 7f83117ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f830c15bdd0 0x7f830c14ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.242+0000 7f83117ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c14c5c0 con 0x7f830c0cfde0 2023-09-12T16:08:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.242+0000 7f83117ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c14e6f0 con 0x7f830c0cf5e0 2023-09-12T16:08:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.242+0000 7f83117ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830c14b710 con 0x7f830c15bdd0 2023-09-12T16:08:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.242+0000 7f830a7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f830c0cfde0 0x7f830c14e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.242+0000 7f830a7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f830c0cfde0 0x7f830c14e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59916/0 (socket says 172.21.15.112:59916) 2023-09-12T16:08:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.242+0000 7f830a7fc700 1 -- 172.21.15.112:0/1744332131 learned_addr learned my addr 172.21.15.112:0/1744332131 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:37.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.242+0000 7f830affd700 1 --2- 172.21.15.112:0/1744332131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f830c0cf5e0 0x7f830c150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:37.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.243+0000 7f830b7fe700 1 --2- 172.21.15.112:0/1744332131 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f830c15bdd0 0x7f830c14ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:37.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.243+0000 7f830a7fc700 1 -- 172.21.15.112:0/1744332131 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f830c15bdd0 msgr2=0x7f830c14ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:37.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.243+0000 7f830a7fc700 1 --2- 172.21.15.112:0/1744332131 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f830c15bdd0 0x7f830c14ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:37.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.243+0000 7f830a7fc700 1 -- 172.21.15.112:0/1744332131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f830c0cf5e0 msgr2=0x7f830c150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:37.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.243+0000 7f830a7fc700 1 --2- 172.21.15.112:0/1744332131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f830c0cf5e0 0x7f830c150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.243+0000 7f830a7fc700 1 -- 172.21.15.112:0/1744332131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8300009520 con 0x7f830c0cfde0 2023-09-12T16:08:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.243+0000 7f830a7fc700 1 --2- 172.21.15.112:0/1744332131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f830c0cfde0 0x7f830c14e1b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8300009fd0 tx=0x7f8300003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.243+0000 7f82f37fe700 1 -- 172.21.15.112:0/1744332131 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830000bbe0 con 0x7f830c0cfde0 2023-09-12T16:08:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.243+0000 7f82f37fe700 1 -- 172.21.15.112:0/1744332131 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f830000be50 con 0x7f830c0cfde0 2023-09-12T16:08:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.243+0000 7f83117ff700 1 -- 172.21.15.112:0/1744332131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830c14b9b0 con 0x7f830c0cfde0 2023-09-12T16:08:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.243+0000 7f82f37fe700 1 -- 172.21.15.112:0/1744332131 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830000f6c0 con 0x7f830c0cfde0 2023-09-12T16:08:37.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.243+0000 7f83117ff700 1 -- 172.21.15.112:0/1744332131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830c14bf70 con 0x7f830c0cfde0 2023-09-12T16:08:37.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.244+0000 7f83117ff700 1 -- 172.21.15.112:0/1744332131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f830c04e300 con 0x7f830c0cfde0 2023-09-12T16:08:37.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.245+0000 7f82f37fe700 1 -- 172.21.15.112:0/1744332131 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f830000f820 con 0x7f830c0cfde0 2023-09-12T16:08:37.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.246+0000 7f82f37fe700 1 --2- 172.21.15.112:0/1744332131 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f82f806a580 0x7f82f806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:37.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.246+0000 7f82f37fe700 1 -- 172.21.15.112:0/1744332131 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f830008a600 con 0x7f830c0cfde0 2023-09-12T16:08:37.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.246+0000 7f830affd700 1 --2- 172.21.15.112:0/1744332131 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f82f806a580 0x7f82f806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:37.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.247+0000 7f830affd700 1 --2- 172.21.15.112:0/1744332131 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f82f806a580 0x7f82f806ca40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f82fc001730 tx=0x7f82fc009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:37.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.250+0000 7f82f37fe700 1 -- 172.21.15.112:0/1744332131 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f83000559a0 con 0x7f830c0cfde0 2023-09-12T16:08:37.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.442+0000 7f83117ff700 1 -- 172.21.15.112:0/1744332131 --> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f830c0d1fa0 con 0x7f82f806a580 2023-09-12T16:08:37.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.452+0000 7f82f37fe700 1 -- 172.21.15.112:0/1744332131 <== mgr.4176 v2:172.21.15.112:6832/1000013333 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289055 (secure 0 0 0) 0x7f830c0d1fa0 con 0x7f82f806a580 2023-09-12T16:08:37.456 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:37.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.456+0000 7f83117ff700 1 -- 172.21.15.112:0/1744332131 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f82f806a580 msgr2=0x7f82f806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:37.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.456+0000 7f83117ff700 1 --2- 172.21.15.112:0/1744332131 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f82f806a580 0x7f82f806ca40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f82fc001730 tx=0x7f82fc009040 comp rx=0 tx=0).stop 2023-09-12T16:08:37.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.456+0000 7f83117ff700 1 -- 172.21.15.112:0/1744332131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f830c0cfde0 msgr2=0x7f830c14e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:37.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.456+0000 7f83117ff700 1 --2- 172.21.15.112:0/1744332131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f830c0cfde0 0x7f830c14e1b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8300009fd0 tx=0x7f8300003f70 comp rx=0 tx=0).stop 2023-09-12T16:08:37.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.456+0000 7f83117ff700 1 -- 172.21.15.112:0/1744332131 shutdown_connections 2023-09-12T16:08:37.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.456+0000 7f83117ff700 1 --2- 172.21.15.112:0/1744332131 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f82f806a580 0x7f82f806ca40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:37.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.456+0000 7f83117ff700 1 --2- 172.21.15.112:0/1744332131 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f830c15bdd0 0x7f830c14ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:37.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.456+0000 7f83117ff700 1 --2- 172.21.15.112:0/1744332131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f830c0cf5e0 0x7f830c150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:37.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.456+0000 7f83117ff700 1 --2- 172.21.15.112:0/1744332131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f830c0cfde0 0x7f830c14e1b0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:37.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.456+0000 7f83117ff700 1 -- 172.21.15.112:0/1744332131 >> 172.21.15.112:0/1744332131 conn(0x7f830c09ab60 msgr2=0x7f830c0c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:37.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.456+0000 7f83117ff700 1 -- 172.21.15.112:0/1744332131 shutdown_connections 2023-09-12T16:08:37.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.456+0000 7f83117ff700 1 -- 172.21.15.112:0/1744332131 wait complete. 2023-09-12T16:08:37.461 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-09-12T16:08:37.475 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2023-09-12T16:08:36.834124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220656,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754064,"statfs":{"total":773094113280,"available":772868161536,"internally_reserved":0,"allocated":4562944,"data_stored":2614939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.756639"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.121598+0000","last_change":"2023-09-12T16:08:33.112978+0000","last_active":"2023-09-12T16:08:33.121598+0000","last_peered":"2023-09-12T16:08:33.121598+0000","last_clean":"2023-09-12T16:08:33.121598+0000","last_became_active":"2023-09-12T16:08:33.112660+0000","last_became_peered":"2023-09-12T16:08:33.112660+0000","last_unstale":"2023-09-12T16:08:33.121598+0000","last_undegraded":"2023-09-12T16:08:33.121598+0000","last_fullsized":"2023-09-12T16:08:33.121598+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:33:08.512795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.113611+0000","last_change":"2023-09-12T16:08:33.107185+0000","last_active":"2023-09-12T16:08:33.113611+0000","last_peered":"2023-09-12T16:08:33.113611+0000","last_clean":"2023-09-12T16:08:33.113611+0000","last_became_active":"2023-09-12T16:08:33.106891+0000","last_became_peered":"2023-09-12T16:08:33.106891+0000","last_unstale":"2023-09-12T16:08:33.113611+0000","last_undegraded":"2023-09-12T16:08:33.113611+0000","last_fullsized":"2023-09-12T16:08:33.113611+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:46:04.288875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.124341+0000","last_change":"2023-09-12T16:08:33.115636+0000","last_active":"2023-09-12T16:08:33.124341+0000","last_peered":"2023-09-12T16:08:33.124341+0000","last_clean":"2023-09-12T16:08:33.124341+0000","last_became_active":"2023-09-12T16:08:33.115339+0000","last_became_peered":"2023-09-12T16:08:33.115339+0000","last_unstale":"2023-09-12T16:08:33.124341+0000","last_undegraded":"2023-09-12T16:08:33.124341+0000","last_fullsized":"2023-09-12T16:08:33.124341+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:09:38.196698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.124391+0000","last_change":"2023-09-12T16:08:33.114546+0000","last_active":"2023-09-12T16:08:33.124391+0000","last_peered":"2023-09-12T16:08:33.124391+0000","last_clean":"2023-09-12T16:08:33.124391+0000","last_became_active":"2023-09-12T16:08:33.114134+0000","last_became_peered":"2023-09-12T16:08:33.114134+0000","last_unstale":"2023-09-12T16:08:33.124391+0000","last_undegraded":"2023-09-12T16:08:33.124391+0000","last_fullsized":"2023-09-12T16:08:33.124391+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:25:01.198031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.124483+0000","last_change":"2023-09-12T16:08:33.114058+0000","last_active":"2023-09-12T16:08:33.124483+0000","last_peered":"2023-09-12T16:08:33.124483+0000","last_clean":"2023-09-12T16:08:33.124483+0000","last_became_active":"2023-09-12T16:08:33.113885+0000","last_became_peered":"2023-09-12T16:08:33.113885+0000","last_unstale":"2023-09-12T16:08:33.124483+0000","last_undegraded":"2023-09-12T16:08:33.124483+0000","last_fullsized":"2023-09-12T16:08:33.124483+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T16:46:37.023406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126968+0000","last_change":"2023-09-12T16:08:33.116810+0000","last_active":"2023-09-12T16:08:33.126968+0000","last_peered":"2023-09-12T16:08:33.126968+0000","last_clean":"2023-09-12T16:08:33.126968+0000","last_became_active":"2023-09-12T16:08:33.116536+0000","last_became_peered":"2023-09-12T16:08:33.116536+0000","last_unstale":"2023-09-12T16:08:33.126968+0000","last_undegraded":"2023-09-12T16:08:33.126968+0000","last_fullsized":"2023-09-12T16:08:33.126968+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:55:43.226971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.122143+0000","last_change":"2023-09-12T16:08:33.115739+0000","last_active":"2023-09-12T16:08:33.122143+0000","last_peered":"2023-09-12T16:08:33.122143+0000","last_clean":"2023-09-12T16:08:33.122143+0000","last_became_active":"2023-09-12T16:08:33.115219+0000","last_became_peered":"2023-09-12T16:08:33.115219+0000","last_unstale":"2023-09-12T16:08:33.122143+0000","last_undegraded":"2023-09-12T16:08:33.122143+0000","last_fullsized":"2023-09-12T16:08:33.122143+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:09:38.196698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.129643+0000","last_change":"2023-09-12T16:08:33.120774+0000","last_active":"2023-09-12T16:08:33.129643+0000","last_peered":"2023-09-12T16:08:33.129643+0000","last_clean":"2023-09-12T16:08:33.129643+0000","last_became_active":"2023-09-12T16:08:33.120519+0000","last_became_peered":"2023-09-12T16:08:33.120519+0000","last_unstale":"2023-09-12T16:08:33.129643+0000","last_undegraded":"2023-09-12T16:08:33.129643+0000","last_fullsized":"2023-09-12T16:08:33.129643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:31:40.345656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126637+0000","last_change":"2023-09-12T16:08:33.116619+0000","last_active":"2023-09-12T16:08:33.126637+0000","last_peered":"2023-09-12T16:08:33.126637+0000","last_clean":"2023-09-12T16:08:33.126637+0000","last_became_active":"2023-09-12T16:08:33.116167+0000","last_became_peered":"2023-09-12T16:08:33.116167+0000","last_unstale":"2023-09-12T16:08:33.126637+0000","last_undegraded":"2023-09-12T16:08:33.126637+0000","last_fullsized":"2023-09-12T16:08:33.126637+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:25:03.910239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.128434+0000","last_change":"2023-09-12T16:08:33.123550+0000","last_active":"2023-09-12T16:08:33.128434+0000","last_peered":"2023-09-12T16:08:33.128434+0000","last_clean":"2023-09-12T16:08:33.128434+0000","last_became_active":"2023-09-12T16:08:33.123220+0000","last_became_peered":"2023-09-12T16:08:33.123220+0000","last_unstale":"2023-09-12T16:08:33.128434+0000","last_undegraded":"2023-09-12T16:08:33.128434+0000","last_fullsized":"2023-09-12T16:08:33.128434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:33:08.512795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126621+0000","last_change":"2023-09-12T16:08:33.118273+0000","last_active":"2023-09-12T16:08:33.126621+0000","last_peered":"2023-09-12T16:08:33.126621+0000","last_clean":"2023-09-12T16:08:33.126621+0000","last_became_active":"2023-09-12T16:08:33.117959+0000","last_became_peered":"2023-09-12T16:08:33.117959+0000","last_unstale":"2023-09-12T16:08:33.126621+0000","last_undegraded":"2023-09-12T16:08:33.126621+0000","last_fullsized":"2023-09-12T16:08:33.126621+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:25:03.910239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.129861+0000","last_change":"2023-09-12T16:08:33.123984+0000","last_active":"2023-09-12T16:08:33.129861+0000","last_peered":"2023-09-12T16:08:33.129861+0000","last_clean":"2023-09-12T16:08:33.129861+0000","last_became_active":"2023-09-12T16:08:33.123706+0000","last_became_peered":"2023-09-12T16:08:33.123706+0000","last_unstale":"2023-09-12T16:08:33.129861+0000","last_undegraded":"2023-09-12T16:08:33.129861+0000","last_fullsized":"2023-09-12T16:08:33.129861+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:00:08.235056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126183+0000","last_change":"2023-09-12T16:08:33.121002+0000","last_active":"2023-09-12T16:08:33.126183+0000","last_peered":"2023-09-12T16:08:33.126183+0000","last_clean":"2023-09-12T16:08:33.126183+0000","last_became_active":"2023-09-12T16:08:33.120717+0000","last_became_peered":"2023-09-12T16:08:33.120717+0000","last_unstale":"2023-09-12T16:08:33.126183+0000","last_undegraded":"2023-09-12T16:08:33.126183+0000","last_fullsized":"2023-09-12T16:08:33.126183+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:07:51.683017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.123811+0000","last_change":"2023-09-12T16:08:33.117456+0000","last_active":"2023-09-12T16:08:33.123811+0000","last_peered":"2023-09-12T16:08:33.123811+0000","last_clean":"2023-09-12T16:08:33.123811+0000","last_became_active":"2023-09-12T16:08:33.117176+0000","last_became_peered":"2023-09-12T16:08:33.117176+0000","last_unstale":"2023-09-12T16:08:33.123811+0000","last_undegraded":"2023-09-12T16:08:33.123811+0000","last_fullsized":"2023-09-12T16:08:33.123811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:08:07.131308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.122123+0000","last_change":"2023-09-12T16:08:33.115514+0000","last_active":"2023-09-12T16:08:33.122123+0000","last_peered":"2023-09-12T16:08:33.122123+0000","last_clean":"2023-09-12T16:08:33.122123+0000","last_became_active":"2023-09-12T16:08:33.114837+0000","last_became_peered":"2023-09-12T16:08:33.114837+0000","last_unstale":"2023-09-12T16:08:33.122123+0000","last_undegraded":"2023-09-12T16:08:33.122123+0000","last_fullsized":"2023-09-12T16:08:33.122123+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:34:57.690903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.137297+0000","last_change":"2023-09-12T16:08:33.132272+0000","last_active":"2023-09-12T16:08:33.137297+0000","last_peered":"2023-09-12T16:08:33.137297+0000","last_clean":"2023-09-12T16:08:33.137297+0000","last_became_active":"2023-09-12T16:08:33.132007+0000","last_became_peered":"2023-09-12T16:08:33.132007+0000","last_unstale":"2023-09-12T16:08:33.137297+0000","last_undegraded":"2023-09-12T16:08:33.137297+0000","last_fullsized":"2023-09-12T16:08:33.137297+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:44:09.196495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.137495+0000","last_change":"2023-09-12T16:08:33.135013+0000","last_active":"2023-09-12T16:08:33.137495+0000","last_peered":"2023-09-12T16:08:33.137495+0000","last_clean":"2023-09-12T16:08:33.137495+0000","last_became_active":"2023-09-12T16:08:33.133580+0000","last_became_peered":"2023-09-12T16:08:33.133580+0000","last_unstale":"2023-09-12T16:08:33.137495+0000","last_undegraded":"2023-09-12T16:08:33.137495+0000","last_fullsized":"2023-09-12T16:08:33.137495+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:05:13.192195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.125288+0000","last_change":"2023-09-12T16:08:33.116560+0000","last_active":"2023-09-12T16:08:33.125288+0000","last_peered":"2023-09-12T16:08:33.125288+0000","last_clean":"2023-09-12T16:08:33.125288+0000","last_became_active":"2023-09-12T16:08:33.115863+0000","last_became_peered":"2023-09-12T16:08:33.115863+0000","last_unstale":"2023-09-12T16:08:33.125288+0000","last_undegraded":"2023-09-12T16:08:33.125288+0000","last_fullsized":"2023-09-12T16:08:33.125288+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:23:59.946149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.127704+0000","last_change":"2023-09-12T16:08:33.120986+0000","last_active":"2023-09-12T16:08:33.127704+0000","last_peered":"2023-09-12T16:08:33.127704+0000","last_clean":"2023-09-12T16:08:33.127704+0000","last_became_active":"2023-09-12T16:08:33.120639+0000","last_became_peered":"2023-09-12T16:08:33.120639+0000","last_unstale":"2023-09-12T16:08:33.127704+0000","last_undegraded":"2023-09-12T16:08:33.127704+0000","last_fullsized":"2023-09-12T16:08:33.127704+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:46:26.956423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126621+0000","last_change":"2023-09-12T16:08:33.116243+0000","last_active":"2023-09-12T16:08:33.126621+0000","last_peered":"2023-09-12T16:08:33.126621+0000","last_clean":"2023-09-12T16:08:33.126621+0000","last_became_active":"2023-09-12T16:08:33.115950+0000","last_became_peered":"2023-09-12T16:08:33.115950+0000","last_unstale":"2023-09-12T16:08:33.126621+0000","last_undegraded":"2023-09-12T16:08:33.126621+0000","last_fullsized":"2023-09-12T16:08:33.126621+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:25:01.198031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.128390+0000","last_change":"2023-09-12T16:08:33.124227+0000","last_active":"2023-09-12T16:08:33.128390+0000","last_peered":"2023-09-12T16:08:33.128390+0000","last_clean":"2023-09-12T16:08:33.128390+0000","last_became_active":"2023-09-12T16:08:33.123893+0000","last_became_peered":"2023-09-12T16:08:33.123893+0000","last_unstale":"2023-09-12T16:08:33.128390+0000","last_undegraded":"2023-09-12T16:08:33.128390+0000","last_fullsized":"2023-09-12T16:08:33.128390+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:05:13.192195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.123762+0000","last_change":"2023-09-12T16:08:33.114640+0000","last_active":"2023-09-12T16:08:33.123762+0000","last_peered":"2023-09-12T16:08:33.123762+0000","last_clean":"2023-09-12T16:08:33.123762+0000","last_became_active":"2023-09-12T16:08:33.114375+0000","last_became_peered":"2023-09-12T16:08:33.114375+0000","last_unstale":"2023-09-12T16:08:33.123762+0000","last_undegraded":"2023-09-12T16:08:33.123762+0000","last_fullsized":"2023-09-12T16:08:33.123762+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:14:15.485968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.136818+0000","last_change":"2023-09-12T16:08:33.131754+0000","last_active":"2023-09-12T16:08:33.136818+0000","last_peered":"2023-09-12T16:08:33.136818+0000","last_clean":"2023-09-12T16:08:33.136818+0000","last_became_active":"2023-09-12T16:08:33.127726+0000","last_became_peered":"2023-09-12T16:08:33.127726+0000","last_unstale":"2023-09-12T16:08:33.136818+0000","last_undegraded":"2023-09-12T16:08:33.136818+0000","last_fullsized":"2023-09-12T16:08:33.136818+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:09:38.196698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126724+0000","last_change":"2023-09-12T16:08:33.121533+0000","last_active":"2023-09-12T16:08:33.126724+0000","last_peered":"2023-09-12T16:08:33.126724+0000","last_clean":"2023-09-12T16:08:33.126724+0000","last_became_active":"2023-09-12T16:08:33.121293+0000","last_became_peered":"2023-09-12T16:08:33.121293+0000","last_unstale":"2023-09-12T16:08:33.126724+0000","last_undegraded":"2023-09-12T16:08:33.126724+0000","last_fullsized":"2023-09-12T16:08:33.126724+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:00:14.640701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126349+0000","last_change":"2023-09-12T16:08:33.115255+0000","last_active":"2023-09-12T16:08:33.126349+0000","last_peered":"2023-09-12T16:08:33.126349+0000","last_clean":"2023-09-12T16:08:33.126349+0000","last_became_active":"2023-09-12T16:08:33.114970+0000","last_became_peered":"2023-09-12T16:08:33.114970+0000","last_unstale":"2023-09-12T16:08:33.126349+0000","last_undegraded":"2023-09-12T16:08:33.126349+0000","last_fullsized":"2023-09-12T16:08:33.126349+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:14:15.485968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126882+0000","last_change":"2023-09-12T16:08:33.118769+0000","last_active":"2023-09-12T16:08:33.126882+0000","last_peered":"2023-09-12T16:08:33.126882+0000","last_clean":"2023-09-12T16:08:33.126882+0000","last_became_active":"2023-09-12T16:08:33.118509+0000","last_became_peered":"2023-09-12T16:08:33.118509+0000","last_unstale":"2023-09-12T16:08:33.126882+0000","last_undegraded":"2023-09-12T16:08:33.126882+0000","last_fullsized":"2023-09-12T16:08:33.126882+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:09:38.196698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.112263+0000","last_change":"2023-09-12T16:08:33.110022+0000","last_active":"2023-09-12T16:08:33.112263+0000","last_peered":"2023-09-12T16:08:33.112263+0000","last_clean":"2023-09-12T16:08:33.112263+0000","last_became_active":"2023-09-12T16:08:33.109726+0000","last_became_peered":"2023-09-12T16:08:33.109726+0000","last_unstale":"2023-09-12T16:08:33.112263+0000","last_undegraded":"2023-09-12T16:08:33.112263+0000","last_fullsized":"2023-09-12T16:08:33.112263+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:00:08.235056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.122087+0000","last_change":"2023-09-12T16:08:33.115626+0000","last_active":"2023-09-12T16:08:33.122087+0000","last_peered":"2023-09-12T16:08:33.122087+0000","last_clean":"2023-09-12T16:08:33.122087+0000","last_became_active":"2023-09-12T16:08:33.115331+0000","last_became_peered":"2023-09-12T16:08:33.115331+0000","last_unstale":"2023-09-12T16:08:33.122087+0000","last_undegraded":"2023-09-12T16:08:33.122087+0000","last_fullsized":"2023-09-12T16:08:33.122087+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:58:38.033978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.127217+0000","last_change":"2023-09-12T16:08:33.119991+0000","last_active":"2023-09-12T16:08:33.127217+0000","last_peered":"2023-09-12T16:08:33.127217+0000","last_clean":"2023-09-12T16:08:33.127217+0000","last_became_active":"2023-09-12T16:08:33.119728+0000","last_became_peered":"2023-09-12T16:08:33.119728+0000","last_unstale":"2023-09-12T16:08:33.127217+0000","last_undegraded":"2023-09-12T16:08:33.127217+0000","last_fullsized":"2023-09-12T16:08:33.127217+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:08:07.131308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126541+0000","last_change":"2023-09-12T16:08:33.115240+0000","last_active":"2023-09-12T16:08:33.126541+0000","last_peered":"2023-09-12T16:08:33.126541+0000","last_clean":"2023-09-12T16:08:33.126541+0000","last_became_active":"2023-09-12T16:08:33.114957+0000","last_became_peered":"2023-09-12T16:08:33.114957+0000","last_unstale":"2023-09-12T16:08:33.126541+0000","last_undegraded":"2023-09-12T16:08:33.126541+0000","last_fullsized":"2023-09-12T16:08:33.126541+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:30:48.606037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.136796+0000","last_change":"2023-09-12T16:08:33.131633+0000","last_active":"2023-09-12T16:08:33.136796+0000","last_peered":"2023-09-12T16:08:33.136796+0000","last_clean":"2023-09-12T16:08:33.136796+0000","last_became_active":"2023-09-12T16:08:33.131354+0000","last_became_peered":"2023-09-12T16:08:33.131354+0000","last_unstale":"2023-09-12T16:08:33.136796+0000","last_undegraded":"2023-09-12T16:08:33.136796+0000","last_fullsized":"2023-09-12T16:08:33.136796+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:14:15.485968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.127858+0000","last_change":"2023-09-12T16:08:33.116204+0000","last_active":"2023-09-12T16:08:33.127858+0000","last_peered":"2023-09-12T16:08:33.127858+0000","last_clean":"2023-09-12T16:08:33.127858+0000","last_became_active":"2023-09-12T16:08:33.115928+0000","last_became_peered":"2023-09-12T16:08:33.115928+0000","last_unstale":"2023-09-12T16:08:33.127858+0000","last_undegraded":"2023-09-12T16:08:33.127858+0000","last_fullsized":"2023-09-12T16:08:33.127858+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:56.845163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.133965+0000","last_change":"2023-09-12T16:08:33.131042+0000","last_active":"2023-09-12T16:08:33.133965+0000","last_peered":"2023-09-12T16:08:33.133965+0000","last_clean":"2023-09-12T16:08:33.133965+0000","last_became_active":"2023-09-12T16:08:33.130268+0000","last_became_peered":"2023-09-12T16:08:33.130268+0000","last_unstale":"2023-09-12T16:08:33.133965+0000","last_undegraded":"2023-09-12T16:08:33.133965+0000","last_fullsized":"2023-09-12T16:08:33.133965+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:55:43.226971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.138337+0000","last_change":"2023-09-12T16:08:32.100841+0000","last_active":"2023-09-12T16:08:33.138337+0000","last_peered":"2023-09-12T16:08:33.138337+0000","last_clean":"2023-09-12T16:08:33.138337+0000","last_became_active":"2023-09-12T16:08:32.100555+0000","last_became_peered":"2023-09-12T16:08:32.100555+0000","last_unstale":"2023-09-12T16:08:33.138337+0000","last_undegraded":"2023-09-12T16:08:33.138337+0000","last_fullsized":"2023-09-12T16:08:33.138337+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:55:42.220954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126994+0000","last_change":"2023-09-12T16:08:33.120236+0000","last_active":"2023-09-12T16:08:33.126994+0000","last_peered":"2023-09-12T16:08:33.126994+0000","last_clean":"2023-09-12T16:08:33.126994+0000","last_became_active":"2023-09-12T16:08:33.119944+0000","last_became_peered":"2023-09-12T16:08:33.119944+0000","last_unstale":"2023-09-12T16:08:33.126994+0000","last_undegraded":"2023-09-12T16:08:33.126994+0000","last_fullsized":"2023-09-12T16:08:33.126994+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:34:57.690903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.134682+0000","last_change":"2023-09-12T16:08:32.105729+0000","last_active":"2023-09-12T16:08:33.134682+0000","last_peered":"2023-09-12T16:08:33.134682+0000","last_clean":"2023-09-12T16:08:33.134682+0000","last_became_active":"2023-09-12T16:08:32.105258+0000","last_became_peered":"2023-09-12T16:08:32.105258+0000","last_unstale":"2023-09-12T16:08:33.134682+0000","last_undegraded":"2023-09-12T16:08:33.134682+0000","last_fullsized":"2023-09-12T16:08:33.134682+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:07:50.676999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.120327+0000","last_change":"2023-09-12T16:08:33.115278+0000","last_active":"2023-09-12T16:08:33.120327+0000","last_peered":"2023-09-12T16:08:33.120327+0000","last_clean":"2023-09-12T16:08:33.120327+0000","last_became_active":"2023-09-12T16:08:33.114999+0000","last_became_peered":"2023-09-12T16:08:33.114999+0000","last_unstale":"2023-09-12T16:08:33.120327+0000","last_undegraded":"2023-09-12T16:08:33.120327+0000","last_fullsized":"2023-09-12T16:08:33.120327+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:55:43.226971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.133703+0000","last_change":"2023-09-12T16:08:32.100562+0000","last_active":"2023-09-12T16:08:33.133703+0000","last_peered":"2023-09-12T16:08:33.133703+0000","last_clean":"2023-09-12T16:08:33.133703+0000","last_became_active":"2023-09-12T16:08:32.100289+0000","last_became_peered":"2023-09-12T16:08:32.100289+0000","last_unstale":"2023-09-12T16:08:33.133703+0000","last_undegraded":"2023-09-12T16:08:33.133703+0000","last_fullsized":"2023-09-12T16:08:33.133703+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:31:39.339639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.121616+0000","last_change":"2023-09-12T16:08:33.112957+0000","last_active":"2023-09-12T16:08:33.121616+0000","last_peered":"2023-09-12T16:08:33.121616+0000","last_clean":"2023-09-12T16:08:33.121616+0000","last_became_active":"2023-09-12T16:08:33.112292+0000","last_became_peered":"2023-09-12T16:08:33.112292+0000","last_unstale":"2023-09-12T16:08:33.121616+0000","last_undegraded":"2023-09-12T16:08:33.121616+0000","last_fullsized":"2023-09-12T16:08:33.121616+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:41:28.014180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.133815+0000","last_change":"2023-09-12T16:08:32.100507+0000","last_active":"2023-09-12T16:08:33.133815+0000","last_peered":"2023-09-12T16:08:33.133815+0000","last_clean":"2023-09-12T16:08:33.133815+0000","last_became_active":"2023-09-12T16:08:32.100095+0000","last_became_peered":"2023-09-12T16:08:32.100095+0000","last_unstale":"2023-09-12T16:08:33.133815+0000","last_undegraded":"2023-09-12T16:08:33.133815+0000","last_fullsized":"2023-09-12T16:08:33.133815+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:56:33.974574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.129257+0000","last_change":"2023-09-12T16:08:33.124955+0000","last_active":"2023-09-12T16:08:33.129257+0000","last_peered":"2023-09-12T16:08:33.129257+0000","last_clean":"2023-09-12T16:08:33.129257+0000","last_became_active":"2023-09-12T16:08:33.124617+0000","last_became_peered":"2023-09-12T16:08:33.124617+0000","last_unstale":"2023-09-12T16:08:33.129257+0000","last_undegraded":"2023-09-12T16:08:33.129257+0000","last_fullsized":"2023-09-12T16:08:33.129257+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:08:07.131308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.129667+0000","last_change":"2023-09-12T16:08:32.106762+0000","last_active":"2023-09-12T16:08:33.129667+0000","last_peered":"2023-09-12T16:08:33.129667+0000","last_clean":"2023-09-12T16:08:33.129667+0000","last_became_active":"2023-09-12T16:08:32.106464+0000","last_became_peered":"2023-09-12T16:08:32.106464+0000","last_unstale":"2023-09-12T16:08:33.129667+0000","last_undegraded":"2023-09-12T16:08:33.129667+0000","last_fullsized":"2023-09-12T16:08:33.129667+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:31:39.339639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.128471+0000","last_change":"2023-09-12T16:08:33.124717+0000","last_active":"2023-09-12T16:08:33.128471+0000","last_peered":"2023-09-12T16:08:33.128471+0000","last_clean":"2023-09-12T16:08:33.128471+0000","last_became_active":"2023-09-12T16:08:33.124391+0000","last_became_peered":"2023-09-12T16:08:33.124391+0000","last_unstale":"2023-09-12T16:08:33.128471+0000","last_undegraded":"2023-09-12T16:08:33.128471+0000","last_fullsized":"2023-09-12T16:08:33.128471+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:56.845163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.129789+0000","last_change":"2023-09-12T16:08:32.103125+0000","last_active":"2023-09-12T16:08:33.129789+0000","last_peered":"2023-09-12T16:08:33.129789+0000","last_clean":"2023-09-12T16:08:33.129789+0000","last_became_active":"2023-09-12T16:08:32.102828+0000","last_became_peered":"2023-09-12T16:08:32.102828+0000","last_unstale":"2023-09-12T16:08:33.129789+0000","last_undegraded":"2023-09-12T16:08:33.129789+0000","last_fullsized":"2023-09-12T16:08:33.129789+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:00:07.229038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.123828+0000","last_change":"2023-09-12T16:08:33.118401+0000","last_active":"2023-09-12T16:08:33.123828+0000","last_peered":"2023-09-12T16:08:33.123828+0000","last_clean":"2023-09-12T16:08:33.123828+0000","last_became_active":"2023-09-12T16:08:33.118053+0000","last_became_peered":"2023-09-12T16:08:33.118053+0000","last_unstale":"2023-09-12T16:08:33.123828+0000","last_undegraded":"2023-09-12T16:08:33.123828+0000","last_fullsized":"2023-09-12T16:08:33.123828+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:44:09.196495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.106941+0000","last_change":"2023-09-12T16:08:32.103791+0000","last_active":"2023-09-12T16:08:33.106941+0000","last_peered":"2023-09-12T16:08:33.106941+0000","last_clean":"2023-09-12T16:08:33.106941+0000","last_became_active":"2023-09-12T16:08:32.103508+0000","last_became_peered":"2023-09-12T16:08:32.103508+0000","last_unstale":"2023-09-12T16:08:33.106941+0000","last_undegraded":"2023-09-12T16:08:33.106941+0000","last_fullsized":"2023-09-12T16:08:33.106941+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:07:50.676999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.129890+0000","last_change":"2023-09-12T16:08:33.122813+0000","last_active":"2023-09-12T16:08:33.129890+0000","last_peered":"2023-09-12T16:08:33.129890+0000","last_clean":"2023-09-12T16:08:33.129890+0000","last_became_active":"2023-09-12T16:08:33.122403+0000","last_became_peered":"2023-09-12T16:08:33.122403+0000","last_unstale":"2023-09-12T16:08:33.129890+0000","last_undegraded":"2023-09-12T16:08:33.129890+0000","last_fullsized":"2023-09-12T16:08:33.129890+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T16:32:58.926616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.106246+0000","last_change":"2023-09-12T16:08:32.099806+0000","last_active":"2023-09-12T16:08:33.106246+0000","last_peered":"2023-09-12T16:08:33.106246+0000","last_clean":"2023-09-12T16:08:33.106246+0000","last_became_active":"2023-09-12T16:08:32.099537+0000","last_became_peered":"2023-09-12T16:08:32.099537+0000","last_unstale":"2023-09-12T16:08:33.106246+0000","last_undegraded":"2023-09-12T16:08:33.106246+0000","last_fullsized":"2023-09-12T16:08:33.106246+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:55.839146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.124366+0000","last_change":"2023-09-12T16:08:33.114390+0000","last_active":"2023-09-12T16:08:33.124366+0000","last_peered":"2023-09-12T16:08:33.124366+0000","last_clean":"2023-09-12T16:08:33.124366+0000","last_became_active":"2023-09-12T16:08:33.113728+0000","last_became_peered":"2023-09-12T16:08:33.113728+0000","last_unstale":"2023-09-12T16:08:33.124366+0000","last_undegraded":"2023-09-12T16:08:33.124366+0000","last_fullsized":"2023-09-12T16:08:33.124366+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:23:59.946149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.099579+0000","last_change":"2023-09-12T16:08:32.092121+0000","last_active":"2023-09-12T16:08:33.099579+0000","last_peered":"2023-09-12T16:08:33.099579+0000","last_clean":"2023-09-12T16:08:33.099579+0000","last_became_active":"2023-09-12T16:08:32.091787+0000","last_became_peered":"2023-09-12T16:08:32.091787+0000","last_unstale":"2023-09-12T16:08:33.099579+0000","last_undegraded":"2023-09-12T16:08:33.099579+0000","last_fullsized":"2023-09-12T16:08:33.099579+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:01:13.109813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.137397+0000","last_change":"2023-09-12T16:08:33.134641+0000","last_active":"2023-09-12T16:08:33.137397+0000","last_peered":"2023-09-12T16:08:33.137397+0000","last_clean":"2023-09-12T16:08:33.137397+0000","last_became_active":"2023-09-12T16:08:33.133968+0000","last_became_peered":"2023-09-12T16:08:33.133968+0000","last_unstale":"2023-09-12T16:08:33.137397+0000","last_undegraded":"2023-09-12T16:08:33.137397+0000","last_fullsized":"2023-09-12T16:08:33.137397+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:25:03.910239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.107917+0000","last_change":"2023-09-12T16:08:32.105779+0000","last_active":"2023-09-12T16:08:33.107917+0000","last_peered":"2023-09-12T16:08:33.107917+0000","last_clean":"2023-09-12T16:08:33.107917+0000","last_became_active":"2023-09-12T16:08:32.104386+0000","last_became_peered":"2023-09-12T16:08:32.104386+0000","last_unstale":"2023-09-12T16:08:33.107917+0000","last_undegraded":"2023-09-12T16:08:33.107917+0000","last_fullsized":"2023-09-12T16:08:33.107917+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:18:37.932139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.128231+0000","last_change":"2023-09-12T16:08:33.122385+0000","last_active":"2023-09-12T16:08:33.128231+0000","last_peered":"2023-09-12T16:08:33.128231+0000","last_clean":"2023-09-12T16:08:33.128231+0000","last_became_active":"2023-09-12T16:08:33.122114+0000","last_became_peered":"2023-09-12T16:08:33.122114+0000","last_unstale":"2023-09-12T16:08:33.128231+0000","last_undegraded":"2023-09-12T16:08:33.128231+0000","last_fullsized":"2023-09-12T16:08:33.128231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:42:42.601295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.132226+0000","last_change":"2023-09-12T16:08:32.105384+0000","last_active":"2023-09-12T16:08:33.132226+0000","last_peered":"2023-09-12T16:08:33.132226+0000","last_clean":"2023-09-12T16:08:33.132226+0000","last_became_active":"2023-09-12T16:08:32.105079+0000","last_became_peered":"2023-09-12T16:08:32.105079+0000","last_unstale":"2023-09-12T16:08:33.132226+0000","last_undegraded":"2023-09-12T16:08:33.132226+0000","last_fullsized":"2023-09-12T16:08:33.132226+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:11:25.027682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.120357+0000","last_change":"2023-09-12T16:08:33.114003+0000","last_active":"2023-09-12T16:08:33.120357+0000","last_peered":"2023-09-12T16:08:33.120357+0000","last_clean":"2023-09-12T16:08:33.120357+0000","last_became_active":"2023-09-12T16:08:33.113723+0000","last_became_peered":"2023-09-12T16:08:33.113723+0000","last_unstale":"2023-09-12T16:08:33.120357+0000","last_undegraded":"2023-09-12T16:08:33.120357+0000","last_fullsized":"2023-09-12T16:08:33.120357+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:09:38.196698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.140215+0000","last_change":"2023-09-12T16:08:32.100860+0000","last_active":"2023-09-12T16:08:33.140215+0000","last_peered":"2023-09-12T16:08:33.140215+0000","last_clean":"2023-09-12T16:08:33.140215+0000","last_became_active":"2023-09-12T16:08:32.100556+0000","last_became_peered":"2023-09-12T16:08:32.100556+0000","last_unstale":"2023-09-12T16:08:33.140215+0000","last_undegraded":"2023-09-12T16:08:33.140215+0000","last_fullsized":"2023-09-12T16:08:33.140215+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:11:25.027682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.124794+0000","last_change":"2023-09-12T16:08:33.115305+0000","last_active":"2023-09-12T16:08:33.124794+0000","last_peered":"2023-09-12T16:08:33.124794+0000","last_clean":"2023-09-12T16:08:33.124794+0000","last_became_active":"2023-09-12T16:08:33.115040+0000","last_became_peered":"2023-09-12T16:08:33.115040+0000","last_unstale":"2023-09-12T16:08:33.124794+0000","last_undegraded":"2023-09-12T16:08:33.124794+0000","last_fullsized":"2023-09-12T16:08:33.124794+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:55:43.226971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.133340+0000","last_change":"2023-09-12T16:08:32.102177+0000","last_active":"2023-09-12T16:08:33.133340+0000","last_peered":"2023-09-12T16:08:33.133340+0000","last_clean":"2023-09-12T16:08:33.133340+0000","last_became_active":"2023-09-12T16:08:32.101914+0000","last_became_peered":"2023-09-12T16:08:32.101914+0000","last_unstale":"2023-09-12T16:08:33.133340+0000","last_undegraded":"2023-09-12T16:08:33.133340+0000","last_fullsized":"2023-09-12T16:08:33.133340+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:24:08.229327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126399+0000","last_change":"2023-09-12T16:08:33.113644+0000","last_active":"2023-09-12T16:08:33.126399+0000","last_peered":"2023-09-12T16:08:33.126399+0000","last_clean":"2023-09-12T16:08:33.126399+0000","last_became_active":"2023-09-12T16:08:33.113422+0000","last_became_peered":"2023-09-12T16:08:33.113422+0000","last_unstale":"2023-09-12T16:08:33.126399+0000","last_undegraded":"2023-09-12T16:08:33.126399+0000","last_fullsized":"2023-09-12T16:08:33.126399+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:13:55.779904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.105919+0000","last_change":"2023-09-12T16:08:32.106007+0000","last_active":"2023-09-12T16:08:33.105919+0000","last_peered":"2023-09-12T16:08:33.105919+0000","last_clean":"2023-09-12T16:08:33.105919+0000","last_became_active":"2023-09-12T16:08:32.105757+0000","last_became_peered":"2023-09-12T16:08:32.105757+0000","last_unstale":"2023-09-12T16:08:33.105919+0000","last_undegraded":"2023-09-12T16:08:33.105919+0000","last_fullsized":"2023-09-12T16:08:33.105919+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:05:12.186177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.131935+0000","last_change":"2023-09-12T16:08:33.127293+0000","last_active":"2023-09-12T16:08:33.131935+0000","last_peered":"2023-09-12T16:08:33.131935+0000","last_clean":"2023-09-12T16:08:33.131935+0000","last_became_active":"2023-09-12T16:08:33.127037+0000","last_became_peered":"2023-09-12T16:08:33.127037+0000","last_unstale":"2023-09-12T16:08:33.131935+0000","last_undegraded":"2023-09-12T16:08:33.131935+0000","last_fullsized":"2023-09-12T16:08:33.131935+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:08:07.131308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.100838+0000","last_change":"2023-09-12T16:08:32.101682+0000","last_active":"2023-09-12T16:08:33.100838+0000","last_peered":"2023-09-12T16:08:33.100838+0000","last_clean":"2023-09-12T16:08:33.100838+0000","last_became_active":"2023-09-12T16:08:32.101341+0000","last_became_peered":"2023-09-12T16:08:32.101341+0000","last_unstale":"2023-09-12T16:08:33.100838+0000","last_undegraded":"2023-09-12T16:08:33.100838+0000","last_fullsized":"2023-09-12T16:08:33.100838+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:38:33.657951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.129852+0000","last_change":"2023-09-12T16:08:33.119003+0000","last_active":"2023-09-12T16:08:33.129852+0000","last_peered":"2023-09-12T16:08:33.129852+0000","last_clean":"2023-09-12T16:08:33.129852+0000","last_became_active":"2023-09-12T16:08:33.118747+0000","last_became_peered":"2023-09-12T16:08:33.118747+0000","last_unstale":"2023-09-12T16:08:33.129852+0000","last_undegraded":"2023-09-12T16:08:33.129852+0000","last_fullsized":"2023-09-12T16:08:33.129852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:36:45.571613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.136139+0000","last_change":"2023-09-12T16:08:32.103219+0000","last_active":"2023-09-12T16:08:33.136139+0000","last_peered":"2023-09-12T16:08:33.136139+0000","last_clean":"2023-09-12T16:08:33.136139+0000","last_became_active":"2023-09-12T16:08:32.102946+0000","last_became_peered":"2023-09-12T16:08:32.102946+0000","last_unstale":"2023-09-12T16:08:33.136139+0000","last_undegraded":"2023-09-12T16:08:33.136139+0000","last_fullsized":"2023-09-12T16:08:33.136139+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:38:33.657951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.113816+0000","last_change":"2023-09-12T16:08:33.106057+0000","last_active":"2023-09-12T16:08:33.113816+0000","last_peered":"2023-09-12T16:08:33.113816+0000","last_clean":"2023-09-12T16:08:33.113816+0000","last_became_active":"2023-09-12T16:08:33.105783+0000","last_became_peered":"2023-09-12T16:08:33.105783+0000","last_unstale":"2023-09-12T16:08:33.113816+0000","last_undegraded":"2023-09-12T16:08:33.113816+0000","last_fullsized":"2023-09-12T16:08:33.113816+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:18:38.938156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.134775+0000","last_change":"2023-09-12T16:08:32.105070+0000","last_active":"2023-09-12T16:08:33.134775+0000","last_peered":"2023-09-12T16:08:33.134775+0000","last_clean":"2023-09-12T16:08:33.134775+0000","last_became_active":"2023-09-12T16:08:32.104761+0000","last_became_peered":"2023-09-12T16:08:32.104761+0000","last_unstale":"2023-09-12T16:08:33.134775+0000","last_undegraded":"2023-09-12T16:08:33.134775+0000","last_fullsized":"2023-09-12T16:08:33.134775+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:41:27.008163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.128496+0000","last_change":"2023-09-12T16:08:33.124811+0000","last_active":"2023-09-12T16:08:33.128496+0000","last_peered":"2023-09-12T16:08:33.128496+0000","last_clean":"2023-09-12T16:08:33.128496+0000","last_became_active":"2023-09-12T16:08:33.124524+0000","last_became_peered":"2023-09-12T16:08:33.124524+0000","last_unstale":"2023-09-12T16:08:33.128496+0000","last_undegraded":"2023-09-12T16:08:33.128496+0000","last_fullsized":"2023-09-12T16:08:33.128496+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:42:42.601295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.138734+0000","last_change":"2023-09-12T16:08:32.106873+0000","last_active":"2023-09-12T16:08:33.138734+0000","last_peered":"2023-09-12T16:08:33.138734+0000","last_clean":"2023-09-12T16:08:33.138734+0000","last_became_active":"2023-09-12T16:08:32.106551+0000","last_became_peered":"2023-09-12T16:08:32.106551+0000","last_unstale":"2023-09-12T16:08:33.138734+0000","last_undegraded":"2023-09-12T16:08:33.138734+0000","last_fullsized":"2023-09-12T16:08:33.138734+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:25:02.904221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.133299+0000","last_change":"2023-09-12T16:08:33.129284+0000","last_active":"2023-09-12T16:08:33.133299+0000","last_peered":"2023-09-12T16:08:33.133299+0000","last_clean":"2023-09-12T16:08:33.133299+0000","last_became_active":"2023-09-12T16:08:33.129009+0000","last_became_peered":"2023-09-12T16:08:33.129009+0000","last_unstale":"2023-09-12T16:08:33.133299+0000","last_undegraded":"2023-09-12T16:08:33.133299+0000","last_fullsized":"2023-09-12T16:08:33.133299+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:00:08.235056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.137682+0000","last_change":"2023-09-12T16:08:32.098919+0000","last_active":"2023-09-12T16:08:33.137682+0000","last_peered":"2023-09-12T16:08:33.137682+0000","last_clean":"2023-09-12T16:08:33.137682+0000","last_became_active":"2023-09-12T16:08:32.098637+0000","last_became_peered":"2023-09-12T16:08:32.098637+0000","last_unstale":"2023-09-12T16:08:33.137682+0000","last_undegraded":"2023-09-12T16:08:33.137682+0000","last_fullsized":"2023-09-12T16:08:33.137682+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:30:47.600020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.124443+0000","last_change":"2023-09-12T16:08:33.114152+0000","last_active":"2023-09-12T16:08:33.124443+0000","last_peered":"2023-09-12T16:08:33.124443+0000","last_clean":"2023-09-12T16:08:33.124443+0000","last_became_active":"2023-09-12T16:08:33.113798+0000","last_became_peered":"2023-09-12T16:08:33.113798+0000","last_unstale":"2023-09-12T16:08:33.124443+0000","last_undegraded":"2023-09-12T16:08:33.124443+0000","last_fullsized":"2023-09-12T16:08:33.124443+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:40:59.842661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.105890+0000","last_change":"2023-09-12T16:08:32.102707+0000","last_active":"2023-09-12T16:08:33.105890+0000","last_peered":"2023-09-12T16:08:33.105890+0000","last_clean":"2023-09-12T16:08:33.105890+0000","last_became_active":"2023-09-12T16:08:32.102436+0000","last_became_peered":"2023-09-12T16:08:32.102436+0000","last_unstale":"2023-09-12T16:08:33.105890+0000","last_undegraded":"2023-09-12T16:08:33.105890+0000","last_fullsized":"2023-09-12T16:08:33.105890+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:42:41.595277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.137459+0000","last_change":"2023-09-12T16:08:33.136083+0000","last_active":"2023-09-12T16:08:33.137459+0000","last_peered":"2023-09-12T16:08:33.137459+0000","last_clean":"2023-09-12T16:08:33.137459+0000","last_became_active":"2023-09-12T16:08:33.134057+0000","last_became_peered":"2023-09-12T16:08:33.134057+0000","last_unstale":"2023-09-12T16:08:33.137459+0000","last_undegraded":"2023-09-12T16:08:33.137459+0000","last_fullsized":"2023-09-12T16:08:33.137459+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:25:01.198031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.130427+0000","last_change":"2023-09-12T16:08:32.102502+0000","last_active":"2023-09-12T16:08:33.130427+0000","last_peered":"2023-09-12T16:08:33.130427+0000","last_clean":"2023-09-12T16:08:33.130427+0000","last_became_active":"2023-09-12T16:08:32.102274+0000","last_became_peered":"2023-09-12T16:08:32.102274+0000","last_unstale":"2023-09-12T16:08:33.130427+0000","last_undegraded":"2023-09-12T16:08:33.130427+0000","last_fullsized":"2023-09-12T16:08:33.130427+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:36:46.260135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.128195+0000","last_change":"2023-09-12T16:08:33.122479+0000","last_active":"2023-09-12T16:08:33.128195+0000","last_peered":"2023-09-12T16:08:33.128195+0000","last_clean":"2023-09-12T16:08:33.128195+0000","last_became_active":"2023-09-12T16:08:33.122219+0000","last_became_peered":"2023-09-12T16:08:33.122219+0000","last_unstale":"2023-09-12T16:08:33.128195+0000","last_undegraded":"2023-09-12T16:08:33.128195+0000","last_fullsized":"2023-09-12T16:08:33.128195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:56.845163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.100509+0000","last_change":"2023-09-12T16:08:32.100068+0000","last_active":"2023-09-12T16:08:33.100509+0000","last_peered":"2023-09-12T16:08:33.100509+0000","last_clean":"2023-09-12T16:08:33.100509+0000","last_became_active":"2023-09-12T16:08:32.099760+0000","last_became_peered":"2023-09-12T16:08:32.099760+0000","last_unstale":"2023-09-12T16:08:33.100509+0000","last_undegraded":"2023-09-12T16:08:33.100509+0000","last_fullsized":"2023-09-12T16:08:33.100509+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:31:20.146943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126068+0000","last_change":"2023-09-12T16:08:33.117467+0000","last_active":"2023-09-12T16:08:33.126068+0000","last_peered":"2023-09-12T16:08:33.126068+0000","last_clean":"2023-09-12T16:08:33.126068+0000","last_became_active":"2023-09-12T16:08:33.117082+0000","last_became_peered":"2023-09-12T16:08:33.117082+0000","last_unstale":"2023-09-12T16:08:33.126068+0000","last_undegraded":"2023-09-12T16:08:33.126068+0000","last_fullsized":"2023-09-12T16:08:33.126068+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:56:34.980592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.113844+0000","last_change":"2023-09-12T16:08:32.103889+0000","last_active":"2023-09-12T16:08:33.113844+0000","last_peered":"2023-09-12T16:08:33.113844+0000","last_clean":"2023-09-12T16:08:33.113844+0000","last_became_active":"2023-09-12T16:08:32.103625+0000","last_became_peered":"2023-09-12T16:08:32.103625+0000","last_unstale":"2023-09-12T16:08:33.113844+0000","last_undegraded":"2023-09-12T16:08:33.113844+0000","last_fullsized":"2023-09-12T16:08:33.113844+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:55.839146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.129873+0000","last_change":"2023-09-12T16:08:33.122739+0000","last_active":"2023-09-12T16:08:33.129873+0000","last_peered":"2023-09-12T16:08:33.129873+0000","last_clean":"2023-09-12T16:08:33.129873+0000","last_became_active":"2023-09-12T16:08:33.122023+0000","last_became_peered":"2023-09-12T16:08:33.122023+0000","last_unstale":"2023-09-12T16:08:33.129873+0000","last_undegraded":"2023-09-12T16:08:33.129873+0000","last_fullsized":"2023-09-12T16:08:33.129873+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:58:38.033978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.101965+0000","last_change":"2023-09-12T16:08:32.101958+0000","last_active":"2023-09-12T16:08:33.101965+0000","last_peered":"2023-09-12T16:08:33.101965+0000","last_clean":"2023-09-12T16:08:33.101965+0000","last_became_active":"2023-09-12T16:08:32.101680+0000","last_became_peered":"2023-09-12T16:08:32.101680+0000","last_unstale":"2023-09-12T16:08:33.101965+0000","last_undegraded":"2023-09-12T16:08:33.101965+0000","last_fullsized":"2023-09-12T16:08:33.101965+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:44:08.190478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.127084+0000","last_change":"2023-09-12T16:08:33.117043+0000","last_active":"2023-09-12T16:08:33.127084+0000","last_peered":"2023-09-12T16:08:33.127084+0000","last_clean":"2023-09-12T16:08:33.127084+0000","last_became_active":"2023-09-12T16:08:33.116803+0000","last_became_peered":"2023-09-12T16:08:33.116803+0000","last_unstale":"2023-09-12T16:08:33.127084+0000","last_undegraded":"2023-09-12T16:08:33.127084+0000","last_fullsized":"2023-09-12T16:08:33.127084+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:25:03.910239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.132304+0000","last_change":"2023-09-12T16:08:32.105597+0000","last_active":"2023-09-12T16:08:33.132304+0000","last_peered":"2023-09-12T16:08:33.132304+0000","last_clean":"2023-09-12T16:08:33.132304+0000","last_became_active":"2023-09-12T16:08:32.105302+0000","last_became_peered":"2023-09-12T16:08:32.105302+0000","last_unstale":"2023-09-12T16:08:33.132304+0000","last_undegraded":"2023-09-12T16:08:33.132304+0000","last_fullsized":"2023-09-12T16:08:33.132304+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T16:32:57.920598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.137478+0000","last_change":"2023-09-12T16:08:33.134833+0000","last_active":"2023-09-12T16:08:33.137478+0000","last_peered":"2023-09-12T16:08:33.137478+0000","last_clean":"2023-09-12T16:08:33.137478+0000","last_became_active":"2023-09-12T16:08:33.134363+0000","last_became_peered":"2023-09-12T16:08:33.134363+0000","last_unstale":"2023-09-12T16:08:33.137478+0000","last_undegraded":"2023-09-12T16:08:33.137478+0000","last_fullsized":"2023-09-12T16:08:33.137478+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:42:42.601295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.101321+0000","last_change":"2023-09-12T16:08:32.106673+0000","last_active":"2023-09-12T16:08:33.101321+0000","last_peered":"2023-09-12T16:08:33.101321+0000","last_clean":"2023-09-12T16:08:33.101321+0000","last_became_active":"2023-09-12T16:08:32.106395+0000","last_became_peered":"2023-09-12T16:08:32.106395+0000","last_unstale":"2023-09-12T16:08:33.101321+0000","last_undegraded":"2023-09-12T16:08:33.101321+0000","last_fullsized":"2023-09-12T16:08:33.101321+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:21:07.407188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.129827+0000","last_change":"2023-09-12T16:08:33.121920+0000","last_active":"2023-09-12T16:08:33.129827+0000","last_peered":"2023-09-12T16:08:33.129827+0000","last_clean":"2023-09-12T16:08:33.129827+0000","last_became_active":"2023-09-12T16:08:33.121707+0000","last_became_peered":"2023-09-12T16:08:33.121707+0000","last_unstale":"2023-09-12T16:08:33.129827+0000","last_undegraded":"2023-09-12T16:08:33.129827+0000","last_fullsized":"2023-09-12T16:08:33.129827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:39:08.995297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.104164+0000","last_change":"2023-09-12T16:08:32.101529+0000","last_active":"2023-09-12T16:08:33.104164+0000","last_peered":"2023-09-12T16:08:33.104164+0000","last_clean":"2023-09-12T16:08:33.104164+0000","last_became_active":"2023-09-12T16:08:32.101273+0000","last_became_peered":"2023-09-12T16:08:32.101273+0000","last_unstale":"2023-09-12T16:08:33.104164+0000","last_undegraded":"2023-09-12T16:08:33.104164+0000","last_fullsized":"2023-09-12T16:08:33.104164+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:56:33.974574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.129275+0000","last_change":"2023-09-12T16:08:33.125496+0000","last_active":"2023-09-12T16:08:33.129275+0000","last_peered":"2023-09-12T16:08:33.129275+0000","last_clean":"2023-09-12T16:08:33.129275+0000","last_became_active":"2023-09-12T16:08:33.125245+0000","last_became_peered":"2023-09-12T16:08:33.125245+0000","last_unstale":"2023-09-12T16:08:33.129275+0000","last_undegraded":"2023-09-12T16:08:33.129275+0000","last_fullsized":"2023-09-12T16:08:33.129275+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:14:15.485968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.105435+0000","last_change":"2023-09-12T16:08:32.105154+0000","last_active":"2023-09-12T16:08:33.105435+0000","last_peered":"2023-09-12T16:08:33.105435+0000","last_clean":"2023-09-12T16:08:33.105435+0000","last_became_active":"2023-09-12T16:08:32.104801+0000","last_became_peered":"2023-09-12T16:08:32.104801+0000","last_unstale":"2023-09-12T16:08:33.105435+0000","last_undegraded":"2023-09-12T16:08:33.105435+0000","last_fullsized":"2023-09-12T16:08:33.105435+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:05:12.186177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.129493+0000","last_change":"2023-09-12T16:08:33.122404+0000","last_active":"2023-09-12T16:08:33.129493+0000","last_peered":"2023-09-12T16:08:33.129493+0000","last_clean":"2023-09-12T16:08:33.129493+0000","last_became_active":"2023-09-12T16:08:33.122137+0000","last_became_peered":"2023-09-12T16:08:33.122137+0000","last_unstale":"2023-09-12T16:08:33.129493+0000","last_undegraded":"2023-09-12T16:08:33.129493+0000","last_fullsized":"2023-09-12T16:08:33.129493+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:56:34.980592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.100535+0000","last_change":"2023-09-12T16:08:32.097022+0000","last_active":"2023-09-12T16:08:33.100535+0000","last_peered":"2023-09-12T16:08:33.100535+0000","last_clean":"2023-09-12T16:08:33.100535+0000","last_became_active":"2023-09-12T16:08:32.096741+0000","last_became_peered":"2023-09-12T16:08:32.096741+0000","last_unstale":"2023-09-12T16:08:33.100535+0000","last_undegraded":"2023-09-12T16:08:33.100535+0000","last_fullsized":"2023-09-12T16:08:33.100535+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:44:08.190478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.123785+0000","last_change":"2023-09-12T16:08:33.117120+0000","last_active":"2023-09-12T16:08:33.123785+0000","last_peered":"2023-09-12T16:08:33.123785+0000","last_clean":"2023-09-12T16:08:33.123785+0000","last_became_active":"2023-09-12T16:08:33.116844+0000","last_became_peered":"2023-09-12T16:08:33.116844+0000","last_unstale":"2023-09-12T16:08:33.123785+0000","last_undegraded":"2023-09-12T16:08:33.123785+0000","last_fullsized":"2023-09-12T16:08:33.123785+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:25:01.198031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.104129+0000","last_change":"2023-09-12T16:08:32.100617+0000","last_active":"2023-09-12T16:08:33.104129+0000","last_peered":"2023-09-12T16:08:33.104129+0000","last_clean":"2023-09-12T16:08:33.104129+0000","last_became_active":"2023-09-12T16:08:32.100323+0000","last_became_peered":"2023-09-12T16:08:32.100323+0000","last_unstale":"2023-09-12T16:08:33.104129+0000","last_undegraded":"2023-09-12T16:08:33.104129+0000","last_fullsized":"2023-09-12T16:08:33.104129+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:38:33.657951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.131856+0000","last_change":"2023-09-12T16:08:33.124460+0000","last_active":"2023-09-12T16:08:33.131856+0000","last_peered":"2023-09-12T16:08:33.131856+0000","last_clean":"2023-09-12T16:08:33.131856+0000","last_became_active":"2023-09-12T16:08:33.123765+0000","last_became_peered":"2023-09-12T16:08:33.123765+0000","last_unstale":"2023-09-12T16:08:33.131856+0000","last_undegraded":"2023-09-12T16:08:33.131856+0000","last_fullsized":"2023-09-12T16:08:33.131856+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:23:59.946149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.098561+0000","last_change":"2023-09-12T16:08:32.092046+0000","last_active":"2023-09-12T16:08:33.098561+0000","last_peered":"2023-09-12T16:08:33.098561+0000","last_clean":"2023-09-12T16:08:33.098561+0000","last_became_active":"2023-09-12T16:08:32.091750+0000","last_became_peered":"2023-09-12T16:08:32.091750+0000","last_unstale":"2023-09-12T16:08:33.098561+0000","last_undegraded":"2023-09-12T16:08:33.098561+0000","last_fullsized":"2023-09-12T16:08:33.098561+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:34:56.684886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.122175+0000","last_change":"2023-09-12T16:08:33.115039+0000","last_active":"2023-09-12T16:08:33.122175+0000","last_peered":"2023-09-12T16:08:33.122175+0000","last_clean":"2023-09-12T16:08:33.122175+0000","last_became_active":"2023-09-12T16:08:33.114720+0000","last_became_peered":"2023-09-12T16:08:33.114720+0000","last_unstale":"2023-09-12T16:08:33.122175+0000","last_undegraded":"2023-09-12T16:08:33.122175+0000","last_fullsized":"2023-09-12T16:08:33.122175+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:46:04.288875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.113982+0000","last_change":"2023-09-12T16:08:32.103200+0000","last_active":"2023-09-12T16:08:33.113982+0000","last_peered":"2023-09-12T16:08:33.113982+0000","last_clean":"2023-09-12T16:08:33.113982+0000","last_became_active":"2023-09-12T16:08:32.102908+0000","last_became_peered":"2023-09-12T16:08:32.102908+0000","last_unstale":"2023-09-12T16:08:33.113982+0000","last_undegraded":"2023-09-12T16:08:33.113982+0000","last_fullsized":"2023-09-12T16:08:33.113982+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:56:33.974574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-09-12T16:08:32.093570+0000","last_change":"2023-09-12T16:06:50.214088+0000","last_active":"2023-09-12T16:08:32.093570+0000","last_peered":"2023-09-12T16:08:32.093570+0000","last_clean":"2023-09-12T16:08:32.093570+0000","last_became_active":"2023-09-12T16:06:50.213622+0000","last_became_peered":"2023-09-12T16:06:50.213622+0000","last_unstale":"2023-09-12T16:08:32.093570+0000","last_undegraded":"2023-09-12T16:08:32.093570+0000","last_fullsized":"2023-09-12T16:08:32.093570+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:49.077619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:49.077619+0000","last_clean_scrub_stamp":"2023-09-12T16:06:49.077619+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:18:36.870572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":766062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 12 16:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54300000000000004}]},{"osd":1,"last update":"Tue Sep 12 16:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.62}]},{"osd":2,"last update":"Tue Sep 12 16:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.59699999999999998}]},{"osd":3,"last update":"Tue Sep 12 16:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.748}]},{"osd":4,"last update":"Tue Sep 12 16:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.72299999999999998}]},{"osd":5,"last update":"Tue Sep 12 16:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.79100000000000004}]},{"osd":6,"last update":"Tue Sep 12 16:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.81999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":183371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.407,"5min":2.407,"15min":2.407},"last":0.70399999999999996}]},{"osd":1,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.75600000000000001}]},{"osd":2,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.77400000000000002}]},{"osd":3,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.82099999999999995}]},{"osd":4,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.57199999999999995}]},{"osd":5,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.59799999999999998}]},{"osd":7,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.622},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.30599999999999999}]},{"osd":2,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.499},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.47299999999999998}]},{"osd":3,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.39800000000000002}]},{"osd":4,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":0.879},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.74399999999999999}]},{"osd":5,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.75700000000000001}]},{"osd":6,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.95499999999999996}]},{"osd":7,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.73399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1019904,"data_stored":772172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 12 16:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.35799999999999998}]},{"osd":2,"last update":"Tue Sep 12 16:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.45600000000000002}]},{"osd":3,"last update":"Tue Sep 12 16:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.438},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.52800000000000002}]},{"osd":4,"last update":"Tue Sep 12 16:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.84899999999999998}]},{"osd":5,"last update":"Tue Sep 12 16:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.77200000000000002}]},{"osd":6,"last update":"Tue Sep 12 16:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.88300000000000001}]},{"osd":7,"last update":"Tue Sep 12 16:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.874}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":182859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.54500000000000004}]},{"osd":1,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.60399999999999998}]},{"osd":3,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.629},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.65500000000000003}]},{"osd":4,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.71199999999999997}]},{"osd":5,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.85799999999999998}]},{"osd":6,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.78800000000000003}]},{"osd":7,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.81299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":175694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 12 16:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.40600000000000003}]},{"osd":1,"last update":"Tue Sep 12 16:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.34499999999999997}]},{"osd":2,"last update":"Tue Sep 12 16:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.48799999999999999}]},{"osd":4,"last update":"Tue Sep 12 16:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.85099999999999998}]},{"osd":5,"last update":"Tue Sep 12 16:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.66400000000000003}]},{"osd":6,"last update":"Tue Sep 12 16:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.70699999999999996}]},{"osd":7,"last update":"Tue Sep 12 16:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.746}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":183393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.70999999999999996}]},{"osd":1,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.59099999999999997}]},{"osd":2,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.63100000000000001}]},{"osd":3,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":5.5119999999999996,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.65100000000000002}]},{"osd":5,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.443}]},{"osd":6,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.69599999999999995}]},{"osd":7,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.68100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":175694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.77400000000000002}]},{"osd":1,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.6339999999999999,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":0.79000000000000004}]},{"osd":2,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":3.1949999999999998,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.875},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":3.1779999999999999,"5min":3.1779999999999999,"15min":3.1779999999999999},"last":0.73499999999999999}]},{"osd":3,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.7930000000000001,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":0.753},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.71699999999999997}]},{"osd":4,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.65900000000000003}]},{"osd":6,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.85399999999999998}]},{"osd":7,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-12T16:08:37.482 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-12T16:08:37.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.713+0000 7f466a3ff700 1 -- 172.21.15.112:0/3970463473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46640b3a60 msgr2=0x7f46640cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:37.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.713+0000 7f466a3ff700 1 --2- 172.21.15.112:0/3970463473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46640b3a60 0x7f46640cfe20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f46580098c0 tx=0x7f4658009bd0 comp rx=0 tx=0).stop 2023-09-12T16:08:37.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.713+0000 7f466a3ff700 1 -- 172.21.15.112:0/3970463473 shutdown_connections 2023-09-12T16:08:37.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.713+0000 7f466a3ff700 1 --2- 172.21.15.112:0/3970463473 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46640d21f0 0x7f46640b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:37.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.713+0000 7f466a3ff700 1 --2- 172.21.15.112:0/3970463473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46640b3a60 0x7f46640cfe20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:37.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.713+0000 7f466a3ff700 1 -- 172.21.15.112:0/3970463473 >> 172.21.15.112:0/3970463473 conn(0x7f466409abe0 msgr2=0x7f46640d18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:37.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.713+0000 7f466a3ff700 1 -- 172.21.15.112:0/3970463473 shutdown_connections 2023-09-12T16:08:37.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.713+0000 7f466a3ff700 1 -- 172.21.15.112:0/3970463473 wait complete. 2023-09-12T16:08:37.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.714+0000 7f466a3ff700 1 Processor -- start 2023-09-12T16:08:37.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.715+0000 7f466a3ff700 1 -- start start 2023-09-12T16:08:37.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.715+0000 7f466a3ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46640b3a60 0x7f466415b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:37.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.715+0000 7f466a3ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46640d21f0 0x7f46640c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:37.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.716+0000 7f466a3ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f466415f0d0 0x7f46640af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:37.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.716+0000 7f466a3ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466415bee0 con 0x7f46640d21f0 2023-09-12T16:08:37.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.716+0000 7f466a3ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46640ae940 con 0x7f46640b3a60 2023-09-12T16:08:37.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.716+0000 7f466a3ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46640aec20 con 0x7f466415f0d0 2023-09-12T16:08:37.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.716+0000 7f46637fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46640d21f0 0x7f46640c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:37.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.716+0000 7f46637fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46640d21f0 0x7f46640c7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59924/0 (socket says 172.21.15.112:59924) 2023-09-12T16:08:37.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.716+0000 7f46637fe700 1 -- 172.21.15.112:0/1342323285 learned_addr learned my addr 172.21.15.112:0/1342323285 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:37.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.716+0000 7f4663fff700 1 --2- 172.21.15.112:0/1342323285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46640b3a60 0x7f466415b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:37.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.716+0000 7f466899c700 1 --2- 172.21.15.112:0/1342323285 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f466415f0d0 0x7f46640af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:37.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.716+0000 7f46637fe700 1 -- 172.21.15.112:0/1342323285 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f466415f0d0 msgr2=0x7f46640af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:37.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.716+0000 7f46637fe700 1 --2- 172.21.15.112:0/1342323285 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f466415f0d0 0x7f46640af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:37.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.716+0000 7f46637fe700 1 -- 172.21.15.112:0/1342323285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46640b3a60 msgr2=0x7f466415b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:37.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.716+0000 7f46637fe700 1 --2- 172.21.15.112:0/1342323285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46640b3a60 0x7f466415b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:37.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.716+0000 7f46637fe700 1 -- 172.21.15.112:0/1342323285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4658009520 con 0x7f46640d21f0 2023-09-12T16:08:37.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.716+0000 7f466899c700 1 --2- 172.21.15.112:0/1342323285 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f466415f0d0 0x7f46640af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:08:37.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.716+0000 7f46637fe700 1 --2- 172.21.15.112:0/1342323285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46640d21f0 0x7f46640c7140 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4658000c00 tx=0x7f465800f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:37.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.717+0000 7f4660ff9700 1 -- 172.21.15.112:0/1342323285 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465800fbc0 con 0x7f46640d21f0 2023-09-12T16:08:37.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.717+0000 7f4660ff9700 1 -- 172.21.15.112:0/1342323285 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f465800fd20 con 0x7f46640d21f0 2023-09-12T16:08:37.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.717+0000 7f4660ff9700 1 -- 172.21.15.112:0/1342323285 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4658017660 con 0x7f46640d21f0 2023-09-12T16:08:37.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.717+0000 7f466a3ff700 1 -- 172.21.15.112:0/1342323285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46640aef00 con 0x7f46640d21f0 2023-09-12T16:08:37.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.717+0000 7f466a3ff700 1 -- 172.21.15.112:0/1342323285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46640af4c0 con 0x7f46640d21f0 2023-09-12T16:08:37.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.718+0000 7f466a3ff700 1 -- 172.21.15.112:0/1342323285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46640af6e0 con 0x7f46640d21f0 2023-09-12T16:08:37.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.719+0000 7f4660ff9700 1 -- 172.21.15.112:0/1342323285 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f46580177c0 con 0x7f46640d21f0 2023-09-12T16:08:37.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.720+0000 7f4660ff9700 1 --2- 172.21.15.112:0/1342323285 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f465006a580 0x7f465006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:37.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.720+0000 7f4660ff9700 1 -- 172.21.15.112:0/1342323285 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f465808aa70 con 0x7f46640d21f0 2023-09-12T16:08:37.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.720+0000 7f4663fff700 1 --2- 172.21.15.112:0/1342323285 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f465006a580 0x7f465006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:37.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.721+0000 7f4663fff700 1 --2- 172.21.15.112:0/1342323285 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f465006a580 0x7f465006ca40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4654000fb0 tx=0x7f4654009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:37.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.724+0000 7f4660ff9700 1 -- 172.21.15.112:0/1342323285 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f4658055f50 con 0x7f46640d21f0 2023-09-12T16:08:37.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.915+0000 7f466a3ff700 1 -- 172.21.15.112:0/1342323285 --> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46640b5870 con 0x7f465006a580 2023-09-12T16:08:37.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.924+0000 7f4660ff9700 1 -- 172.21.15.112:0/1342323285 <== mgr.4176 v2:172.21.15.112:6832/1000013333 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289055 (secure 0 0 0) 0x7f4654001cd0 con 0x7f465006a580 2023-09-12T16:08:37.929 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:37.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.928+0000 7f466a3ff700 1 -- 172.21.15.112:0/1342323285 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f465006a580 msgr2=0x7f465006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:37.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.928+0000 7f466a3ff700 1 --2- 172.21.15.112:0/1342323285 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f465006a580 0x7f465006ca40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4654000fb0 tx=0x7f4654009040 comp rx=0 tx=0).stop 2023-09-12T16:08:37.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.928+0000 7f466a3ff700 1 -- 172.21.15.112:0/1342323285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46640d21f0 msgr2=0x7f46640c7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:37.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.928+0000 7f466a3ff700 1 --2- 172.21.15.112:0/1342323285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46640d21f0 0x7f46640c7140 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4658000c00 tx=0x7f465800f710 comp rx=0 tx=0).stop 2023-09-12T16:08:37.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.928+0000 7f466a3ff700 1 -- 172.21.15.112:0/1342323285 shutdown_connections 2023-09-12T16:08:37.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.928+0000 7f466a3ff700 1 --2- 172.21.15.112:0/1342323285 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f465006a580 0x7f465006ca40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:37.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.928+0000 7f466a3ff700 1 --2- 172.21.15.112:0/1342323285 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f466415f0d0 0x7f46640af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:37.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.928+0000 7f466a3ff700 1 --2- 172.21.15.112:0/1342323285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46640b3a60 0x7f466415b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:37.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.928+0000 7f466a3ff700 1 --2- 172.21.15.112:0/1342323285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46640d21f0 0x7f46640c7140 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:37.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.928+0000 7f466a3ff700 1 -- 172.21.15.112:0/1342323285 >> 172.21.15.112:0/1342323285 conn(0x7f466409abe0 msgr2=0x7f466415c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:37.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.928+0000 7f466a3ff700 1 -- 172.21.15.112:0/1342323285 shutdown_connections 2023-09-12T16:08:37.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:37.928+0000 7f466a3ff700 1 -- 172.21.15.112:0/1342323285 wait complete. 2023-09-12T16:08:37.934 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-09-12T16:08:37.947 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2023-09-12T16:08:36.834124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220656,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754064,"statfs":{"total":773094113280,"available":772868161536,"internally_reserved":0,"allocated":4562944,"data_stored":2614939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.756639"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.121598+0000","last_change":"2023-09-12T16:08:33.112978+0000","last_active":"2023-09-12T16:08:33.121598+0000","last_peered":"2023-09-12T16:08:33.121598+0000","last_clean":"2023-09-12T16:08:33.121598+0000","last_became_active":"2023-09-12T16:08:33.112660+0000","last_became_peered":"2023-09-12T16:08:33.112660+0000","last_unstale":"2023-09-12T16:08:33.121598+0000","last_undegraded":"2023-09-12T16:08:33.121598+0000","last_fullsized":"2023-09-12T16:08:33.121598+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:33:08.512795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.113611+0000","last_change":"2023-09-12T16:08:33.107185+0000","last_active":"2023-09-12T16:08:33.113611+0000","last_peered":"2023-09-12T16:08:33.113611+0000","last_clean":"2023-09-12T16:08:33.113611+0000","last_became_active":"2023-09-12T16:08:33.106891+0000","last_became_peered":"2023-09-12T16:08:33.106891+0000","last_unstale":"2023-09-12T16:08:33.113611+0000","last_undegraded":"2023-09-12T16:08:33.113611+0000","last_fullsized":"2023-09-12T16:08:33.113611+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:46:04.288875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.124341+0000","last_change":"2023-09-12T16:08:33.115636+0000","last_active":"2023-09-12T16:08:33.124341+0000","last_peered":"2023-09-12T16:08:33.124341+0000","last_clean":"2023-09-12T16:08:33.124341+0000","last_became_active":"2023-09-12T16:08:33.115339+0000","last_became_peered":"2023-09-12T16:08:33.115339+0000","last_unstale":"2023-09-12T16:08:33.124341+0000","last_undegraded":"2023-09-12T16:08:33.124341+0000","last_fullsized":"2023-09-12T16:08:33.124341+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:09:38.196698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.124391+0000","last_change":"2023-09-12T16:08:33.114546+0000","last_active":"2023-09-12T16:08:33.124391+0000","last_peered":"2023-09-12T16:08:33.124391+0000","last_clean":"2023-09-12T16:08:33.124391+0000","last_became_active":"2023-09-12T16:08:33.114134+0000","last_became_peered":"2023-09-12T16:08:33.114134+0000","last_unstale":"2023-09-12T16:08:33.124391+0000","last_undegraded":"2023-09-12T16:08:33.124391+0000","last_fullsized":"2023-09-12T16:08:33.124391+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:25:01.198031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.124483+0000","last_change":"2023-09-12T16:08:33.114058+0000","last_active":"2023-09-12T16:08:33.124483+0000","last_peered":"2023-09-12T16:08:33.124483+0000","last_clean":"2023-09-12T16:08:33.124483+0000","last_became_active":"2023-09-12T16:08:33.113885+0000","last_became_peered":"2023-09-12T16:08:33.113885+0000","last_unstale":"2023-09-12T16:08:33.124483+0000","last_undegraded":"2023-09-12T16:08:33.124483+0000","last_fullsized":"2023-09-12T16:08:33.124483+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T16:46:37.023406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126968+0000","last_change":"2023-09-12T16:08:33.116810+0000","last_active":"2023-09-12T16:08:33.126968+0000","last_peered":"2023-09-12T16:08:33.126968+0000","last_clean":"2023-09-12T16:08:33.126968+0000","last_became_active":"2023-09-12T16:08:33.116536+0000","last_became_peered":"2023-09-12T16:08:33.116536+0000","last_unstale":"2023-09-12T16:08:33.126968+0000","last_undegraded":"2023-09-12T16:08:33.126968+0000","last_fullsized":"2023-09-12T16:08:33.126968+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:55:43.226971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.122143+0000","last_change":"2023-09-12T16:08:33.115739+0000","last_active":"2023-09-12T16:08:33.122143+0000","last_peered":"2023-09-12T16:08:33.122143+0000","last_clean":"2023-09-12T16:08:33.122143+0000","last_became_active":"2023-09-12T16:08:33.115219+0000","last_became_peered":"2023-09-12T16:08:33.115219+0000","last_unstale":"2023-09-12T16:08:33.122143+0000","last_undegraded":"2023-09-12T16:08:33.122143+0000","last_fullsized":"2023-09-12T16:08:33.122143+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:09:38.196698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.129643+0000","last_change":"2023-09-12T16:08:33.120774+0000","last_active":"2023-09-12T16:08:33.129643+0000","last_peered":"2023-09-12T16:08:33.129643+0000","last_clean":"2023-09-12T16:08:33.129643+0000","last_became_active":"2023-09-12T16:08:33.120519+0000","last_became_peered":"2023-09-12T16:08:33.120519+0000","last_unstale":"2023-09-12T16:08:33.129643+0000","last_undegraded":"2023-09-12T16:08:33.129643+0000","last_fullsized":"2023-09-12T16:08:33.129643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:31:40.345656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126637+0000","last_change":"2023-09-12T16:08:33.116619+0000","last_active":"2023-09-12T16:08:33.126637+0000","last_peered":"2023-09-12T16:08:33.126637+0000","last_clean":"2023-09-12T16:08:33.126637+0000","last_became_active":"2023-09-12T16:08:33.116167+0000","last_became_peered":"2023-09-12T16:08:33.116167+0000","last_unstale":"2023-09-12T16:08:33.126637+0000","last_undegraded":"2023-09-12T16:08:33.126637+0000","last_fullsized":"2023-09-12T16:08:33.126637+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:25:03.910239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.128434+0000","last_change":"2023-09-12T16:08:33.123550+0000","last_active":"2023-09-12T16:08:33.128434+0000","last_peered":"2023-09-12T16:08:33.128434+0000","last_clean":"2023-09-12T16:08:33.128434+0000","last_became_active":"2023-09-12T16:08:33.123220+0000","last_became_peered":"2023-09-12T16:08:33.123220+0000","last_unstale":"2023-09-12T16:08:33.128434+0000","last_undegraded":"2023-09-12T16:08:33.128434+0000","last_fullsized":"2023-09-12T16:08:33.128434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:33:08.512795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126621+0000","last_change":"2023-09-12T16:08:33.118273+0000","last_active":"2023-09-12T16:08:33.126621+0000","last_peered":"2023-09-12T16:08:33.126621+0000","last_clean":"2023-09-12T16:08:33.126621+0000","last_became_active":"2023-09-12T16:08:33.117959+0000","last_became_peered":"2023-09-12T16:08:33.117959+0000","last_unstale":"2023-09-12T16:08:33.126621+0000","last_undegraded":"2023-09-12T16:08:33.126621+0000","last_fullsized":"2023-09-12T16:08:33.126621+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:25:03.910239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.129861+0000","last_change":"2023-09-12T16:08:33.123984+0000","last_active":"2023-09-12T16:08:33.129861+0000","last_peered":"2023-09-12T16:08:33.129861+0000","last_clean":"2023-09-12T16:08:33.129861+0000","last_became_active":"2023-09-12T16:08:33.123706+0000","last_became_peered":"2023-09-12T16:08:33.123706+0000","last_unstale":"2023-09-12T16:08:33.129861+0000","last_undegraded":"2023-09-12T16:08:33.129861+0000","last_fullsized":"2023-09-12T16:08:33.129861+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:00:08.235056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126183+0000","last_change":"2023-09-12T16:08:33.121002+0000","last_active":"2023-09-12T16:08:33.126183+0000","last_peered":"2023-09-12T16:08:33.126183+0000","last_clean":"2023-09-12T16:08:33.126183+0000","last_became_active":"2023-09-12T16:08:33.120717+0000","last_became_peered":"2023-09-12T16:08:33.120717+0000","last_unstale":"2023-09-12T16:08:33.126183+0000","last_undegraded":"2023-09-12T16:08:33.126183+0000","last_fullsized":"2023-09-12T16:08:33.126183+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:07:51.683017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.123811+0000","last_change":"2023-09-12T16:08:33.117456+0000","last_active":"2023-09-12T16:08:33.123811+0000","last_peered":"2023-09-12T16:08:33.123811+0000","last_clean":"2023-09-12T16:08:33.123811+0000","last_became_active":"2023-09-12T16:08:33.117176+0000","last_became_peered":"2023-09-12T16:08:33.117176+0000","last_unstale":"2023-09-12T16:08:33.123811+0000","last_undegraded":"2023-09-12T16:08:33.123811+0000","last_fullsized":"2023-09-12T16:08:33.123811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:08:07.131308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.122123+0000","last_change":"2023-09-12T16:08:33.115514+0000","last_active":"2023-09-12T16:08:33.122123+0000","last_peered":"2023-09-12T16:08:33.122123+0000","last_clean":"2023-09-12T16:08:33.122123+0000","last_became_active":"2023-09-12T16:08:33.114837+0000","last_became_peered":"2023-09-12T16:08:33.114837+0000","last_unstale":"2023-09-12T16:08:33.122123+0000","last_undegraded":"2023-09-12T16:08:33.122123+0000","last_fullsized":"2023-09-12T16:08:33.122123+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:34:57.690903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.137297+0000","last_change":"2023-09-12T16:08:33.132272+0000","last_active":"2023-09-12T16:08:33.137297+0000","last_peered":"2023-09-12T16:08:33.137297+0000","last_clean":"2023-09-12T16:08:33.137297+0000","last_became_active":"2023-09-12T16:08:33.132007+0000","last_became_peered":"2023-09-12T16:08:33.132007+0000","last_unstale":"2023-09-12T16:08:33.137297+0000","last_undegraded":"2023-09-12T16:08:33.137297+0000","last_fullsized":"2023-09-12T16:08:33.137297+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:44:09.196495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.137495+0000","last_change":"2023-09-12T16:08:33.135013+0000","last_active":"2023-09-12T16:08:33.137495+0000","last_peered":"2023-09-12T16:08:33.137495+0000","last_clean":"2023-09-12T16:08:33.137495+0000","last_became_active":"2023-09-12T16:08:33.133580+0000","last_became_peered":"2023-09-12T16:08:33.133580+0000","last_unstale":"2023-09-12T16:08:33.137495+0000","last_undegraded":"2023-09-12T16:08:33.137495+0000","last_fullsized":"2023-09-12T16:08:33.137495+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:05:13.192195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.125288+0000","last_change":"2023-09-12T16:08:33.116560+0000","last_active":"2023-09-12T16:08:33.125288+0000","last_peered":"2023-09-12T16:08:33.125288+0000","last_clean":"2023-09-12T16:08:33.125288+0000","last_became_active":"2023-09-12T16:08:33.115863+0000","last_became_peered":"2023-09-12T16:08:33.115863+0000","last_unstale":"2023-09-12T16:08:33.125288+0000","last_undegraded":"2023-09-12T16:08:33.125288+0000","last_fullsized":"2023-09-12T16:08:33.125288+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:23:59.946149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.127704+0000","last_change":"2023-09-12T16:08:33.120986+0000","last_active":"2023-09-12T16:08:33.127704+0000","last_peered":"2023-09-12T16:08:33.127704+0000","last_clean":"2023-09-12T16:08:33.127704+0000","last_became_active":"2023-09-12T16:08:33.120639+0000","last_became_peered":"2023-09-12T16:08:33.120639+0000","last_unstale":"2023-09-12T16:08:33.127704+0000","last_undegraded":"2023-09-12T16:08:33.127704+0000","last_fullsized":"2023-09-12T16:08:33.127704+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:46:26.956423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126621+0000","last_change":"2023-09-12T16:08:33.116243+0000","last_active":"2023-09-12T16:08:33.126621+0000","last_peered":"2023-09-12T16:08:33.126621+0000","last_clean":"2023-09-12T16:08:33.126621+0000","last_became_active":"2023-09-12T16:08:33.115950+0000","last_became_peered":"2023-09-12T16:08:33.115950+0000","last_unstale":"2023-09-12T16:08:33.126621+0000","last_undegraded":"2023-09-12T16:08:33.126621+0000","last_fullsized":"2023-09-12T16:08:33.126621+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:25:01.198031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.128390+0000","last_change":"2023-09-12T16:08:33.124227+0000","last_active":"2023-09-12T16:08:33.128390+0000","last_peered":"2023-09-12T16:08:33.128390+0000","last_clean":"2023-09-12T16:08:33.128390+0000","last_became_active":"2023-09-12T16:08:33.123893+0000","last_became_peered":"2023-09-12T16:08:33.123893+0000","last_unstale":"2023-09-12T16:08:33.128390+0000","last_undegraded":"2023-09-12T16:08:33.128390+0000","last_fullsized":"2023-09-12T16:08:33.128390+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:05:13.192195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.123762+0000","last_change":"2023-09-12T16:08:33.114640+0000","last_active":"2023-09-12T16:08:33.123762+0000","last_peered":"2023-09-12T16:08:33.123762+0000","last_clean":"2023-09-12T16:08:33.123762+0000","last_became_active":"2023-09-12T16:08:33.114375+0000","last_became_peered":"2023-09-12T16:08:33.114375+0000","last_unstale":"2023-09-12T16:08:33.123762+0000","last_undegraded":"2023-09-12T16:08:33.123762+0000","last_fullsized":"2023-09-12T16:08:33.123762+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:14:15.485968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.136818+0000","last_change":"2023-09-12T16:08:33.131754+0000","last_active":"2023-09-12T16:08:33.136818+0000","last_peered":"2023-09-12T16:08:33.136818+0000","last_clean":"2023-09-12T16:08:33.136818+0000","last_became_active":"2023-09-12T16:08:33.127726+0000","last_became_peered":"2023-09-12T16:08:33.127726+0000","last_unstale":"2023-09-12T16:08:33.136818+0000","last_undegraded":"2023-09-12T16:08:33.136818+0000","last_fullsized":"2023-09-12T16:08:33.136818+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:09:38.196698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126724+0000","last_change":"2023-09-12T16:08:33.121533+0000","last_active":"2023-09-12T16:08:33.126724+0000","last_peered":"2023-09-12T16:08:33.126724+0000","last_clean":"2023-09-12T16:08:33.126724+0000","last_became_active":"2023-09-12T16:08:33.121293+0000","last_became_peered":"2023-09-12T16:08:33.121293+0000","last_unstale":"2023-09-12T16:08:33.126724+0000","last_undegraded":"2023-09-12T16:08:33.126724+0000","last_fullsized":"2023-09-12T16:08:33.126724+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:00:14.640701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126349+0000","last_change":"2023-09-12T16:08:33.115255+0000","last_active":"2023-09-12T16:08:33.126349+0000","last_peered":"2023-09-12T16:08:33.126349+0000","last_clean":"2023-09-12T16:08:33.126349+0000","last_became_active":"2023-09-12T16:08:33.114970+0000","last_became_peered":"2023-09-12T16:08:33.114970+0000","last_unstale":"2023-09-12T16:08:33.126349+0000","last_undegraded":"2023-09-12T16:08:33.126349+0000","last_fullsized":"2023-09-12T16:08:33.126349+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:14:15.485968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126882+0000","last_change":"2023-09-12T16:08:33.118769+0000","last_active":"2023-09-12T16:08:33.126882+0000","last_peered":"2023-09-12T16:08:33.126882+0000","last_clean":"2023-09-12T16:08:33.126882+0000","last_became_active":"2023-09-12T16:08:33.118509+0000","last_became_peered":"2023-09-12T16:08:33.118509+0000","last_unstale":"2023-09-12T16:08:33.126882+0000","last_undegraded":"2023-09-12T16:08:33.126882+0000","last_fullsized":"2023-09-12T16:08:33.126882+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:09:38.196698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.112263+0000","last_change":"2023-09-12T16:08:33.110022+0000","last_active":"2023-09-12T16:08:33.112263+0000","last_peered":"2023-09-12T16:08:33.112263+0000","last_clean":"2023-09-12T16:08:33.112263+0000","last_became_active":"2023-09-12T16:08:33.109726+0000","last_became_peered":"2023-09-12T16:08:33.109726+0000","last_unstale":"2023-09-12T16:08:33.112263+0000","last_undegraded":"2023-09-12T16:08:33.112263+0000","last_fullsized":"2023-09-12T16:08:33.112263+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:00:08.235056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.122087+0000","last_change":"2023-09-12T16:08:33.115626+0000","last_active":"2023-09-12T16:08:33.122087+0000","last_peered":"2023-09-12T16:08:33.122087+0000","last_clean":"2023-09-12T16:08:33.122087+0000","last_became_active":"2023-09-12T16:08:33.115331+0000","last_became_peered":"2023-09-12T16:08:33.115331+0000","last_unstale":"2023-09-12T16:08:33.122087+0000","last_undegraded":"2023-09-12T16:08:33.122087+0000","last_fullsized":"2023-09-12T16:08:33.122087+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:58:38.033978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.127217+0000","last_change":"2023-09-12T16:08:33.119991+0000","last_active":"2023-09-12T16:08:33.127217+0000","last_peered":"2023-09-12T16:08:33.127217+0000","last_clean":"2023-09-12T16:08:33.127217+0000","last_became_active":"2023-09-12T16:08:33.119728+0000","last_became_peered":"2023-09-12T16:08:33.119728+0000","last_unstale":"2023-09-12T16:08:33.127217+0000","last_undegraded":"2023-09-12T16:08:33.127217+0000","last_fullsized":"2023-09-12T16:08:33.127217+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:08:07.131308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126541+0000","last_change":"2023-09-12T16:08:33.115240+0000","last_active":"2023-09-12T16:08:33.126541+0000","last_peered":"2023-09-12T16:08:33.126541+0000","last_clean":"2023-09-12T16:08:33.126541+0000","last_became_active":"2023-09-12T16:08:33.114957+0000","last_became_peered":"2023-09-12T16:08:33.114957+0000","last_unstale":"2023-09-12T16:08:33.126541+0000","last_undegraded":"2023-09-12T16:08:33.126541+0000","last_fullsized":"2023-09-12T16:08:33.126541+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:30:48.606037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.136796+0000","last_change":"2023-09-12T16:08:33.131633+0000","last_active":"2023-09-12T16:08:33.136796+0000","last_peered":"2023-09-12T16:08:33.136796+0000","last_clean":"2023-09-12T16:08:33.136796+0000","last_became_active":"2023-09-12T16:08:33.131354+0000","last_became_peered":"2023-09-12T16:08:33.131354+0000","last_unstale":"2023-09-12T16:08:33.136796+0000","last_undegraded":"2023-09-12T16:08:33.136796+0000","last_fullsized":"2023-09-12T16:08:33.136796+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:14:15.485968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.127858+0000","last_change":"2023-09-12T16:08:33.116204+0000","last_active":"2023-09-12T16:08:33.127858+0000","last_peered":"2023-09-12T16:08:33.127858+0000","last_clean":"2023-09-12T16:08:33.127858+0000","last_became_active":"2023-09-12T16:08:33.115928+0000","last_became_peered":"2023-09-12T16:08:33.115928+0000","last_unstale":"2023-09-12T16:08:33.127858+0000","last_undegraded":"2023-09-12T16:08:33.127858+0000","last_fullsized":"2023-09-12T16:08:33.127858+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:56.845163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.133965+0000","last_change":"2023-09-12T16:08:33.131042+0000","last_active":"2023-09-12T16:08:33.133965+0000","last_peered":"2023-09-12T16:08:33.133965+0000","last_clean":"2023-09-12T16:08:33.133965+0000","last_became_active":"2023-09-12T16:08:33.130268+0000","last_became_peered":"2023-09-12T16:08:33.130268+0000","last_unstale":"2023-09-12T16:08:33.133965+0000","last_undegraded":"2023-09-12T16:08:33.133965+0000","last_fullsized":"2023-09-12T16:08:33.133965+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:55:43.226971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.138337+0000","last_change":"2023-09-12T16:08:32.100841+0000","last_active":"2023-09-12T16:08:33.138337+0000","last_peered":"2023-09-12T16:08:33.138337+0000","last_clean":"2023-09-12T16:08:33.138337+0000","last_became_active":"2023-09-12T16:08:32.100555+0000","last_became_peered":"2023-09-12T16:08:32.100555+0000","last_unstale":"2023-09-12T16:08:33.138337+0000","last_undegraded":"2023-09-12T16:08:33.138337+0000","last_fullsized":"2023-09-12T16:08:33.138337+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:55:42.220954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126994+0000","last_change":"2023-09-12T16:08:33.120236+0000","last_active":"2023-09-12T16:08:33.126994+0000","last_peered":"2023-09-12T16:08:33.126994+0000","last_clean":"2023-09-12T16:08:33.126994+0000","last_became_active":"2023-09-12T16:08:33.119944+0000","last_became_peered":"2023-09-12T16:08:33.119944+0000","last_unstale":"2023-09-12T16:08:33.126994+0000","last_undegraded":"2023-09-12T16:08:33.126994+0000","last_fullsized":"2023-09-12T16:08:33.126994+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:34:57.690903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.134682+0000","last_change":"2023-09-12T16:08:32.105729+0000","last_active":"2023-09-12T16:08:33.134682+0000","last_peered":"2023-09-12T16:08:33.134682+0000","last_clean":"2023-09-12T16:08:33.134682+0000","last_became_active":"2023-09-12T16:08:32.105258+0000","last_became_peered":"2023-09-12T16:08:32.105258+0000","last_unstale":"2023-09-12T16:08:33.134682+0000","last_undegraded":"2023-09-12T16:08:33.134682+0000","last_fullsized":"2023-09-12T16:08:33.134682+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:07:50.676999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.120327+0000","last_change":"2023-09-12T16:08:33.115278+0000","last_active":"2023-09-12T16:08:33.120327+0000","last_peered":"2023-09-12T16:08:33.120327+0000","last_clean":"2023-09-12T16:08:33.120327+0000","last_became_active":"2023-09-12T16:08:33.114999+0000","last_became_peered":"2023-09-12T16:08:33.114999+0000","last_unstale":"2023-09-12T16:08:33.120327+0000","last_undegraded":"2023-09-12T16:08:33.120327+0000","last_fullsized":"2023-09-12T16:08:33.120327+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:55:43.226971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.133703+0000","last_change":"2023-09-12T16:08:32.100562+0000","last_active":"2023-09-12T16:08:33.133703+0000","last_peered":"2023-09-12T16:08:33.133703+0000","last_clean":"2023-09-12T16:08:33.133703+0000","last_became_active":"2023-09-12T16:08:32.100289+0000","last_became_peered":"2023-09-12T16:08:32.100289+0000","last_unstale":"2023-09-12T16:08:33.133703+0000","last_undegraded":"2023-09-12T16:08:33.133703+0000","last_fullsized":"2023-09-12T16:08:33.133703+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:31:39.339639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.121616+0000","last_change":"2023-09-12T16:08:33.112957+0000","last_active":"2023-09-12T16:08:33.121616+0000","last_peered":"2023-09-12T16:08:33.121616+0000","last_clean":"2023-09-12T16:08:33.121616+0000","last_became_active":"2023-09-12T16:08:33.112292+0000","last_became_peered":"2023-09-12T16:08:33.112292+0000","last_unstale":"2023-09-12T16:08:33.121616+0000","last_undegraded":"2023-09-12T16:08:33.121616+0000","last_fullsized":"2023-09-12T16:08:33.121616+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:41:28.014180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.133815+0000","last_change":"2023-09-12T16:08:32.100507+0000","last_active":"2023-09-12T16:08:33.133815+0000","last_peered":"2023-09-12T16:08:33.133815+0000","last_clean":"2023-09-12T16:08:33.133815+0000","last_became_active":"2023-09-12T16:08:32.100095+0000","last_became_peered":"2023-09-12T16:08:32.100095+0000","last_unstale":"2023-09-12T16:08:33.133815+0000","last_undegraded":"2023-09-12T16:08:33.133815+0000","last_fullsized":"2023-09-12T16:08:33.133815+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:56:33.974574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.129257+0000","last_change":"2023-09-12T16:08:33.124955+0000","last_active":"2023-09-12T16:08:33.129257+0000","last_peered":"2023-09-12T16:08:33.129257+0000","last_clean":"2023-09-12T16:08:33.129257+0000","last_became_active":"2023-09-12T16:08:33.124617+0000","last_became_peered":"2023-09-12T16:08:33.124617+0000","last_unstale":"2023-09-12T16:08:33.129257+0000","last_undegraded":"2023-09-12T16:08:33.129257+0000","last_fullsized":"2023-09-12T16:08:33.129257+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:08:07.131308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.129667+0000","last_change":"2023-09-12T16:08:32.106762+0000","last_active":"2023-09-12T16:08:33.129667+0000","last_peered":"2023-09-12T16:08:33.129667+0000","last_clean":"2023-09-12T16:08:33.129667+0000","last_became_active":"2023-09-12T16:08:32.106464+0000","last_became_peered":"2023-09-12T16:08:32.106464+0000","last_unstale":"2023-09-12T16:08:33.129667+0000","last_undegraded":"2023-09-12T16:08:33.129667+0000","last_fullsized":"2023-09-12T16:08:33.129667+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:31:39.339639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.128471+0000","last_change":"2023-09-12T16:08:33.124717+0000","last_active":"2023-09-12T16:08:33.128471+0000","last_peered":"2023-09-12T16:08:33.128471+0000","last_clean":"2023-09-12T16:08:33.128471+0000","last_became_active":"2023-09-12T16:08:33.124391+0000","last_became_peered":"2023-09-12T16:08:33.124391+0000","last_unstale":"2023-09-12T16:08:33.128471+0000","last_undegraded":"2023-09-12T16:08:33.128471+0000","last_fullsized":"2023-09-12T16:08:33.128471+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:56.845163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.129789+0000","last_change":"2023-09-12T16:08:32.103125+0000","last_active":"2023-09-12T16:08:33.129789+0000","last_peered":"2023-09-12T16:08:33.129789+0000","last_clean":"2023-09-12T16:08:33.129789+0000","last_became_active":"2023-09-12T16:08:32.102828+0000","last_became_peered":"2023-09-12T16:08:32.102828+0000","last_unstale":"2023-09-12T16:08:33.129789+0000","last_undegraded":"2023-09-12T16:08:33.129789+0000","last_fullsized":"2023-09-12T16:08:33.129789+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:00:07.229038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.123828+0000","last_change":"2023-09-12T16:08:33.118401+0000","last_active":"2023-09-12T16:08:33.123828+0000","last_peered":"2023-09-12T16:08:33.123828+0000","last_clean":"2023-09-12T16:08:33.123828+0000","last_became_active":"2023-09-12T16:08:33.118053+0000","last_became_peered":"2023-09-12T16:08:33.118053+0000","last_unstale":"2023-09-12T16:08:33.123828+0000","last_undegraded":"2023-09-12T16:08:33.123828+0000","last_fullsized":"2023-09-12T16:08:33.123828+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:44:09.196495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.106941+0000","last_change":"2023-09-12T16:08:32.103791+0000","last_active":"2023-09-12T16:08:33.106941+0000","last_peered":"2023-09-12T16:08:33.106941+0000","last_clean":"2023-09-12T16:08:33.106941+0000","last_became_active":"2023-09-12T16:08:32.103508+0000","last_became_peered":"2023-09-12T16:08:32.103508+0000","last_unstale":"2023-09-12T16:08:33.106941+0000","last_undegraded":"2023-09-12T16:08:33.106941+0000","last_fullsized":"2023-09-12T16:08:33.106941+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:07:50.676999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.129890+0000","last_change":"2023-09-12T16:08:33.122813+0000","last_active":"2023-09-12T16:08:33.129890+0000","last_peered":"2023-09-12T16:08:33.129890+0000","last_clean":"2023-09-12T16:08:33.129890+0000","last_became_active":"2023-09-12T16:08:33.122403+0000","last_became_peered":"2023-09-12T16:08:33.122403+0000","last_unstale":"2023-09-12T16:08:33.129890+0000","last_undegraded":"2023-09-12T16:08:33.129890+0000","last_fullsized":"2023-09-12T16:08:33.129890+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T16:32:58.926616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.106246+0000","last_change":"2023-09-12T16:08:32.099806+0000","last_active":"2023-09-12T16:08:33.106246+0000","last_peered":"2023-09-12T16:08:33.106246+0000","last_clean":"2023-09-12T16:08:33.106246+0000","last_became_active":"2023-09-12T16:08:32.099537+0000","last_became_peered":"2023-09-12T16:08:32.099537+0000","last_unstale":"2023-09-12T16:08:33.106246+0000","last_undegraded":"2023-09-12T16:08:33.106246+0000","last_fullsized":"2023-09-12T16:08:33.106246+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:55.839146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.124366+0000","last_change":"2023-09-12T16:08:33.114390+0000","last_active":"2023-09-12T16:08:33.124366+0000","last_peered":"2023-09-12T16:08:33.124366+0000","last_clean":"2023-09-12T16:08:33.124366+0000","last_became_active":"2023-09-12T16:08:33.113728+0000","last_became_peered":"2023-09-12T16:08:33.113728+0000","last_unstale":"2023-09-12T16:08:33.124366+0000","last_undegraded":"2023-09-12T16:08:33.124366+0000","last_fullsized":"2023-09-12T16:08:33.124366+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:23:59.946149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.099579+0000","last_change":"2023-09-12T16:08:32.092121+0000","last_active":"2023-09-12T16:08:33.099579+0000","last_peered":"2023-09-12T16:08:33.099579+0000","last_clean":"2023-09-12T16:08:33.099579+0000","last_became_active":"2023-09-12T16:08:32.091787+0000","last_became_peered":"2023-09-12T16:08:32.091787+0000","last_unstale":"2023-09-12T16:08:33.099579+0000","last_undegraded":"2023-09-12T16:08:33.099579+0000","last_fullsized":"2023-09-12T16:08:33.099579+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:01:13.109813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.137397+0000","last_change":"2023-09-12T16:08:33.134641+0000","last_active":"2023-09-12T16:08:33.137397+0000","last_peered":"2023-09-12T16:08:33.137397+0000","last_clean":"2023-09-12T16:08:33.137397+0000","last_became_active":"2023-09-12T16:08:33.133968+0000","last_became_peered":"2023-09-12T16:08:33.133968+0000","last_unstale":"2023-09-12T16:08:33.137397+0000","last_undegraded":"2023-09-12T16:08:33.137397+0000","last_fullsized":"2023-09-12T16:08:33.137397+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:25:03.910239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.107917+0000","last_change":"2023-09-12T16:08:32.105779+0000","last_active":"2023-09-12T16:08:33.107917+0000","last_peered":"2023-09-12T16:08:33.107917+0000","last_clean":"2023-09-12T16:08:33.107917+0000","last_became_active":"2023-09-12T16:08:32.104386+0000","last_became_peered":"2023-09-12T16:08:32.104386+0000","last_unstale":"2023-09-12T16:08:33.107917+0000","last_undegraded":"2023-09-12T16:08:33.107917+0000","last_fullsized":"2023-09-12T16:08:33.107917+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:18:37.932139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.128231+0000","last_change":"2023-09-12T16:08:33.122385+0000","last_active":"2023-09-12T16:08:33.128231+0000","last_peered":"2023-09-12T16:08:33.128231+0000","last_clean":"2023-09-12T16:08:33.128231+0000","last_became_active":"2023-09-12T16:08:33.122114+0000","last_became_peered":"2023-09-12T16:08:33.122114+0000","last_unstale":"2023-09-12T16:08:33.128231+0000","last_undegraded":"2023-09-12T16:08:33.128231+0000","last_fullsized":"2023-09-12T16:08:33.128231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:42:42.601295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.132226+0000","last_change":"2023-09-12T16:08:32.105384+0000","last_active":"2023-09-12T16:08:33.132226+0000","last_peered":"2023-09-12T16:08:33.132226+0000","last_clean":"2023-09-12T16:08:33.132226+0000","last_became_active":"2023-09-12T16:08:32.105079+0000","last_became_peered":"2023-09-12T16:08:32.105079+0000","last_unstale":"2023-09-12T16:08:33.132226+0000","last_undegraded":"2023-09-12T16:08:33.132226+0000","last_fullsized":"2023-09-12T16:08:33.132226+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:11:25.027682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.120357+0000","last_change":"2023-09-12T16:08:33.114003+0000","last_active":"2023-09-12T16:08:33.120357+0000","last_peered":"2023-09-12T16:08:33.120357+0000","last_clean":"2023-09-12T16:08:33.120357+0000","last_became_active":"2023-09-12T16:08:33.113723+0000","last_became_peered":"2023-09-12T16:08:33.113723+0000","last_unstale":"2023-09-12T16:08:33.120357+0000","last_undegraded":"2023-09-12T16:08:33.120357+0000","last_fullsized":"2023-09-12T16:08:33.120357+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T02:09:38.196698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.140215+0000","last_change":"2023-09-12T16:08:32.100860+0000","last_active":"2023-09-12T16:08:33.140215+0000","last_peered":"2023-09-12T16:08:33.140215+0000","last_clean":"2023-09-12T16:08:33.140215+0000","last_became_active":"2023-09-12T16:08:32.100556+0000","last_became_peered":"2023-09-12T16:08:32.100556+0000","last_unstale":"2023-09-12T16:08:33.140215+0000","last_undegraded":"2023-09-12T16:08:33.140215+0000","last_fullsized":"2023-09-12T16:08:33.140215+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T03:11:25.027682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.124794+0000","last_change":"2023-09-12T16:08:33.115305+0000","last_active":"2023-09-12T16:08:33.124794+0000","last_peered":"2023-09-12T16:08:33.124794+0000","last_clean":"2023-09-12T16:08:33.124794+0000","last_became_active":"2023-09-12T16:08:33.115040+0000","last_became_peered":"2023-09-12T16:08:33.115040+0000","last_unstale":"2023-09-12T16:08:33.124794+0000","last_undegraded":"2023-09-12T16:08:33.124794+0000","last_fullsized":"2023-09-12T16:08:33.124794+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:55:43.226971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.133340+0000","last_change":"2023-09-12T16:08:32.102177+0000","last_active":"2023-09-12T16:08:33.133340+0000","last_peered":"2023-09-12T16:08:33.133340+0000","last_clean":"2023-09-12T16:08:33.133340+0000","last_became_active":"2023-09-12T16:08:32.101914+0000","last_became_peered":"2023-09-12T16:08:32.101914+0000","last_unstale":"2023-09-12T16:08:33.133340+0000","last_undegraded":"2023-09-12T16:08:33.133340+0000","last_fullsized":"2023-09-12T16:08:33.133340+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:24:08.229327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126399+0000","last_change":"2023-09-12T16:08:33.113644+0000","last_active":"2023-09-12T16:08:33.126399+0000","last_peered":"2023-09-12T16:08:33.126399+0000","last_clean":"2023-09-12T16:08:33.126399+0000","last_became_active":"2023-09-12T16:08:33.113422+0000","last_became_peered":"2023-09-12T16:08:33.113422+0000","last_unstale":"2023-09-12T16:08:33.126399+0000","last_undegraded":"2023-09-12T16:08:33.126399+0000","last_fullsized":"2023-09-12T16:08:33.126399+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:13:55.779904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.105919+0000","last_change":"2023-09-12T16:08:32.106007+0000","last_active":"2023-09-12T16:08:33.105919+0000","last_peered":"2023-09-12T16:08:33.105919+0000","last_clean":"2023-09-12T16:08:33.105919+0000","last_became_active":"2023-09-12T16:08:32.105757+0000","last_became_peered":"2023-09-12T16:08:32.105757+0000","last_unstale":"2023-09-12T16:08:33.105919+0000","last_undegraded":"2023-09-12T16:08:33.105919+0000","last_fullsized":"2023-09-12T16:08:33.105919+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:05:12.186177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.131935+0000","last_change":"2023-09-12T16:08:33.127293+0000","last_active":"2023-09-12T16:08:33.131935+0000","last_peered":"2023-09-12T16:08:33.131935+0000","last_clean":"2023-09-12T16:08:33.131935+0000","last_became_active":"2023-09-12T16:08:33.127037+0000","last_became_peered":"2023-09-12T16:08:33.127037+0000","last_unstale":"2023-09-12T16:08:33.131935+0000","last_undegraded":"2023-09-12T16:08:33.131935+0000","last_fullsized":"2023-09-12T16:08:33.131935+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:08:07.131308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.100838+0000","last_change":"2023-09-12T16:08:32.101682+0000","last_active":"2023-09-12T16:08:33.100838+0000","last_peered":"2023-09-12T16:08:33.100838+0000","last_clean":"2023-09-12T16:08:33.100838+0000","last_became_active":"2023-09-12T16:08:32.101341+0000","last_became_peered":"2023-09-12T16:08:32.101341+0000","last_unstale":"2023-09-12T16:08:33.100838+0000","last_undegraded":"2023-09-12T16:08:33.100838+0000","last_fullsized":"2023-09-12T16:08:33.100838+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:38:33.657951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.129852+0000","last_change":"2023-09-12T16:08:33.119003+0000","last_active":"2023-09-12T16:08:33.129852+0000","last_peered":"2023-09-12T16:08:33.129852+0000","last_clean":"2023-09-12T16:08:33.129852+0000","last_became_active":"2023-09-12T16:08:33.118747+0000","last_became_peered":"2023-09-12T16:08:33.118747+0000","last_unstale":"2023-09-12T16:08:33.129852+0000","last_undegraded":"2023-09-12T16:08:33.129852+0000","last_fullsized":"2023-09-12T16:08:33.129852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:36:45.571613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.136139+0000","last_change":"2023-09-12T16:08:32.103219+0000","last_active":"2023-09-12T16:08:33.136139+0000","last_peered":"2023-09-12T16:08:33.136139+0000","last_clean":"2023-09-12T16:08:33.136139+0000","last_became_active":"2023-09-12T16:08:32.102946+0000","last_became_peered":"2023-09-12T16:08:32.102946+0000","last_unstale":"2023-09-12T16:08:33.136139+0000","last_undegraded":"2023-09-12T16:08:33.136139+0000","last_fullsized":"2023-09-12T16:08:33.136139+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:38:33.657951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.113816+0000","last_change":"2023-09-12T16:08:33.106057+0000","last_active":"2023-09-12T16:08:33.113816+0000","last_peered":"2023-09-12T16:08:33.113816+0000","last_clean":"2023-09-12T16:08:33.113816+0000","last_became_active":"2023-09-12T16:08:33.105783+0000","last_became_peered":"2023-09-12T16:08:33.105783+0000","last_unstale":"2023-09-12T16:08:33.113816+0000","last_undegraded":"2023-09-12T16:08:33.113816+0000","last_fullsized":"2023-09-12T16:08:33.113816+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:18:38.938156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.134775+0000","last_change":"2023-09-12T16:08:32.105070+0000","last_active":"2023-09-12T16:08:33.134775+0000","last_peered":"2023-09-12T16:08:33.134775+0000","last_clean":"2023-09-12T16:08:33.134775+0000","last_became_active":"2023-09-12T16:08:32.104761+0000","last_became_peered":"2023-09-12T16:08:32.104761+0000","last_unstale":"2023-09-12T16:08:33.134775+0000","last_undegraded":"2023-09-12T16:08:33.134775+0000","last_fullsized":"2023-09-12T16:08:33.134775+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T21:41:27.008163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.128496+0000","last_change":"2023-09-12T16:08:33.124811+0000","last_active":"2023-09-12T16:08:33.128496+0000","last_peered":"2023-09-12T16:08:33.128496+0000","last_clean":"2023-09-12T16:08:33.128496+0000","last_became_active":"2023-09-12T16:08:33.124524+0000","last_became_peered":"2023-09-12T16:08:33.124524+0000","last_unstale":"2023-09-12T16:08:33.128496+0000","last_undegraded":"2023-09-12T16:08:33.128496+0000","last_fullsized":"2023-09-12T16:08:33.128496+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:42:42.601295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.138734+0000","last_change":"2023-09-12T16:08:32.106873+0000","last_active":"2023-09-12T16:08:33.138734+0000","last_peered":"2023-09-12T16:08:33.138734+0000","last_clean":"2023-09-12T16:08:33.138734+0000","last_became_active":"2023-09-12T16:08:32.106551+0000","last_became_peered":"2023-09-12T16:08:32.106551+0000","last_unstale":"2023-09-12T16:08:33.138734+0000","last_undegraded":"2023-09-12T16:08:33.138734+0000","last_fullsized":"2023-09-12T16:08:33.138734+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:25:02.904221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.133299+0000","last_change":"2023-09-12T16:08:33.129284+0000","last_active":"2023-09-12T16:08:33.133299+0000","last_peered":"2023-09-12T16:08:33.133299+0000","last_clean":"2023-09-12T16:08:33.133299+0000","last_became_active":"2023-09-12T16:08:33.129009+0000","last_became_peered":"2023-09-12T16:08:33.129009+0000","last_unstale":"2023-09-12T16:08:33.133299+0000","last_undegraded":"2023-09-12T16:08:33.133299+0000","last_fullsized":"2023-09-12T16:08:33.133299+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:00:08.235056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.137682+0000","last_change":"2023-09-12T16:08:32.098919+0000","last_active":"2023-09-12T16:08:33.137682+0000","last_peered":"2023-09-12T16:08:33.137682+0000","last_clean":"2023-09-12T16:08:33.137682+0000","last_became_active":"2023-09-12T16:08:32.098637+0000","last_became_peered":"2023-09-12T16:08:32.098637+0000","last_unstale":"2023-09-12T16:08:33.137682+0000","last_undegraded":"2023-09-12T16:08:33.137682+0000","last_fullsized":"2023-09-12T16:08:33.137682+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:30:47.600020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.124443+0000","last_change":"2023-09-12T16:08:33.114152+0000","last_active":"2023-09-12T16:08:33.124443+0000","last_peered":"2023-09-12T16:08:33.124443+0000","last_clean":"2023-09-12T16:08:33.124443+0000","last_became_active":"2023-09-12T16:08:33.113798+0000","last_became_peered":"2023-09-12T16:08:33.113798+0000","last_unstale":"2023-09-12T16:08:33.124443+0000","last_undegraded":"2023-09-12T16:08:33.124443+0000","last_fullsized":"2023-09-12T16:08:33.124443+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:40:59.842661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.105890+0000","last_change":"2023-09-12T16:08:32.102707+0000","last_active":"2023-09-12T16:08:33.105890+0000","last_peered":"2023-09-12T16:08:33.105890+0000","last_clean":"2023-09-12T16:08:33.105890+0000","last_became_active":"2023-09-12T16:08:32.102436+0000","last_became_peered":"2023-09-12T16:08:32.102436+0000","last_unstale":"2023-09-12T16:08:33.105890+0000","last_undegraded":"2023-09-12T16:08:33.105890+0000","last_fullsized":"2023-09-12T16:08:33.105890+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:42:41.595277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.137459+0000","last_change":"2023-09-12T16:08:33.136083+0000","last_active":"2023-09-12T16:08:33.137459+0000","last_peered":"2023-09-12T16:08:33.137459+0000","last_clean":"2023-09-12T16:08:33.137459+0000","last_became_active":"2023-09-12T16:08:33.134057+0000","last_became_peered":"2023-09-12T16:08:33.134057+0000","last_unstale":"2023-09-12T16:08:33.137459+0000","last_undegraded":"2023-09-12T16:08:33.137459+0000","last_fullsized":"2023-09-12T16:08:33.137459+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:25:01.198031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.130427+0000","last_change":"2023-09-12T16:08:32.102502+0000","last_active":"2023-09-12T16:08:33.130427+0000","last_peered":"2023-09-12T16:08:33.130427+0000","last_clean":"2023-09-12T16:08:33.130427+0000","last_became_active":"2023-09-12T16:08:32.102274+0000","last_became_peered":"2023-09-12T16:08:32.102274+0000","last_unstale":"2023-09-12T16:08:33.130427+0000","last_undegraded":"2023-09-12T16:08:33.130427+0000","last_fullsized":"2023-09-12T16:08:33.130427+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:36:46.260135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.128195+0000","last_change":"2023-09-12T16:08:33.122479+0000","last_active":"2023-09-12T16:08:33.128195+0000","last_peered":"2023-09-12T16:08:33.128195+0000","last_clean":"2023-09-12T16:08:33.128195+0000","last_became_active":"2023-09-12T16:08:33.122219+0000","last_became_peered":"2023-09-12T16:08:33.122219+0000","last_unstale":"2023-09-12T16:08:33.128195+0000","last_undegraded":"2023-09-12T16:08:33.128195+0000","last_fullsized":"2023-09-12T16:08:33.128195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:56.845163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.100509+0000","last_change":"2023-09-12T16:08:32.100068+0000","last_active":"2023-09-12T16:08:33.100509+0000","last_peered":"2023-09-12T16:08:33.100509+0000","last_clean":"2023-09-12T16:08:33.100509+0000","last_became_active":"2023-09-12T16:08:32.099760+0000","last_became_peered":"2023-09-12T16:08:32.099760+0000","last_unstale":"2023-09-12T16:08:33.100509+0000","last_undegraded":"2023-09-12T16:08:33.100509+0000","last_fullsized":"2023-09-12T16:08:33.100509+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:31:20.146943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.126068+0000","last_change":"2023-09-12T16:08:33.117467+0000","last_active":"2023-09-12T16:08:33.126068+0000","last_peered":"2023-09-12T16:08:33.126068+0000","last_clean":"2023-09-12T16:08:33.126068+0000","last_became_active":"2023-09-12T16:08:33.117082+0000","last_became_peered":"2023-09-12T16:08:33.117082+0000","last_unstale":"2023-09-12T16:08:33.126068+0000","last_undegraded":"2023-09-12T16:08:33.126068+0000","last_fullsized":"2023-09-12T16:08:33.126068+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:56:34.980592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.113844+0000","last_change":"2023-09-12T16:08:32.103889+0000","last_active":"2023-09-12T16:08:33.113844+0000","last_peered":"2023-09-12T16:08:33.113844+0000","last_clean":"2023-09-12T16:08:33.113844+0000","last_became_active":"2023-09-12T16:08:32.103625+0000","last_became_peered":"2023-09-12T16:08:32.103625+0000","last_unstale":"2023-09-12T16:08:33.113844+0000","last_undegraded":"2023-09-12T16:08:33.113844+0000","last_fullsized":"2023-09-12T16:08:33.113844+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:05:55.839146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.129873+0000","last_change":"2023-09-12T16:08:33.122739+0000","last_active":"2023-09-12T16:08:33.129873+0000","last_peered":"2023-09-12T16:08:33.129873+0000","last_clean":"2023-09-12T16:08:33.129873+0000","last_became_active":"2023-09-12T16:08:33.122023+0000","last_became_peered":"2023-09-12T16:08:33.122023+0000","last_unstale":"2023-09-12T16:08:33.129873+0000","last_undegraded":"2023-09-12T16:08:33.129873+0000","last_fullsized":"2023-09-12T16:08:33.129873+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:58:38.033978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.101965+0000","last_change":"2023-09-12T16:08:32.101958+0000","last_active":"2023-09-12T16:08:33.101965+0000","last_peered":"2023-09-12T16:08:33.101965+0000","last_clean":"2023-09-12T16:08:33.101965+0000","last_became_active":"2023-09-12T16:08:32.101680+0000","last_became_peered":"2023-09-12T16:08:32.101680+0000","last_unstale":"2023-09-12T16:08:33.101965+0000","last_undegraded":"2023-09-12T16:08:33.101965+0000","last_fullsized":"2023-09-12T16:08:33.101965+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:44:08.190478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.127084+0000","last_change":"2023-09-12T16:08:33.117043+0000","last_active":"2023-09-12T16:08:33.127084+0000","last_peered":"2023-09-12T16:08:33.127084+0000","last_clean":"2023-09-12T16:08:33.127084+0000","last_became_active":"2023-09-12T16:08:33.116803+0000","last_became_peered":"2023-09-12T16:08:33.116803+0000","last_unstale":"2023-09-12T16:08:33.127084+0000","last_undegraded":"2023-09-12T16:08:33.127084+0000","last_fullsized":"2023-09-12T16:08:33.127084+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:25:03.910239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.132304+0000","last_change":"2023-09-12T16:08:32.105597+0000","last_active":"2023-09-12T16:08:33.132304+0000","last_peered":"2023-09-12T16:08:33.132304+0000","last_clean":"2023-09-12T16:08:33.132304+0000","last_became_active":"2023-09-12T16:08:32.105302+0000","last_became_peered":"2023-09-12T16:08:32.105302+0000","last_unstale":"2023-09-12T16:08:33.132304+0000","last_undegraded":"2023-09-12T16:08:33.132304+0000","last_fullsized":"2023-09-12T16:08:33.132304+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T16:32:57.920598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.137478+0000","last_change":"2023-09-12T16:08:33.134833+0000","last_active":"2023-09-12T16:08:33.137478+0000","last_peered":"2023-09-12T16:08:33.137478+0000","last_clean":"2023-09-12T16:08:33.137478+0000","last_became_active":"2023-09-12T16:08:33.134363+0000","last_became_peered":"2023-09-12T16:08:33.134363+0000","last_unstale":"2023-09-12T16:08:33.137478+0000","last_undegraded":"2023-09-12T16:08:33.137478+0000","last_fullsized":"2023-09-12T16:08:33.137478+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:42:42.601295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.101321+0000","last_change":"2023-09-12T16:08:32.106673+0000","last_active":"2023-09-12T16:08:33.101321+0000","last_peered":"2023-09-12T16:08:33.101321+0000","last_clean":"2023-09-12T16:08:33.101321+0000","last_became_active":"2023-09-12T16:08:32.106395+0000","last_became_peered":"2023-09-12T16:08:32.106395+0000","last_unstale":"2023-09-12T16:08:33.101321+0000","last_undegraded":"2023-09-12T16:08:33.101321+0000","last_fullsized":"2023-09-12T16:08:33.101321+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:21:07.407188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.129827+0000","last_change":"2023-09-12T16:08:33.121920+0000","last_active":"2023-09-12T16:08:33.129827+0000","last_peered":"2023-09-12T16:08:33.129827+0000","last_clean":"2023-09-12T16:08:33.129827+0000","last_became_active":"2023-09-12T16:08:33.121707+0000","last_became_peered":"2023-09-12T16:08:33.121707+0000","last_unstale":"2023-09-12T16:08:33.129827+0000","last_undegraded":"2023-09-12T16:08:33.129827+0000","last_fullsized":"2023-09-12T16:08:33.129827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:39:08.995297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.104164+0000","last_change":"2023-09-12T16:08:32.101529+0000","last_active":"2023-09-12T16:08:33.104164+0000","last_peered":"2023-09-12T16:08:33.104164+0000","last_clean":"2023-09-12T16:08:33.104164+0000","last_became_active":"2023-09-12T16:08:32.101273+0000","last_became_peered":"2023-09-12T16:08:32.101273+0000","last_unstale":"2023-09-12T16:08:33.104164+0000","last_undegraded":"2023-09-12T16:08:33.104164+0000","last_fullsized":"2023-09-12T16:08:33.104164+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:56:33.974574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.129275+0000","last_change":"2023-09-12T16:08:33.125496+0000","last_active":"2023-09-12T16:08:33.129275+0000","last_peered":"2023-09-12T16:08:33.129275+0000","last_clean":"2023-09-12T16:08:33.129275+0000","last_became_active":"2023-09-12T16:08:33.125245+0000","last_became_peered":"2023-09-12T16:08:33.125245+0000","last_unstale":"2023-09-12T16:08:33.129275+0000","last_undegraded":"2023-09-12T16:08:33.129275+0000","last_fullsized":"2023-09-12T16:08:33.129275+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:14:15.485968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.105435+0000","last_change":"2023-09-12T16:08:32.105154+0000","last_active":"2023-09-12T16:08:33.105435+0000","last_peered":"2023-09-12T16:08:33.105435+0000","last_clean":"2023-09-12T16:08:33.105435+0000","last_became_active":"2023-09-12T16:08:32.104801+0000","last_became_peered":"2023-09-12T16:08:32.104801+0000","last_unstale":"2023-09-12T16:08:33.105435+0000","last_undegraded":"2023-09-12T16:08:33.105435+0000","last_fullsized":"2023-09-12T16:08:33.105435+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T18:05:12.186177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.129493+0000","last_change":"2023-09-12T16:08:33.122404+0000","last_active":"2023-09-12T16:08:33.129493+0000","last_peered":"2023-09-12T16:08:33.129493+0000","last_clean":"2023-09-12T16:08:33.129493+0000","last_became_active":"2023-09-12T16:08:33.122137+0000","last_became_peered":"2023-09-12T16:08:33.122137+0000","last_unstale":"2023-09-12T16:08:33.129493+0000","last_undegraded":"2023-09-12T16:08:33.129493+0000","last_fullsized":"2023-09-12T16:08:33.129493+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:56:34.980592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.100535+0000","last_change":"2023-09-12T16:08:32.097022+0000","last_active":"2023-09-12T16:08:33.100535+0000","last_peered":"2023-09-12T16:08:33.100535+0000","last_clean":"2023-09-12T16:08:33.100535+0000","last_became_active":"2023-09-12T16:08:32.096741+0000","last_became_peered":"2023-09-12T16:08:32.096741+0000","last_unstale":"2023-09-12T16:08:33.100535+0000","last_undegraded":"2023-09-12T16:08:33.100535+0000","last_fullsized":"2023-09-12T16:08:33.100535+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T17:44:08.190478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.123785+0000","last_change":"2023-09-12T16:08:33.117120+0000","last_active":"2023-09-12T16:08:33.123785+0000","last_peered":"2023-09-12T16:08:33.123785+0000","last_clean":"2023-09-12T16:08:33.123785+0000","last_became_active":"2023-09-12T16:08:33.116844+0000","last_became_peered":"2023-09-12T16:08:33.116844+0000","last_unstale":"2023-09-12T16:08:33.123785+0000","last_undegraded":"2023-09-12T16:08:33.123785+0000","last_fullsized":"2023-09-12T16:08:33.123785+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T19:25:01.198031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.104129+0000","last_change":"2023-09-12T16:08:32.100617+0000","last_active":"2023-09-12T16:08:33.104129+0000","last_peered":"2023-09-12T16:08:33.104129+0000","last_clean":"2023-09-12T16:08:33.104129+0000","last_became_active":"2023-09-12T16:08:32.100323+0000","last_became_peered":"2023-09-12T16:08:32.100323+0000","last_unstale":"2023-09-12T16:08:33.104129+0000","last_undegraded":"2023-09-12T16:08:33.104129+0000","last_fullsized":"2023-09-12T16:08:33.104129+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T00:38:33.657951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.131856+0000","last_change":"2023-09-12T16:08:33.124460+0000","last_active":"2023-09-12T16:08:33.131856+0000","last_peered":"2023-09-12T16:08:33.131856+0000","last_clean":"2023-09-12T16:08:33.131856+0000","last_became_active":"2023-09-12T16:08:33.123765+0000","last_became_peered":"2023-09-12T16:08:33.123765+0000","last_unstale":"2023-09-12T16:08:33.131856+0000","last_undegraded":"2023-09-12T16:08:33.131856+0000","last_fullsized":"2023-09-12T16:08:33.131856+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:23:59.946149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.098561+0000","last_change":"2023-09-12T16:08:32.092046+0000","last_active":"2023-09-12T16:08:33.098561+0000","last_peered":"2023-09-12T16:08:33.098561+0000","last_clean":"2023-09-12T16:08:33.098561+0000","last_became_active":"2023-09-12T16:08:32.091750+0000","last_became_peered":"2023-09-12T16:08:32.091750+0000","last_unstale":"2023-09-12T16:08:33.098561+0000","last_undegraded":"2023-09-12T16:08:33.098561+0000","last_fullsized":"2023-09-12T16:08:33.098561+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T01:34:56.684886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.122175+0000","last_change":"2023-09-12T16:08:33.115039+0000","last_active":"2023-09-12T16:08:33.122175+0000","last_peered":"2023-09-12T16:08:33.122175+0000","last_clean":"2023-09-12T16:08:33.122175+0000","last_became_active":"2023-09-12T16:08:33.114720+0000","last_became_peered":"2023-09-12T16:08:33.114720+0000","last_unstale":"2023-09-12T16:08:33.122175+0000","last_undegraded":"2023-09-12T16:08:33.122175+0000","last_fullsized":"2023-09-12T16:08:33.122175+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:32.076937+0000","last_clean_scrub_stamp":"2023-09-12T16:08:32.076937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T20:46:04.288875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-12T16:08:33.113982+0000","last_change":"2023-09-12T16:08:32.103200+0000","last_active":"2023-09-12T16:08:33.113982+0000","last_peered":"2023-09-12T16:08:33.113982+0000","last_clean":"2023-09-12T16:08:33.113982+0000","last_became_active":"2023-09-12T16:08:32.102908+0000","last_became_peered":"2023-09-12T16:08:32.102908+0000","last_unstale":"2023-09-12T16:08:33.113982+0000","last_undegraded":"2023-09-12T16:08:33.113982+0000","last_fullsized":"2023-09-12T16:08:33.113982+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:08:31.070920+0000","last_clean_scrub_stamp":"2023-09-12T16:08:31.070920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T23:56:33.974574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-09-12T16:08:32.093570+0000","last_change":"2023-09-12T16:06:50.214088+0000","last_active":"2023-09-12T16:08:32.093570+0000","last_peered":"2023-09-12T16:08:32.093570+0000","last_clean":"2023-09-12T16:08:32.093570+0000","last_became_active":"2023-09-12T16:06:50.213622+0000","last_became_peered":"2023-09-12T16:06:50.213622+0000","last_unstale":"2023-09-12T16:08:32.093570+0000","last_undegraded":"2023-09-12T16:08:32.093570+0000","last_fullsized":"2023-09-12T16:08:32.093570+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-12T16:06:49.077619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-12T16:06:49.077619+0000","last_clean_scrub_stamp":"2023-09-12T16:06:49.077619+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-13T22:18:36.870572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":766062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 12 16:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54300000000000004}]},{"osd":1,"last update":"Tue Sep 12 16:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.62}]},{"osd":2,"last update":"Tue Sep 12 16:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.59699999999999998}]},{"osd":3,"last update":"Tue Sep 12 16:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.748}]},{"osd":4,"last update":"Tue Sep 12 16:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.72299999999999998}]},{"osd":5,"last update":"Tue Sep 12 16:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.79100000000000004}]},{"osd":6,"last update":"Tue Sep 12 16:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.81999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":183371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.407,"5min":2.407,"15min":2.407},"last":0.70399999999999996}]},{"osd":1,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.75600000000000001}]},{"osd":2,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.77400000000000002}]},{"osd":3,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.82099999999999995}]},{"osd":4,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.57199999999999995}]},{"osd":5,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.59799999999999998}]},{"osd":7,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.622},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.30599999999999999}]},{"osd":2,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.499},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.47299999999999998}]},{"osd":3,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.39800000000000002}]},{"osd":4,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":0.879},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.74399999999999999}]},{"osd":5,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.75700000000000001}]},{"osd":6,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.95499999999999996}]},{"osd":7,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.73399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1019904,"data_stored":772172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 12 16:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.35799999999999998}]},{"osd":2,"last update":"Tue Sep 12 16:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.45600000000000002}]},{"osd":3,"last update":"Tue Sep 12 16:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.438},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.52800000000000002}]},{"osd":4,"last update":"Tue Sep 12 16:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.84899999999999998}]},{"osd":5,"last update":"Tue Sep 12 16:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.77200000000000002}]},{"osd":6,"last update":"Tue Sep 12 16:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.88300000000000001}]},{"osd":7,"last update":"Tue Sep 12 16:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.874}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":182859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.54500000000000004}]},{"osd":1,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.60399999999999998}]},{"osd":3,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.629},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.65500000000000003}]},{"osd":4,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.71199999999999997}]},{"osd":5,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.85799999999999998}]},{"osd":6,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.78800000000000003}]},{"osd":7,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.81299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":175694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 12 16:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.40600000000000003}]},{"osd":1,"last update":"Tue Sep 12 16:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.34499999999999997}]},{"osd":2,"last update":"Tue Sep 12 16:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.48799999999999999}]},{"osd":4,"last update":"Tue Sep 12 16:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.85099999999999998}]},{"osd":5,"last update":"Tue Sep 12 16:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.66400000000000003}]},{"osd":6,"last update":"Tue Sep 12 16:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.70699999999999996}]},{"osd":7,"last update":"Tue Sep 12 16:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.746}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":183393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.70999999999999996}]},{"osd":1,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.59099999999999997}]},{"osd":2,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.63100000000000001}]},{"osd":3,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":5.5119999999999996,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.65100000000000002}]},{"osd":5,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.443}]},{"osd":6,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.69599999999999995}]},{"osd":7,"last update":"Tue Sep 12 16:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.68100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":175694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.77400000000000002}]},{"osd":1,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.6339999999999999,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":0.79000000000000004}]},{"osd":2,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":3.1949999999999998,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.875},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":3.1779999999999999,"5min":3.1779999999999999,"15min":3.1779999999999999},"last":0.73499999999999999}]},{"osd":3,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.7930000000000001,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":0.753},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.71699999999999997}]},{"osd":4,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.65900000000000003}]},{"osd":6,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.85399999999999998}]},{"osd":7,"last update":"Tue Sep 12 16:07:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-12T16:08:37.956 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-12T16:08:37.957 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-12T16:08:38.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.193+0000 7efeb7dff700 1 -- 172.21.15.112:0/625570438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efeb00d1e90 msgr2=0x7efeb00cc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:38.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.193+0000 7efeb7dff700 1 --2- 172.21.15.112:0/625570438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efeb00d1e90 0x7efeb00cc9b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efea8009f60 tx=0x7efea8009f90 comp rx=0 tx=0).stop 2023-09-12T16:08:38.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.194+0000 7efeb7dff700 1 -- 172.21.15.112:0/625570438 shutdown_connections 2023-09-12T16:08:38.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.194+0000 7efeb7dff700 1 --2- 172.21.15.112:0/625570438 >> v2:172.21.15.144:3300/0 conn(0x7efeb015ef80 0x7efeb00cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:38.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.194+0000 7efeb7dff700 1 --2- 172.21.15.112:0/625570438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efeb00d1e90 0x7efeb00cc9b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:38.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.194+0000 7efeb7dff700 1 -- 172.21.15.112:0/625570438 >> 172.21.15.112:0/625570438 conn(0x7efeb008b190 msgr2=0x7efeb009aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:38.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.194+0000 7efeb7dff700 1 -- 172.21.15.112:0/625570438 shutdown_connections 2023-09-12T16:08:38.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.194+0000 7efeb7dff700 1 -- 172.21.15.112:0/625570438 wait complete. 2023-09-12T16:08:38.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.195+0000 7efeb7dff700 1 Processor -- start 2023-09-12T16:08:38.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.195+0000 7efeb7dff700 1 -- start start 2023-09-12T16:08:38.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.196+0000 7efeb7dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb00cf900 0x7efeb00c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:38.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.196+0000 7efeb7dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efeb00d1e90 0x7efeb0156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.196+0000 7efeb7dff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efeb015ef80 0x7efeb01f1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.196+0000 7efeb7dff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb015af30 con 0x7efeb00d1e90 2023-09-12T16:08:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.196+0000 7efeb7dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb01565a0 con 0x7efeb00cf900 2023-09-12T16:08:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.196+0000 7efeb7dff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb01f23e0 con 0x7efeb015ef80 2023-09-12T16:08:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.197+0000 7efeb539a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efeb00d1e90 0x7efeb0156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.197+0000 7efeb539a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efeb00d1e90 0x7efeb0156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59936/0 (socket says 172.21.15.112:59936) 2023-09-12T16:08:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.197+0000 7efeb539a700 1 -- 172.21.15.112:0/3302419401 learned_addr learned my addr 172.21.15.112:0/3302419401 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.197+0000 7efeb639c700 1 --2- 172.21.15.112:0/3302419401 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efeb015ef80 0x7efeb01f1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.197+0000 7efeb5b9b700 1 --2- 172.21.15.112:0/3302419401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb00cf900 0x7efeb00c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.197+0000 7efeb539a700 1 -- 172.21.15.112:0/3302419401 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efeb015ef80 msgr2=0x7efeb01f1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:38.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.197+0000 7efeb539a700 1 --2- 172.21.15.112:0/3302419401 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efeb015ef80 0x7efeb01f1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:38.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.197+0000 7efeb539a700 1 -- 172.21.15.112:0/3302419401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb00cf900 msgr2=0x7efeb00c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:38.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.197+0000 7efeb539a700 1 --2- 172.21.15.112:0/3302419401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb00cf900 0x7efeb00c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:38.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.197+0000 7efeb539a700 1 -- 172.21.15.112:0/3302419401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac0094c0 con 0x7efeb00d1e90 2023-09-12T16:08:38.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.197+0000 7efeb539a700 1 --2- 172.21.15.112:0/3302419401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efeb00d1e90 0x7efeb0156060 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7efea000c730 tx=0x7efea000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:38.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.197+0000 7efea67fc700 1 -- 172.21.15.112:0/3302419401 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea0005230 con 0x7efeb00d1e90 2023-09-12T16:08:38.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.198+0000 7efea67fc700 1 -- 172.21.15.112:0/3302419401 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efea0005480 con 0x7efeb00d1e90 2023-09-12T16:08:38.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.198+0000 7efea67fc700 1 -- 172.21.15.112:0/3302419401 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea0004990 con 0x7efeb00d1e90 2023-09-12T16:08:38.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.198+0000 7efeb7dff700 1 -- 172.21.15.112:0/3302419401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea8009c40 con 0x7efeb00d1e90 2023-09-12T16:08:38.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.198+0000 7efeb7dff700 1 -- 172.21.15.112:0/3302419401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb00b1a70 con 0x7efeb00d1e90 2023-09-12T16:08:38.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.199+0000 7efeb7dff700 1 -- 172.21.15.112:0/3302419401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb0073ea0 con 0x7efeb00d1e90 2023-09-12T16:08:38.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.200+0000 7efea67fc700 1 -- 172.21.15.112:0/3302419401 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7efea0004af0 con 0x7efeb00d1e90 2023-09-12T16:08:38.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.201+0000 7efea67fc700 1 --2- 172.21.15.112:0/3302419401 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7efe9406a580 0x7efe9406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:38.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.201+0000 7efea67fc700 1 -- 172.21.15.112:0/3302419401 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7efea0088170 con 0x7efeb00d1e90 2023-09-12T16:08:38.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.201+0000 7efeb5b9b700 1 --2- 172.21.15.112:0/3302419401 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7efe9406a580 0x7efe9406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:38.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.201+0000 7efeb5b9b700 1 --2- 172.21.15.112:0/3302419401 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7efe9406a580 0x7efe9406ca40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efeb015d2f0 tx=0x7efeac0091e0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:38.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.205+0000 7efea67fc700 1 -- 172.21.15.112:0/3302419401 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7efea0053660 con 0x7efeb00d1e90 2023-09-12T16:08:38.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.477+0000 7efeb7dff700 1 -- 172.21.15.112:0/3302419401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7efeb015b0e0 con 0x7efeb00d1e90 2023-09-12T16:08:38.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.480+0000 7efea67fc700 1 -- 172.21.15.112:0/3302419401 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+147 (secure 0 0 0) 0x7efea0056c80 con 0x7efeb00d1e90 2023-09-12T16:08:38.481 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2023-09-12T16:08:38.481 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBljABl3NnCFBAAwqxLxKcPIqofg05riNxItA== 2023-09-12T16:08:38.482 INFO:teuthology.orchestra.run.smithi112.stdout: caps mds = "allow" 2023-09-12T16:08:38.482 INFO:teuthology.orchestra.run.smithi112.stdout: caps mon = "allow r" 2023-09-12T16:08:38.482 INFO:teuthology.orchestra.run.smithi112.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-09-12T16:08:38.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.482+0000 7efeb7dff700 1 -- 172.21.15.112:0/3302419401 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7efe9406a580 msgr2=0x7efe9406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:38.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.482+0000 7efeb7dff700 1 --2- 172.21.15.112:0/3302419401 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7efe9406a580 0x7efe9406ca40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efeb015d2f0 tx=0x7efeac0091e0 comp rx=0 tx=0).stop 2023-09-12T16:08:38.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.482+0000 7efeb7dff700 1 -- 172.21.15.112:0/3302419401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efeb00d1e90 msgr2=0x7efeb0156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:38.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.482+0000 7efeb7dff700 1 --2- 172.21.15.112:0/3302419401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efeb00d1e90 0x7efeb0156060 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7efea000c730 tx=0x7efea000ca40 comp rx=0 tx=0).stop 2023-09-12T16:08:38.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.482+0000 7efeb7dff700 1 -- 172.21.15.112:0/3302419401 shutdown_connections 2023-09-12T16:08:38.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.482+0000 7efeb7dff700 1 --2- 172.21.15.112:0/3302419401 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7efe9406a580 0x7efe9406ca40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:38.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.482+0000 7efeb7dff700 1 --2- 172.21.15.112:0/3302419401 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efeb015ef80 0x7efeb01f1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:38.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.482+0000 7efeb7dff700 1 --2- 172.21.15.112:0/3302419401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb00cf900 0x7efeb00c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:38.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.482+0000 7efeb7dff700 1 --2- 172.21.15.112:0/3302419401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efeb00d1e90 0x7efeb0156060 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:38.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.482+0000 7efeb7dff700 1 -- 172.21.15.112:0/3302419401 >> 172.21.15.112:0/3302419401 conn(0x7efeb008b190 msgr2=0x7efeb00ae820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:38.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.483+0000 7efeb7dff700 1 -- 172.21.15.112:0/3302419401 shutdown_connections 2023-09-12T16:08:38.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.483+0000 7efeb7dff700 1 -- 172.21.15.112:0/3302419401 wait complete. 2023-09-12T16:08:38.486 INFO:teuthology.orchestra.run.smithi112.stderr:updated caps for client.0 2023-09-12T16:08:38.501 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-12T16:08:38.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.699+0000 7fb44e9ff700 1 -- 172.21.15.112:0/3979569524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb434003a00 msgr2=0x7fb434003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:38.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.699+0000 7fb44e9ff700 1 --2- 172.21.15.112:0/3979569524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb434003a00 0x7fb434003e20 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb438009bd0 tx=0x7fb434005880 comp rx=0 tx=0).stop 2023-09-12T16:08:38.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.699+0000 7fb44cf9c700 1 -- 172.21.15.112:0/3979569524 reap_dead start 2023-09-12T16:08:38.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.699+0000 7fb44e9ff700 1 -- 172.21.15.112:0/3979569524 shutdown_connections 2023-09-12T16:08:38.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.699+0000 7fb44e9ff700 1 -- 172.21.15.112:0/3979569524 >> 172.21.15.112:0/3979569524 conn(0x7fb4480d1930 msgr2=0x7fb4480d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:38.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.699+0000 7fb44e9ff700 1 -- 172.21.15.112:0/3979569524 shutdown_connections 2023-09-12T16:08:38.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.699+0000 7fb44e9ff700 1 -- 172.21.15.112:0/3979569524 wait complete. 2023-09-12T16:08:38.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.702+0000 7fb44e9ff700 1 Processor -- start 2023-09-12T16:08:38.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.702+0000 7fb44e9ff700 1 -- start start 2023-09-12T16:08:38.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.703+0000 7fb44e9ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb434003a00 0x7fb4480b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:38.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.703+0000 7fb44e9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb44815b6f0 0x7fb4480b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:38.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.703+0000 7fb44e9ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb4480cadb0 0x7fb44815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:38.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.703+0000 7fb44e9ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44809c4c0 con 0x7fb434003a00 2023-09-12T16:08:38.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.703+0000 7fb44e9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44809e740 con 0x7fb44815b6f0 2023-09-12T16:08:38.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.703+0000 7fb44e9ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44809c710 con 0x7fb4480cadb0 2023-09-12T16:08:38.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.703+0000 7fb447fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb434003a00 0x7fb4480b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:38.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.703+0000 7fb447fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb434003a00 0x7fb4480b2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59954/0 (socket says 172.21.15.112:59954) 2023-09-12T16:08:38.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.703+0000 7fb447fff700 1 -- 172.21.15.112:0/2293290219 learned_addr learned my addr 172.21.15.112:0/2293290219 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:38.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.704+0000 7fb44cf9c700 1 --2- 172.21.15.112:0/2293290219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb4480cadb0 0x7fb44815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:38.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.704+0000 7fb43ffff700 1 --2- 172.21.15.112:0/2293290219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb44815b6f0 0x7fb4480b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:38.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.704+0000 7fb447fff700 1 -- 172.21.15.112:0/2293290219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb4480cadb0 msgr2=0x7fb44815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:38.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.704+0000 7fb447fff700 1 --2- 172.21.15.112:0/2293290219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb4480cadb0 0x7fb44815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:38.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.704+0000 7fb447fff700 1 -- 172.21.15.112:0/2293290219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb44815b6f0 msgr2=0x7fb4480b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:38.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.704+0000 7fb447fff700 1 --2- 172.21.15.112:0/2293290219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb44815b6f0 0x7fb4480b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:38.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.704+0000 7fb447fff700 1 -- 172.21.15.112:0/2293290219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44809c9f0 con 0x7fb434003a00 2023-09-12T16:08:38.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.704+0000 7fb43ffff700 1 --2- 172.21.15.112:0/2293290219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb44815b6f0 0x7fb4480b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:08:38.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.704+0000 7fb447fff700 1 --2- 172.21.15.112:0/2293290219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb434003a00 0x7fb4480b2110 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb438000c00 tx=0x7fb438005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:38.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.704+0000 7fb4457fa700 1 -- 172.21.15.112:0/2293290219 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4380049b0 con 0x7fb434003a00 2023-09-12T16:08:38.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.704+0000 7fb4457fa700 1 -- 172.21.15.112:0/2293290219 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb438005260 con 0x7fb434003a00 2023-09-12T16:08:38.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.704+0000 7fb44e9ff700 1 -- 172.21.15.112:0/2293290219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44809ccd0 con 0x7fb434003a00 2023-09-12T16:08:38.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.704+0000 7fb4457fa700 1 -- 172.21.15.112:0/2293290219 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438005670 con 0x7fb434003a00 2023-09-12T16:08:38.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.705+0000 7fb44e9ff700 1 -- 172.21.15.112:0/2293290219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4480b65e0 con 0x7fb434003a00 2023-09-12T16:08:38.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.706+0000 7fb44e9ff700 1 -- 172.21.15.112:0/2293290219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44809ea20 con 0x7fb434003a00 2023-09-12T16:08:38.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.706+0000 7fb4457fa700 1 -- 172.21.15.112:0/2293290219 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fb438020050 con 0x7fb434003a00 2023-09-12T16:08:38.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.707+0000 7fb4457fa700 1 --2- 172.21.15.112:0/2293290219 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb42806a580 0x7fb42806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:38.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.707+0000 7fb4457fa700 1 -- 172.21.15.112:0/2293290219 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb43808acf0 con 0x7fb434003a00 2023-09-12T16:08:38.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.708+0000 7fb43ffff700 1 --2- 172.21.15.112:0/2293290219 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb42806a580 0x7fb42806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:38.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.708+0000 7fb43ffff700 1 --2- 172.21.15.112:0/2293290219 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb42806a580 0x7fb42806ca40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb4481f50a0 tx=0x7fb430009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:38.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.712+0000 7fb4457fa700 1 -- 172.21.15.112:0/2293290219 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb4380560a0 con 0x7fb434003a00 2023-09-12T16:08:38.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.956+0000 7fb44e9ff700 1 -- 172.21.15.112:0/2293290219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb44809e510 con 0x7fb434003a00 2023-09-12T16:08:38.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.956+0000 7fb4457fa700 1 -- 172.21.15.112:0/2293290219 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4922 (secure 0 0 0) 0x7fb44809e510 con 0x7fb434003a00 2023-09-12T16:08:38.958 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:38.958 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/2998708372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2998708372},{"type":"v1","addr":"172.21.15.112:6836","nonce":2998708372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4976,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/645279320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645279320},{"type":"v1","addr":"172.21.15.144:6833","nonce":645279320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":4979,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1677723765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1677723765},{"type":"v1","addr":"172.21.15.144:6835","nonce":1677723765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-12T16:08:32.573410+0000","modified":"2023-09-12T16:08:35.602701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5370},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5370":{"gid":5370,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6837/4247846879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":4247846879},{"type":"v1","addr":"172.21.15.112:6837","nonce":4247846879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-12T16:08:38.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.959+0000 7fb44e9ff700 1 -- 172.21.15.112:0/2293290219 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb42806a580 msgr2=0x7fb42806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:38.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.959+0000 7fb44e9ff700 1 --2- 172.21.15.112:0/2293290219 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb42806a580 0x7fb42806ca40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb4481f50a0 tx=0x7fb430009260 comp rx=0 tx=0).stop 2023-09-12T16:08:38.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.959+0000 7fb44e9ff700 1 -- 172.21.15.112:0/2293290219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb434003a00 msgr2=0x7fb4480b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:38.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.959+0000 7fb44e9ff700 1 --2- 172.21.15.112:0/2293290219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb434003a00 0x7fb4480b2110 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb438000c00 tx=0x7fb438005fa0 comp rx=0 tx=0).stop 2023-09-12T16:08:38.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.959+0000 7fb44e9ff700 1 -- 172.21.15.112:0/2293290219 shutdown_connections 2023-09-12T16:08:38.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.959+0000 7fb44e9ff700 1 --2- 172.21.15.112:0/2293290219 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb42806a580 0x7fb42806ca40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:38.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.959+0000 7fb44e9ff700 1 --2- 172.21.15.112:0/2293290219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb4480cadb0 0x7fb44815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:38.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.959+0000 7fb44e9ff700 1 --2- 172.21.15.112:0/2293290219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb434003a00 0x7fb4480b2110 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:38.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.959+0000 7fb44e9ff700 1 --2- 172.21.15.112:0/2293290219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb44815b6f0 0x7fb4480b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:38.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.959+0000 7fb44e9ff700 1 -- 172.21.15.112:0/2293290219 >> 172.21.15.112:0/2293290219 conn(0x7fb4480d1930 msgr2=0x7fb4480b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:38.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.959+0000 7fb44e9ff700 1 -- 172.21.15.112:0/2293290219 shutdown_connections 2023-09-12T16:08:38.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:38.959+0000 7fb44e9ff700 1 -- 172.21.15.112:0/2293290219 wait complete. 2023-09-12T16:08:38.963 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 17 2023-09-12T16:08:39.381 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-12T16:08:32.573410+0000', 'modified': '2023-09-12T16:08:35.602701+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5370}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5370': {'gid': 5370, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.112:6837/4247846879', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6835', 'nonce': 4247846879}, {'type': 'v1', 'addr': '172.21.15.112:6837', 'nonce': 4247846879}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-12T16:08:39.381 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-12T16:08:39.382 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-09-12T16:08:39.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.583+0000 7f8a4b7ff700 1 -- 172.21.15.112:0/2608776446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a30004d90 msgr2=0x7f8a30005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:39.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.583+0000 7f8a4b7ff700 1 --2- 172.21.15.112:0/2608776446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a30004d90 0x7f8a30005210 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c006fd0 tx=0x7f8a30005880 comp rx=0 tx=0).stop 2023-09-12T16:08:39.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.583+0000 7f8a49d9c700 1 -- 172.21.15.112:0/2608776446 reap_dead start 2023-09-12T16:08:39.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.584+0000 7f8a4b7ff700 1 -- 172.21.15.112:0/2608776446 shutdown_connections 2023-09-12T16:08:39.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.584+0000 7f8a4b7ff700 1 -- 172.21.15.112:0/2608776446 >> 172.21.15.112:0/2608776446 conn(0x7f8a440d1930 msgr2=0x7f8a440d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:39.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.584+0000 7f8a4b7ff700 1 -- 172.21.15.112:0/2608776446 shutdown_connections 2023-09-12T16:08:39.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.584+0000 7f8a4b7ff700 1 -- 172.21.15.112:0/2608776446 wait complete. 2023-09-12T16:08:39.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.585+0000 7f8a4b7ff700 1 Processor -- start 2023-09-12T16:08:39.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.585+0000 7f8a4b7ff700 1 -- start start 2023-09-12T16:08:39.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.586+0000 7f8a4b7ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a30004d90 0x7f8a440b68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:39.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.586+0000 7f8a4b7ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a44157bb0 0x7f8a44158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:39.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.586+0000 7f8a4b7ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8a44140820 0x7f8a44140cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:39.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.586+0000 7f8a4b7ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a44154220 con 0x7f8a30004d90 2023-09-12T16:08:39.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.586+0000 7f8a4b7ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a44158570 con 0x7f8a44157bb0 2023-09-12T16:08:39.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.586+0000 7f8a4b7ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a440b5570 con 0x7f8a44140820 2023-09-12T16:08:39.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.587+0000 7f8a4959b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a30004d90 0x7f8a440b68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:39.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.587+0000 7f8a4959b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a30004d90 0x7f8a440b68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59976/0 (socket says 172.21.15.112:59976) 2023-09-12T16:08:39.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.587+0000 7f8a4959b700 1 -- 172.21.15.112:0/2130781412 learned_addr learned my addr 172.21.15.112:0/2130781412 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:39.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.587+0000 7f8a48d9a700 1 --2- 172.21.15.112:0/2130781412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a44157bb0 0x7f8a44158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:39.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.587+0000 7f8a49d9c700 1 --2- 172.21.15.112:0/2130781412 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8a44140820 0x7f8a44140cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:39.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.587+0000 7f8a4959b700 1 -- 172.21.15.112:0/2130781412 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8a44140820 msgr2=0x7f8a44140cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:39.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.587+0000 7f8a4959b700 1 --2- 172.21.15.112:0/2130781412 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8a44140820 0x7f8a44140cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.587+0000 7f8a4959b700 1 -- 172.21.15.112:0/2130781412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a44157bb0 msgr2=0x7f8a44158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:39.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.587+0000 7f8a4959b700 1 --2- 172.21.15.112:0/2130781412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a44157bb0 0x7f8a44158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.587+0000 7f8a4959b700 1 -- 172.21.15.112:0/2130781412 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a440b5850 con 0x7f8a30004d90 2023-09-12T16:08:39.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.587+0000 7f8a49d9c700 1 --2- 172.21.15.112:0/2130781412 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8a44140820 0x7f8a44140cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-12T16:08:39.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.587+0000 7f8a4959b700 1 --2- 172.21.15.112:0/2130781412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a30004d90 0x7f8a440b68f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8a40011ae0 tx=0x7f8a40011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:39.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.587+0000 7f8a39ffb700 1 -- 172.21.15.112:0/2130781412 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4000fb80 con 0x7f8a30004d90 2023-09-12T16:08:39.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.588+0000 7f8a39ffb700 1 -- 172.21.15.112:0/2130781412 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8a4000fce0 con 0x7f8a30004d90 2023-09-12T16:08:39.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.588+0000 7f8a39ffb700 1 -- 172.21.15.112:0/2130781412 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40019670 con 0x7f8a30004d90 2023-09-12T16:08:39.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.588+0000 7f8a4b7ff700 1 -- 172.21.15.112:0/2130781412 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a440b5b30 con 0x7f8a30004d90 2023-09-12T16:08:39.597 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.588+0000 7f8a4b7ff700 1 -- 172.21.15.112:0/2130781412 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a440b60f0 con 0x7f8a30004d90 2023-09-12T16:08:39.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.590+0000 7f8a39ffb700 1 -- 172.21.15.112:0/2130781412 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f8a400197d0 con 0x7f8a30004d90 2023-09-12T16:08:39.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.591+0000 7f8a39ffb700 1 --2- 172.21.15.112:0/2130781412 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8a2806a580 0x7f8a2806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:39.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.591+0000 7f8a39ffb700 1 -- 172.21.15.112:0/2130781412 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8a40089720 con 0x7f8a30004d90 2023-09-12T16:08:39.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.592+0000 7f8a48d9a700 1 --2- 172.21.15.112:0/2130781412 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8a2806a580 0x7f8a2806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:39.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.592+0000 7f8a48d9a700 1 --2- 172.21.15.112:0/2130781412 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8a2806a580 0x7f8a2806ca40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8a340017a0 tx=0x7f8a34001550 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:39.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.593+0000 7f8a5f03bb80 1 Processor -- start 2023-09-12T16:08:39.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.593+0000 7f8a5f03bb80 1 -- start start 2023-09-12T16:08:39.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.594+0000 7f8a5f03bb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555a85f4a5e0 0x555a85f4a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:39.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.594+0000 7f8a5f03bb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a85f1d990 0x555a85f207c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:39.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.594+0000 7f8a5f03bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f1ba80 0x555a85f477d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:39.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.594+0000 7f8a5f03bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a85e88ca0 con 0x555a85f1ba80 2023-09-12T16:08:39.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.594+0000 7f8a5f03bb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a85e78670 con 0x555a85f1d990 2023-09-12T16:08:39.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.594+0000 7f8a5f03bb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a85e75dd0 con 0x555a85f4a5e0 2023-09-12T16:08:39.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.594+0000 7f8a49d9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f1ba80 0x555a85f477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:39.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.594+0000 7f8a49d9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f1ba80 0x555a85f477d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59984/0 (socket says 172.21.15.112:59984) 2023-09-12T16:08:39.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.594+0000 7f8a49d9c700 1 -- 172.21.15.112:0/2933830639 learned_addr learned my addr 172.21.15.112:0/2933830639 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:39.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.595+0000 7f8a4959b700 1 --2- 172.21.15.112:0/2933830639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555a85f4a5e0 0x555a85f4a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:39.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.595+0000 7f8a48d9a700 1 --2- 172.21.15.112:0/2933830639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a85f1d990 0x555a85f207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:39.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.595+0000 7f8a49d9c700 1 -- 172.21.15.112:0/2933830639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555a85f4a5e0 msgr2=0x555a85f4a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-12T16:08:39.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.595+0000 7f8a49d9c700 1 --2- 172.21.15.112:0/2933830639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555a85f4a5e0 0x555a85f4a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.595+0000 7f8a49d9c700 1 -- 172.21.15.112:0/2933830639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a85f1d990 msgr2=0x555a85f207c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-12T16:08:39.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.595+0000 7f8a49d9c700 1 --2- 172.21.15.112:0/2933830639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a85f1d990 0x555a85f207c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.595+0000 7f8a49d9c700 1 -- 172.21.15.112:0/2933830639 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a85c63790 con 0x555a85f1ba80 2023-09-12T16:08:39.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.595+0000 7f8a49d9c700 1 --2- 172.21.15.112:0/2933830639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f1ba80 0x555a85f477d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8a440b3300 tx=0x7f8a3c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d84d549018c6f38 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:39.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.595+0000 7f8a26ffd700 1 -- 172.21.15.112:0/2933830639 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c015040 con 0x555a85f1ba80 2023-09-12T16:08:39.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.595+0000 7f8a26ffd700 1 -- 172.21.15.112:0/2933830639 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8a3c001240 con 0x555a85f1ba80 2023-09-12T16:08:39.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.595+0000 7f8a26ffd700 1 -- 172.21.15.112:0/2933830639 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c003db0 con 0x555a85f1ba80 2023-09-12T16:08:39.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.596+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/2933830639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f1ba80 msgr2=0x555a85f477d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:39.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.596+0000 7f8a5f03bb80 1 --2- 172.21.15.112:0/2933830639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f1ba80 0x555a85f477d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8a440b3300 tx=0x7f8a3c0014a0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.596+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/2933830639 shutdown_connections 2023-09-12T16:08:39.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.596+0000 7f8a5f03bb80 1 --2- 172.21.15.112:0/2933830639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555a85f4a5e0 0x555a85f4a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.596+0000 7f8a5f03bb80 1 --2- 172.21.15.112:0/2933830639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f1ba80 0x555a85f477d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.596+0000 7f8a5f03bb80 1 --2- 172.21.15.112:0/2933830639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a85f1d990 0x555a85f207c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.596+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/2933830639 >> 172.21.15.112:0/2933830639 conn(0x555a85e4d530 msgr2=0x555a85f653f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:39.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.596+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/2933830639 shutdown_connections 2023-09-12T16:08:39.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.596+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/2933830639 wait complete. 2023-09-12T16:08:39.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.597+0000 7f8a5f03bb80 1 -- start start 2023-09-12T16:08:39.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.597+0000 7f8a5f03bb80 1 Processor -- start 2023-09-12T16:08:39.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.598+0000 7f8a5f03bb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a85f1ba80 0x555a85f48a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:39.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.598+0000 7f8a5f03bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f1d990 0x555a85f45560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:39.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.598+0000 7f8a5f03bb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555a85f4a5e0 0x555a85f45aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:39.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.598+0000 7f8a5f03bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a85e716c0 con 0x555a85f1d990 2023-09-12T16:08:39.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.598+0000 7f8a5f03bb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a85e2d790 con 0x555a85f1ba80 2023-09-12T16:08:39.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.598+0000 7f8a5f03bb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a85e13af0 con 0x555a85f4a5e0 2023-09-12T16:08:39.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.598+0000 7f8a5f03bb80 10 client.0 _ll_register_callbacks cb 0x555a85c775a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-12T16:08:39.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.599+0000 7f8a48d9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f1d990 0x555a85f45560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:39.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.599+0000 7f8a48d9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f1d990 0x555a85f45560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59992/0 (socket says 172.21.15.112:59992) 2023-09-12T16:08:39.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.599+0000 7f8a48d9a700 1 -- 172.21.15.112:0/2105477265 learned_addr learned my addr 172.21.15.112:0/2105477265 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:39.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.599+0000 7f8a4959b700 1 --2- 172.21.15.112:0/2105477265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a85f1ba80 0x555a85f48a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:39.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.599+0000 7f8a49d9c700 1 --2- 172.21.15.112:0/2105477265 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555a85f4a5e0 0x555a85f45aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:39.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.599+0000 7f8a48d9a700 1 -- 172.21.15.112:0/2105477265 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555a85f4a5e0 msgr2=0x555a85f45aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-12T16:08:39.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.599+0000 7f8a48d9a700 1 --2- 172.21.15.112:0/2105477265 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555a85f4a5e0 0x555a85f45aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.599+0000 7f8a48d9a700 1 -- 172.21.15.112:0/2105477265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a85f1ba80 msgr2=0x555a85f48a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-12T16:08:39.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.599+0000 7f8a48d9a700 1 --2- 172.21.15.112:0/2105477265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a85f1ba80 0x555a85f48a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.599+0000 7f8a48d9a700 1 -- 172.21.15.112:0/2105477265 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a300035b0 con 0x555a85f1d990 2023-09-12T16:08:39.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.599+0000 7f8a4959b700 1 --2- 172.21.15.112:0/2105477265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a85f1ba80 0x555a85f48a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:08:39.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.599+0000 7f8a48d9a700 1 --2- 172.21.15.112:0/2105477265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f1d990 0x555a85f45560 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8a34003d00 tx=0x7f8a34014070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e3781a8e3a1791 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:39.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.599+0000 7f8a1ffff700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-09-12T16:08:39.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.600+0000 7f8a1ffff700 1 -- 172.21.15.112:0/2105477265 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a34023070 con 0x555a85f1d990 2023-09-12T16:08:39.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.600+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/2105477265 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555a85f12980 con 0x555a85f1d990 2023-09-12T16:08:39.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.600+0000 7f8a1ffff700 1 -- 172.21.15.112:0/2105477265 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8a34013e00 con 0x555a85f1d990 2023-09-12T16:08:39.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.600+0000 7f8a1ffff700 1 -- 172.21.15.112:0/2105477265 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a34003ea0 con 0x555a85f1d990 2023-09-12T16:08:39.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.600+0000 7f8a5f03bb80 10 client.5529 fetch_fsmap learned FSMap version 17 2023-09-12T16:08:39.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.600+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/2105477265 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x555a85d500a0 con 0x555a85f1d990 2023-09-12T16:08:39.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.600+0000 7f8a1ffff700 1 -- 172.21.15.112:0/2105477265 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x555a85f12980 con 0x555a85f1d990 2023-09-12T16:08:39.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.600+0000 7f8a1ffff700 1 -- 172.21.15.112:0/2105477265 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8a34029420 con 0x555a85f1d990 2023-09-12T16:08:39.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.600+0000 7f8a5f03bb80 10 client.5529 fetch_fsmap finished waiting for FSMap version 17 2023-09-12T16:08:39.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.600+0000 7f8a5f03bb80 10 client.5529 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-12T16:08:39.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.600+0000 7f8a5f03bb80 20 client.5529 populate_metadata read hostname 'smithi112' 2023-09-12T16:08:39.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.600+0000 7f8a5f03bb80 1 --2- 172.21.15.112:0/2105477265 >> [v2:172.21.15.112:6835/4247846879,v1:172.21.15.112:6837/4247846879] conn(0x555a85f48060 0x555a85f6bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:39.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.600+0000 7f8a5f03bb80 4 client.5529 mds_command: new command op to 5370 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-12T16:08:39.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.600+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/2105477265 --> [v2:172.21.15.112:6835/4247846879,v1:172.21.15.112:6837/4247846879] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555a85eeee90 con 0x555a85f48060 2023-09-12T16:08:39.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.601+0000 7f8a4959b700 1 --2- 172.21.15.112:0/2105477265 >> [v2:172.21.15.112:6835/4247846879,v1:172.21.15.112:6837/4247846879] conn(0x555a85f48060 0x555a85f6bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:39.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.601+0000 7f8a4959b700 1 --2- 172.21.15.112:0/2105477265 >> [v2:172.21.15.112:6835/4247846879,v1:172.21.15.112:6837/4247846879] conn(0x555a85f48060 0x555a85f6bc30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b7e27a0e0c1322b server_cookie=1ba96d5e31f156d8 in_seq=0 out_seq=0 2023-09-12T16:08:39.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.601+0000 7f8a1ffff700 10 client.5529 ms_handle_connect on v2:172.21.15.112:6835/4247846879 2023-09-12T16:08:39.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.602+0000 7f8a1ffff700 1 -- 172.21.15.112:0/2105477265 <== mds.0 v2:172.21.15.112:6835/4247846879 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555a85eeee90 con 0x555a85f48060 2023-09-12T16:08:39.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.602+0000 7f8a1ffff700 10 client.5529 handle_command_reply: tid=0 2023-09-12T16:08:39.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.602+0000 7f8a5f03bb80 1 client.5529 shutdown 2023-09-12T16:08:39.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.602+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/2105477265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f1d990 msgr2=0x555a85f45560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:39.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.602+0000 7f8a5f03bb80 1 --2- 172.21.15.112:0/2105477265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f1d990 0x555a85f45560 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8a34003d00 tx=0x7f8a34014070 comp rx=0 tx=0).stop 2023-09-12T16:08:39.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.602+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/2105477265 shutdown_connections 2023-09-12T16:08:39.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.602+0000 7f8a5f03bb80 1 --2- 172.21.15.112:0/2105477265 >> [v2:172.21.15.112:6835/4247846879,v1:172.21.15.112:6837/4247846879] conn(0x555a85f48060 0x555a85f6bc30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.602+0000 7f8a5f03bb80 1 --2- 172.21.15.112:0/2105477265 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555a85f4a5e0 0x555a85f45aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.602+0000 7f8a5f03bb80 1 --2- 172.21.15.112:0/2105477265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a85f1ba80 0x555a85f48a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.602+0000 7f8a1ffff700 0 client.5529 ms_handle_reset on v2:172.21.15.112:6835/4247846879 2023-09-12T16:08:39.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.602+0000 7f8a5f03bb80 1 --2- 172.21.15.112:0/2105477265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f1d990 0x555a85f45560 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.602+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/2105477265 >> 172.21.15.112:0/2105477265 conn(0x555a85e4d530 msgr2=0x555a85f690c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:39.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.602+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/2105477265 shutdown_connections 2023-09-12T16:08:39.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.602+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/2105477265 wait complete. 2023-09-12T16:08:39.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.602+0000 7f8a5f03bb80 20 client.5529 trim_cache size 0 max 16384 2023-09-12T16:08:39.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.620+0000 7f8a5f03bb80 1 Processor -- start 2023-09-12T16:08:39.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.620+0000 7f8a5f03bb80 1 -- start start 2023-09-12T16:08:39.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.621+0000 7f8a5f03bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f1ba80 0x555a85f488a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:39.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.621+0000 7f8a5f03bb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a85f1d990 0x555a85f1aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:39.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.621+0000 7f8a5f03bb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555a85f4a5e0 0x555a85f1afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:39.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.621+0000 7f8a5f03bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a85c64390 con 0x555a85f1ba80 2023-09-12T16:08:39.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.621+0000 7f8a5f03bb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a85f206d0 con 0x555a85f1d990 2023-09-12T16:08:39.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.621+0000 7f8a5f03bb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a85f1bf70 con 0x555a85f4a5e0 2023-09-12T16:08:39.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.621+0000 7f8a4959b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f1ba80 0x555a85f488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:39.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.621+0000 7f8a4959b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f1ba80 0x555a85f488a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60008/0 (socket says 172.21.15.112:60008) 2023-09-12T16:08:39.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.621+0000 7f8a4959b700 1 -- 172.21.15.112:0/1896193307 learned_addr learned my addr 172.21.15.112:0/1896193307 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:39.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.621+0000 7f8a4959b700 1 -- 172.21.15.112:0/1896193307 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555a85f4a5e0 msgr2=0x555a85f1afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-12T16:08:39.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.621+0000 7f8a4959b700 1 --2- 172.21.15.112:0/1896193307 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555a85f4a5e0 0x555a85f1afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.621+0000 7f8a4959b700 1 -- 172.21.15.112:0/1896193307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a85f1d990 msgr2=0x555a85f1aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-12T16:08:39.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.621+0000 7f8a4959b700 1 --2- 172.21.15.112:0/1896193307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a85f1d990 0x555a85f1aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.621+0000 7f8a4959b700 1 -- 172.21.15.112:0/1896193307 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a85e35b90 con 0x555a85f1ba80 2023-09-12T16:08:39.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.622+0000 7f8a4959b700 1 --2- 172.21.15.112:0/1896193307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f1ba80 0x555a85f488a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8a40012fd0 tx=0x7f8a40087940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b71e835d8dda6d server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:39.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.622+0000 7f8a277fe700 1 -- 172.21.15.112:0/1896193307 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40087b80 con 0x555a85f1ba80 2023-09-12T16:08:39.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.622+0000 7f8a277fe700 1 -- 172.21.15.112:0/1896193307 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8a40056bd0 con 0x555a85f1ba80 2023-09-12T16:08:39.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.622+0000 7f8a277fe700 1 -- 172.21.15.112:0/1896193307 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40057f60 con 0x555a85f1ba80 2023-09-12T16:08:39.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.622+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/1896193307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f1ba80 msgr2=0x555a85f488a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:39.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.622+0000 7f8a5f03bb80 1 --2- 172.21.15.112:0/1896193307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f1ba80 0x555a85f488a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8a40012fd0 tx=0x7f8a40087940 comp rx=0 tx=0).stop 2023-09-12T16:08:39.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.622+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/1896193307 shutdown_connections 2023-09-12T16:08:39.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.622+0000 7f8a5f03bb80 1 --2- 172.21.15.112:0/1896193307 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555a85f4a5e0 0x555a85f1afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.622+0000 7f8a5f03bb80 1 --2- 172.21.15.112:0/1896193307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f1ba80 0x555a85f488a0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.622+0000 7f8a5f03bb80 1 --2- 172.21.15.112:0/1896193307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a85f1d990 0x555a85f1aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.622+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/1896193307 >> 172.21.15.112:0/1896193307 conn(0x555a85e4d530 msgr2=0x555a85f86040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:39.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.623+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/1896193307 shutdown_connections 2023-09-12T16:08:39.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.623+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/1896193307 wait complete. 2023-09-12T16:08:39.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.623+0000 7f8a5f03bb80 1 -- start start 2023-09-12T16:08:39.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.623+0000 7f8a5f03bb80 1 Processor -- start 2023-09-12T16:08:39.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.624+0000 7f8a5f03bb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a85f1ba80 0x555a85f4df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:39.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.624+0000 7f8a5f03bb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555a85f1d990 0x555a85f36140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:39.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.624+0000 7f8a5f03bb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f4a5e0 0x555a85f1a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:39.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.624+0000 7f8a5f03bb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a85f4e480 con 0x555a85f4a5e0 2023-09-12T16:08:39.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.624+0000 7f8a5f03bb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a85f69620 con 0x555a85f1ba80 2023-09-12T16:08:39.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.624+0000 7f8a5f03bb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a85f36e60 con 0x555a85f1d990 2023-09-12T16:08:39.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.624+0000 7f8a5f03bb80 10 client.0 _ll_register_callbacks cb 0x7f8a34003bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-12T16:08:39.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.625+0000 7f8a49d9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f4a5e0 0x555a85f1a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:39.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.625+0000 7f8a49d9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f4a5e0 0x555a85f1a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60020/0 (socket says 172.21.15.112:60020) 2023-09-12T16:08:39.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.625+0000 7f8a49d9c700 1 -- 172.21.15.112:0/2938062605 learned_addr learned my addr 172.21.15.112:0/2938062605 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:39.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.625+0000 7f8a48d9a700 1 --2- 172.21.15.112:0/2938062605 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555a85f1d990 0x555a85f36140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:39.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.625+0000 7f8a4959b700 1 --2- 172.21.15.112:0/2938062605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a85f1ba80 0x555a85f4df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:39.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.625+0000 7f8a49d9c700 1 -- 172.21.15.112:0/2938062605 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555a85f1d990 msgr2=0x555a85f36140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-12T16:08:39.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.625+0000 7f8a49d9c700 1 --2- 172.21.15.112:0/2938062605 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555a85f1d990 0x555a85f36140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.625+0000 7f8a49d9c700 1 -- 172.21.15.112:0/2938062605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a85f1ba80 msgr2=0x555a85f4df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-12T16:08:39.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.625+0000 7f8a49d9c700 1 --2- 172.21.15.112:0/2938062605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a85f1ba80 0x555a85f4df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.625+0000 7f8a49d9c700 1 -- 172.21.15.112:0/2938062605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a440b60f0 con 0x555a85f4a5e0 2023-09-12T16:08:39.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.625+0000 7f8a49d9c700 1 --2- 172.21.15.112:0/2938062605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f4a5e0 0x555a85f1a710 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8a4408bbe0 tx=0x7f8a3c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb246dbefced58c server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:39.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.625+0000 7f8a1ffff700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-09-12T16:08:39.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.626+0000 7f8a1ffff700 1 -- 172.21.15.112:0/2938062605 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c015070 con 0x555a85f4a5e0 2023-09-12T16:08:39.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.626+0000 7f8a1ffff700 1 -- 172.21.15.112:0/2938062605 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8a3c00cbb0 con 0x555a85f4a5e0 2023-09-12T16:08:39.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.626+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/2938062605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a3c001240 con 0x555a85f4a5e0 2023-09-12T16:08:39.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.626+0000 7f8a1ffff700 1 -- 172.21.15.112:0/2938062605 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a3c00cd70 con 0x555a85f4a5e0 2023-09-12T16:08:39.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.626+0000 7f8a5f03bb80 10 client.5535 fetch_fsmap learned FSMap version 17 2023-09-12T16:08:39.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.626+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/2938062605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x555a85cc41d0 con 0x555a85f4a5e0 2023-09-12T16:08:39.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.626+0000 7f8a1ffff700 1 -- 172.21.15.112:0/2938062605 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8a3c001240 con 0x555a85f4a5e0 2023-09-12T16:08:39.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.626+0000 7f8a1ffff700 1 -- 172.21.15.112:0/2938062605 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8a3c0060d0 con 0x555a85f4a5e0 2023-09-12T16:08:39.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.626+0000 7f8a5f03bb80 10 client.5535 fetch_fsmap finished waiting for FSMap version 17 2023-09-12T16:08:39.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.626+0000 7f8a5f03bb80 10 client.5535 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-12T16:08:39.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.626+0000 7f8a5f03bb80 20 client.5535 populate_metadata read hostname 'smithi112' 2023-09-12T16:08:39.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.626+0000 7f8a5f03bb80 1 --2- 172.21.15.112:0/2938062605 >> [v2:172.21.15.112:6835/4247846879,v1:172.21.15.112:6837/4247846879] conn(0x555a85fccab0 0x555a85f1ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:39.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.626+0000 7f8a5f03bb80 4 client.5535 mds_command: new command op to 5370 tid=0[{"prefix": "status"}] 2023-09-12T16:08:39.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.626+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/2938062605 --> [v2:172.21.15.112:6835/4247846879,v1:172.21.15.112:6837/4247846879] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555a85e6a800 con 0x555a85fccab0 2023-09-12T16:08:39.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.626+0000 7f8a4959b700 1 --2- 172.21.15.112:0/2938062605 >> [v2:172.21.15.112:6835/4247846879,v1:172.21.15.112:6837/4247846879] conn(0x555a85fccab0 0x555a85f1ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:39.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.627+0000 7f8a4959b700 1 --2- 172.21.15.112:0/2938062605 >> [v2:172.21.15.112:6835/4247846879,v1:172.21.15.112:6837/4247846879] conn(0x555a85fccab0 0x555a85f1ac50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47502803a1a6ab42 server_cookie=6be94d2013e9622f in_seq=0 out_seq=0 2023-09-12T16:08:39.652 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.627+0000 7f8a1ffff700 10 client.5535 ms_handle_connect on v2:172.21.15.112:6835/4247846879 2023-09-12T16:08:39.652 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.627+0000 7f8a1ffff700 1 -- 172.21.15.112:0/2938062605 <== mds.0 v2:172.21.15.112:6835/4247846879 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x555a85e6a800 con 0x555a85fccab0 2023-09-12T16:08:39.652 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.627+0000 7f8a1ffff700 10 client.5535 handle_command_reply: tid=0 2023-09-12T16:08:39.652 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.627+0000 7f8a5f03bb80 1 client.5535 shutdown 2023-09-12T16:08:39.652 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.627+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/2938062605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f4a5e0 msgr2=0x555a85f1a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:39.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.627+0000 7f8a5f03bb80 1 --2- 172.21.15.112:0/2938062605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f4a5e0 0x555a85f1a710 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8a4408bbe0 tx=0x7f8a3c00c6a0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.627+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/2938062605 shutdown_connections 2023-09-12T16:08:39.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.627+0000 7f8a5f03bb80 1 --2- 172.21.15.112:0/2938062605 >> [v2:172.21.15.112:6835/4247846879,v1:172.21.15.112:6837/4247846879] conn(0x555a85fccab0 0x555a85f1ac50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.627+0000 7f8a5f03bb80 1 --2- 172.21.15.112:0/2938062605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a85f4a5e0 0x555a85f1a710 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.627+0000 7f8a5f03bb80 1 --2- 172.21.15.112:0/2938062605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a85f1ba80 0x555a85f4df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.627+0000 7f8a1ffff700 0 client.5535 ms_handle_reset on v2:172.21.15.112:6835/4247846879 2023-09-12T16:08:39.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.627+0000 7f8a5f03bb80 1 --2- 172.21.15.112:0/2938062605 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555a85f1d990 0x555a85f36140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.627+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/2938062605 >> 172.21.15.112:0/2938062605 conn(0x555a85e4d530 msgr2=0x555a85f44740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:39.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.627+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/2938062605 shutdown_connections 2023-09-12T16:08:39.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.628+0000 7f8a5f03bb80 1 -- 172.21.15.112:0/2938062605 wait complete. 2023-09-12T16:08:39.655 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.628+0000 7f8a5f03bb80 20 client.5535 trim_cache size 0 max 16384 2023-09-12T16:08:39.655 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-09-12T16:08:39.655 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "81d9ebed-ec6c-4564-a5d4-cdbd74c977f8", 2023-09-12T16:08:39.656 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2023-09-12T16:08:39.656 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 5370, 2023-09-12T16:08:39.656 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2023-09-12T16:08:39.656 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2023-09-12T16:08:39.657 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2023-09-12T16:08:39.657 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 6.5216309150000003, 2023-09-12T16:08:39.657 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 17, 2023-09-12T16:08:39.657 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 38, 2023-09-12T16:08:39.657 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 38, 2023-09-12T16:08:39.658 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 15.343324542 2023-09-12T16:08:39.658 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-09-12T16:08:39.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.628+0000 7f8a4b7ff700 1 -- 172.21.15.112:0/2130781412 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8a2806a580 msgr2=0x7f8a2806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.628+0000 7f8a4b7ff700 1 --2- 172.21.15.112:0/2130781412 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8a2806a580 0x7f8a2806ca40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8a340017a0 tx=0x7f8a34001550 comp rx=0 tx=0).stop 2023-09-12T16:08:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.628+0000 7f8a4b7ff700 1 -- 172.21.15.112:0/2130781412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a30004d90 msgr2=0x7f8a440b68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.628+0000 7f8a4b7ff700 1 --2- 172.21.15.112:0/2130781412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a30004d90 0x7f8a440b68f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8a40011ae0 tx=0x7f8a40011ea0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.628+0000 7f8a4b7ff700 1 -- 172.21.15.112:0/2130781412 shutdown_connections 2023-09-12T16:08:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.628+0000 7f8a4b7ff700 1 --2- 172.21.15.112:0/2130781412 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f8a2806a580 0x7f8a2806ca40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.628+0000 7f8a4b7ff700 1 --2- 172.21.15.112:0/2130781412 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8a44140820 0x7f8a44140cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.628+0000 7f8a4b7ff700 1 --2- 172.21.15.112:0/2130781412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a30004d90 0x7f8a440b68f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.628+0000 7f8a4b7ff700 1 --2- 172.21.15.112:0/2130781412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a44157bb0 0x7f8a44158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.628+0000 7f8a4b7ff700 1 -- 172.21.15.112:0/2130781412 >> 172.21.15.112:0/2130781412 conn(0x7f8a440d1930 msgr2=0x7f8a440c7880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:39.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.629+0000 7f8a4b7ff700 1 -- 172.21.15.112:0/2130781412 shutdown_connections 2023-09-12T16:08:39.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.629+0000 7f8a4b7ff700 1 -- 172.21.15.112:0/2130781412 wait complete. 2023-09-12T16:08:39.662 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-12T16:08:39.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.860+0000 7f0fc59ff700 1 -- 172.21.15.112:0/2032111187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fc0159af0 msgr2=0x7f0fc00cd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:39.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.860+0000 7f0fc59ff700 1 --2- 172.21.15.112:0/2032111187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fc0159af0 0x7f0fc00cd440 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0005fd0 tx=0x7f0fb0009c70 comp rx=0 tx=0).stop 2023-09-12T16:08:39.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.860+0000 7f0fc59ff700 1 -- 172.21.15.112:0/2032111187 shutdown_connections 2023-09-12T16:08:39.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.860+0000 7f0fc59ff700 1 --2- 172.21.15.112:0/2032111187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fc0159af0 0x7f0fc00cd440 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.860+0000 7f0fc59ff700 1 --2- 172.21.15.112:0/2032111187 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fc00c9ac0 0x7f0fc00cd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.861+0000 7f0fc59ff700 1 -- 172.21.15.112:0/2032111187 >> 172.21.15.112:0/2032111187 conn(0x7f0fc006a650 msgr2=0x7f0fc006c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:39.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.861+0000 7f0fc59ff700 1 -- 172.21.15.112:0/2032111187 shutdown_connections 2023-09-12T16:08:39.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.861+0000 7f0fc59ff700 1 -- 172.21.15.112:0/2032111187 wait complete. 2023-09-12T16:08:39.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.863+0000 7f0fc59ff700 1 Processor -- start 2023-09-12T16:08:39.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.863+0000 7f0fc59ff700 1 -- start start 2023-09-12T16:08:39.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.864+0000 7f0fc59ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fc0070e00 0x7f0fc01f6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:39.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.864+0000 7f0fc59ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fc0159af0 0x7f0fc00afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:39.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.864+0000 7f0fc59ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fc00b0330 0x7f0fc01f1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:39.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.864+0000 7f0fc59ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc01f68a0 con 0x7f0fc0070e00 2023-09-12T16:08:39.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.864+0000 7f0fc59ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc00cb930 con 0x7f0fc00b0330 2023-09-12T16:08:39.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.864+0000 7f0fc59ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc00b09b0 con 0x7f0fc0159af0 2023-09-12T16:08:39.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.865+0000 7f0fbeffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fc0070e00 0x7f0fc01f6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:39.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.865+0000 7f0fbeffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fc0070e00 0x7f0fc01f6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60038/0 (socket says 172.21.15.112:60038) 2023-09-12T16:08:39.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.865+0000 7f0fbeffd700 1 -- 172.21.15.112:0/1407964343 learned_addr learned my addr 172.21.15.112:0/1407964343 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:08:39.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.865+0000 7f0fb7fff700 1 --2- 172.21.15.112:0/1407964343 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fc0159af0 0x7f0fc00afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:39.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.865+0000 7f0fbf7fe700 1 --2- 172.21.15.112:0/1407964343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fc00b0330 0x7f0fc01f1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:39.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.865+0000 7f0fbeffd700 1 -- 172.21.15.112:0/1407964343 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fc0159af0 msgr2=0x7f0fc00afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:39.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.865+0000 7f0fbeffd700 1 --2- 172.21.15.112:0/1407964343 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fc0159af0 0x7f0fc00afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.865+0000 7f0fbeffd700 1 -- 172.21.15.112:0/1407964343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fc00b0330 msgr2=0x7f0fc01f1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:39.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.865+0000 7f0fbeffd700 1 --2- 172.21.15.112:0/1407964343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fc00b0330 0x7f0fc01f1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:39.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.865+0000 7f0fbeffd700 1 -- 172.21.15.112:0/1407964343 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb00095f0 con 0x7f0fc0070e00 2023-09-12T16:08:39.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.865+0000 7f0fbeffd700 1 --2- 172.21.15.112:0/1407964343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fc0070e00 0x7f0fc01f6360 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00098e0 tx=0x7f0fb000bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:39.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.865+0000 7f0fbcff9700 1 -- 172.21.15.112:0/1407964343 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb001c070 con 0x7f0fc0070e00 2023-09-12T16:08:39.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.865+0000 7f0fbcff9700 1 -- 172.21.15.112:0/1407964343 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0fb0003890 con 0x7f0fc0070e00 2023-09-12T16:08:39.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.865+0000 7f0fc59ff700 1 -- 172.21.15.112:0/1407964343 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc00b0c90 con 0x7f0fc0070e00 2023-09-12T16:08:39.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.865+0000 7f0fbcff9700 1 -- 172.21.15.112:0/1407964343 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0003c60 con 0x7f0fc0070e00 2023-09-12T16:08:39.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.866+0000 7f0fc59ff700 1 -- 172.21.15.112:0/1407964343 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc00b1250 con 0x7f0fc0070e00 2023-09-12T16:08:39.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.867+0000 7f0fc59ff700 1 -- 172.21.15.112:0/1407964343 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc00cbc10 con 0x7f0fc0070e00 2023-09-12T16:08:39.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.867+0000 7f0fbcff9700 1 -- 172.21.15.112:0/1407964343 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f0fb000f460 con 0x7f0fc0070e00 2023-09-12T16:08:39.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.868+0000 7f0fbcff9700 1 --2- 172.21.15.112:0/1407964343 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f0fa006a580 0x7f0fa006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:08:39.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.868+0000 7f0fbcff9700 1 -- 172.21.15.112:0/1407964343 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0fb0089fe0 con 0x7f0fc0070e00 2023-09-12T16:08:39.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.869+0000 7f0fb7fff700 1 --2- 172.21.15.112:0/1407964343 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f0fa006a580 0x7f0fa006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:08:39.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.869+0000 7f0fb7fff700 1 --2- 172.21.15.112:0/1407964343 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f0fa006a580 0x7f0fa006ca40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8005950 tx=0x7f0fa80058e0 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:08:39.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:39.873+0000 7f0fbcff9700 1 -- 172.21.15.112:0/1407964343 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f0fb0055470 con 0x7f0fc0070e00 2023-09-12T16:08:40.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:40.117+0000 7f0fc59ff700 1 -- 172.21.15.112:0/1407964343 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0fc004e300 con 0x7f0fc0070e00 2023-09-12T16:08:40.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:40.118+0000 7f0fbcff9700 1 -- 172.21.15.112:0/1407964343 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0fb0058a90 con 0x7f0fc0070e00 2023-09-12T16:08:40.119 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-12T16:08:40.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:40.121+0000 7f0fc59ff700 1 -- 172.21.15.112:0/1407964343 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f0fa006a580 msgr2=0x7f0fa006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:40.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:40.121+0000 7f0fc59ff700 1 --2- 172.21.15.112:0/1407964343 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f0fa006a580 0x7f0fa006ca40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8005950 tx=0x7f0fa80058e0 comp rx=0 tx=0).stop 2023-09-12T16:08:40.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:40.121+0000 7f0fc59ff700 1 -- 172.21.15.112:0/1407964343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fc0070e00 msgr2=0x7f0fc01f6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:08:40.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:40.121+0000 7f0fc59ff700 1 --2- 172.21.15.112:0/1407964343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fc0070e00 0x7f0fc01f6360 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00098e0 tx=0x7f0fb000bee0 comp rx=0 tx=0).stop 2023-09-12T16:08:40.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:40.121+0000 7f0fc59ff700 1 -- 172.21.15.112:0/1407964343 shutdown_connections 2023-09-12T16:08:40.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:40.121+0000 7f0fc59ff700 1 --2- 172.21.15.112:0/1407964343 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f0fa006a580 0x7f0fa006ca40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:40.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:40.121+0000 7f0fc59ff700 1 --2- 172.21.15.112:0/1407964343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fc00b0330 0x7f0fc01f1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:40.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:40.121+0000 7f0fc59ff700 1 --2- 172.21.15.112:0/1407964343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fc0070e00 0x7f0fc01f6360 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:40.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:40.121+0000 7f0fc59ff700 1 --2- 172.21.15.112:0/1407964343 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fc0159af0 0x7f0fc00afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:08:40.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:40.121+0000 7f0fc59ff700 1 -- 172.21.15.112:0/1407964343 >> 172.21.15.112:0/1407964343 conn(0x7f0fc006a650 msgr2=0x7f0fc00ae780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:08:40.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:40.121+0000 7f0fc59ff700 1 -- 172.21.15.112:0/1407964343 shutdown_connections 2023-09-12T16:08:40.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:08:40.121+0000 7f0fc59ff700 1 -- 172.21.15.112:0/1407964343 wait complete. 2023-09-12T16:08:40.139 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-12T16:08:40.140 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-12T16:08:40.140 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-09-12T16:08:40.140 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-12T16:08:40.141 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-12T16:08:40.141 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-12T16:08:40.141 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-12T16:08:40.142 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-12T16:08:40.142 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-12T16:08:40.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:08:40.143 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-09-12T16:08:40.191 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-12T16:08:40.191 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-12T16:08:40.191 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-09-12T16:08:40.191 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:08:40.192 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-09-12T16:08:40.192 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:08:40.192 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-12T16:08:40.192 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-09-12T16:08:40.193 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2023-09-12T16:08:40.193 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-12T16:08:40.193 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-09-12T16:08:40.193 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2023-09-12T16:08:40.193 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-12T16:08:40.193 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-09-12T16:08:40.194 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-12T16:08:40.194 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-09-12T16:08:40.194 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-12T16:08:40.194 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42263sec preferred_lft 42263sec 2023-09-12T16:08:40.195 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2023-09-12T16:08:40.195 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:08:40.195 INFO:teuthology.orchestra.run.smithi112.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-12T16:08:40.195 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 26:eb:76:f0:1d:55 brd ff:ff:ff:ff:ff:ff 2023-09-12T16:08:40.195 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-12T16:08:40.195 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:08:40.196 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::68b2:e9ff:fe06:27c6/64 scope link 2023-09-12T16:08:40.196 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:08:40.196 INFO:teuthology.orchestra.run.smithi112.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-12T16:08:40.196 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 26:eb:76:f0:1d:55 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-12T16:08:40.197 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::24eb:76ff:fef0:1d55/64 scope link 2023-09-12T16:08:40.197 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:08:40.197 INFO:teuthology.orchestra.run.smithi112.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-12T16:08:40.197 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether fe:fc:78:eb:85:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-12T16:08:40.197 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::fcfc:78ff:feeb:85f9/64 scope link 2023-09-12T16:08:40.198 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-09-12T16:08:40.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:08:40.199 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-12T16:08:40.266 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-09-12T16:08:40.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:08:40.269 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-09-12T16:08:40.318 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-09-12T16:08:40.318 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-12T16:08:40.318 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-12T16:08:40.318 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-12T16:08:40.319 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-12T16:08:40.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:08:40.320 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-09-12T16:08:40.321 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-09-12T16:08:40.321 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-12T16:08:40.321 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-12T16:08:40.322 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-12T16:08:40.322 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-09-12T16:08:40.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:08:40.494 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-09-12T16:08:40.541 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-12T16:08:40.541 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-12T16:08:40.542 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-12T16:08:40.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:08:40.542 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2023-09-12T16:08:40.652 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-12T16:08:40.653 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-12T16:08:40.699 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-12T16:08:40.699 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-12T16:08:40.700 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-12T16:08:40.784 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-12T16:08:40.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:08:40.785 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-12T16:08:40.929 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-12T16:08:40.929 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-12T16:08:40.929 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2023-09-12T16:08:40.945 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-12T16:08:40.945 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-12T16:08:40.945 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2023-09-12T16:08:40.946 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-09-12T16:08:40.946 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-12T16:08:40.971 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-12T16:08:40.971 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-12T16:08:40.971 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2023-09-12T16:08:40.971 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-09-12T16:08:40.972 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-12T16:08:40.972 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-09-12T16:08:40.972 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.112:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-09-12T16:08:40.972 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=81d9ebed-ec6c-4564-a5d4-cdbd74c977f8" will pass to kernel 2023-09-12T16:08:40.976 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-12T16:08:40.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:08:40.977 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-12T16:08:41.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:08:41.048 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-12T16:08:41.151 INFO:teuthology.orchestra.run.smithi112.stdout:client5434 2023-09-12T16:08:41.151 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:08:41.152 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T16:08:41.198 DEBUG:teuthology.orchestra.run.smithi112:> mktemp -d --suffix=xfstests-dev 2023-09-12T16:08:41.283 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.X1XCSigEoUxfstests-dev 2023-09-12T16:08:41.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:08:41.284 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.X1XCSigEoUxfstests-dev) 2023-09-12T16:08:41.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:08:41.395 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.X1XCSigEoUxfstests-dev) 2023-09-12T16:08:41.445 INFO:teuthology.orchestra.run.smithi112.stderr:Cloning into '/tmp/tmp.X1XCSigEoUxfstests-dev'... 2023-09-12T16:08:42.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:08:42.297 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-09-12T16:08:42.350 DEBUG:teuthology.orchestra.run.smithi112:> mktemp -d --suffix=test 2023-09-12T16:08:42.397 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.pXerGKKTHMtest 2023-09-12T16:08:42.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:08:42.398 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-09-12T16:08:42.485 DEBUG:teuthology.orchestra.run.smithi112:> mktemp -d --suffix=scratch 2023-09-12T16:08:42.531 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:08:42.531 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "8". 2023-09-12T16:08:42.532 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python3 sqlite xfsprogs-qa-devel 2023-09-12T16:08:43.624 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:04:53 ago on Tue 12 Sep 2023 04:03:50 PM UTC. 2023-09-12T16:08:45.051 INFO:teuthology.orchestra.run.smithi112.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-09-12T16:08:45.052 INFO:teuthology.orchestra.run.smithi112.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-09-12T16:08:45.053 INFO:teuthology.orchestra.run.smithi112.stdout:Package automake-1.16.1-8.el8.noarch is already installed. 2023-09-12T16:08:45.054 INFO:teuthology.orchestra.run.smithi112.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-09-12T16:08:45.055 INFO:teuthology.orchestra.run.smithi112.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-09-12T16:08:45.057 INFO:teuthology.orchestra.run.smithi112.stdout:Package e2fsprogs-1.45.6-5.el8.x86_64 is already installed. 2023-09-12T16:08:45.059 INFO:teuthology.orchestra.run.smithi112.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-09-12T16:08:45.060 INFO:teuthology.orchestra.run.smithi112.stdout:Package gcc-8.5.0-19.el8.x86_64 is already installed. 2023-09-12T16:08:45.063 INFO:teuthology.orchestra.run.smithi112.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-09-12T16:08:45.064 INFO:teuthology.orchestra.run.smithi112.stdout:Package lvm2-8:2.03.14-9.el8.x86_64 is already installed. 2023-09-12T16:08:45.065 INFO:teuthology.orchestra.run.smithi112.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-09-12T16:08:45.066 INFO:teuthology.orchestra.run.smithi112.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-09-12T16:08:45.067 INFO:teuthology.orchestra.run.smithi112.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-09-12T16:08:45.068 INFO:teuthology.orchestra.run.smithi112.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-09-12T16:08:45.069 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsdump-3.1.8-6.el8.x86_64 is already installed. 2023-09-12T16:08:45.070 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsprogs-5.0.0-12.el8.x86_64 is already installed. 2023-09-12T16:08:45.071 INFO:teuthology.orchestra.run.smithi112.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-12T16:08:45.072 INFO:teuthology.orchestra.run.smithi112.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-12T16:08:45.074 INFO:teuthology.orchestra.run.smithi112.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-09-12T16:08:45.075 INFO:teuthology.orchestra.run.smithi112.stdout:Package libuuid-devel-2.32.1-43.el8.x86_64 is already installed. 2023-09-12T16:08:45.076 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsprogs-devel-5.0.0-12.el8.x86_64 is already installed. 2023-09-12T16:08:45.080 INFO:teuthology.orchestra.run.smithi112.stdout:Package python36-3.6.8-38.module_el8.5.0+895+a459eca8.x86_64 is already installed. 2023-09-12T16:08:45.081 INFO:teuthology.orchestra.run.smithi112.stdout:Package sqlite-3.26.0-17.el8.x86_64 is already installed. 2023-09-12T16:08:45.086 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsprogs-5.0.0-12.el8.x86_64 is already installed. 2023-09-12T16:08:45.282 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2023-09-12T16:08:45.284 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2023-09-12T16:08:45.284 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2023-09-12T16:08:45.284 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2023-09-12T16:08:45.285 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2023-09-12T16:08:45.285 INFO:teuthology.orchestra.run.smithi112.stdout: dump x86_64 1:0.4-0.36.b46.el8 baseos 164 k 2023-09-12T16:08:45.285 INFO:teuthology.orchestra.run.smithi112.stdout: fio x86_64 3.19-4.el8 appstream 538 k 2023-09-12T16:08:45.285 INFO:teuthology.orchestra.run.smithi112.stdout: indent x86_64 2.2.13-4.el8 epel 187 k 2023-09-12T16:08:45.285 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrading: 2023-09-12T16:08:45.286 INFO:teuthology.orchestra.run.smithi112.stdout: cpp x86_64 8.5.0-20.el8 baseos 10 M 2023-09-12T16:08:45.286 INFO:teuthology.orchestra.run.smithi112.stdout: gcc x86_64 8.5.0-20.el8 baseos 24 M 2023-09-12T16:08:45.286 INFO:teuthology.orchestra.run.smithi112.stdout: gcc-gdb-plugin x86_64 8.5.0-20.el8 appstream 121 k 2023-09-12T16:08:45.286 INFO:teuthology.orchestra.run.smithi112.stdout: gcc-plugin-annobin x86_64 8.5.0-20.el8 baseos 36 k 2023-09-12T16:08:45.286 INFO:teuthology.orchestra.run.smithi112.stdout: libgcc x86_64 8.5.0-20.el8 baseos 81 k 2023-09-12T16:08:45.287 INFO:teuthology.orchestra.run.smithi112.stdout: libgomp x86_64 8.5.0-20.el8 baseos 208 k 2023-09-12T16:08:45.287 INFO:teuthology.orchestra.run.smithi112.stdout: sqlite x86_64 3.26.0-18.el8 baseos 668 k 2023-09-12T16:08:45.287 INFO:teuthology.orchestra.run.smithi112.stdout: sqlite-libs x86_64 3.26.0-18.el8 baseos 581 k 2023-09-12T16:08:45.287 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2023-09-12T16:08:45.287 INFO:teuthology.orchestra.run.smithi112.stdout: daxctl-libs x86_64 71.1-7.el8 baseos 42 k 2023-09-12T16:08:45.288 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemblk x86_64 1.6.1-1.el8 appstream 92 k 2023-09-12T16:08:45.288 INFO:teuthology.orchestra.run.smithi112.stdout: ndctl-libs x86_64 71.1-7.el8 baseos 80 k 2023-09-12T16:08:45.288 INFO:teuthology.orchestra.run.smithi112.stdout: rmt x86_64 2:1.5.3-13.el8 baseos 51 k 2023-09-12T16:08:45.288 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:45.288 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2023-09-12T16:08:45.289 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2023-09-12T16:08:45.289 INFO:teuthology.orchestra.run.smithi112.stdout:Install 7 Packages 2023-09-12T16:08:45.289 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrade 8 Packages 2023-09-12T16:08:45.289 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:08:45.290 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 37 M 2023-09-12T16:08:45.290 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2023-09-12T16:08:45.837 INFO:teuthology.orchestra.run.smithi112.stdout:(1/15): libpmemblk-1.6.1-1.el8.x86_64.rpm 834 kB/s | 92 kB 00:00 2023-09-12T16:08:45.879 INFO:teuthology.orchestra.run.smithi112.stdout:(2/15): daxctl-libs-71.1-7.el8.x86_64.rpm 279 kB/s | 42 kB 00:00 2023-09-12T16:08:45.904 INFO:teuthology.orchestra.run.smithi112.stdout:(3/15): fio-3.19-4.el8.x86_64.rpm 3.0 MB/s | 538 kB 00:00 2023-09-12T16:08:45.963 INFO:teuthology.orchestra.run.smithi112.stdout:(4/15): ndctl-libs-71.1-7.el8.x86_64.rpm 959 kB/s | 80 kB 00:00 2023-09-12T16:08:46.055 INFO:teuthology.orchestra.run.smithi112.stdout:(5/15): dump-0.4-0.36.b46.el8.x86_64.rpm 757 kB/s | 164 kB 00:00 2023-09-12T16:08:46.088 INFO:teuthology.orchestra.run.smithi112.stdout:(6/15): rmt-1.5.3-13.el8.x86_64.rpm 279 kB/s | 51 kB 00:00 2023-09-12T16:08:46.113 INFO:teuthology.orchestra.run.smithi112.stdout:(7/15): gcc-gdb-plugin-8.5.0-20.el8.x86_64.rpm 2.2 MB/s | 121 kB 00:00 2023-09-12T16:08:46.731 INFO:teuthology.orchestra.run.smithi112.stdout:(8/15): indent-2.2.13-4.el8.x86_64.rpm 243 kB/s | 187 kB 00:00 2023-09-12T16:08:46.873 INFO:teuthology.orchestra.run.smithi112.stdout:(9/15): gcc-plugin-annobin-8.5.0-20.el8.x86_64. 253 kB/s | 36 kB 00:00 2023-09-12T16:08:47.073 INFO:teuthology.orchestra.run.smithi112.stdout:(10/15): libgcc-8.5.0-20.el8.x86_64.rpm 407 kB/s | 81 kB 00:00 2023-09-12T16:08:47.332 INFO:teuthology.orchestra.run.smithi112.stdout:(11/15): cpp-8.5.0-20.el8.x86_64.rpm 8.4 MB/s | 10 MB 00:01 2023-09-12T16:08:47.432 INFO:teuthology.orchestra.run.smithi112.stdout:(12/15): libgomp-8.5.0-20.el8.x86_64.rpm 580 kB/s | 208 kB 00:00 2023-09-12T16:08:47.482 INFO:teuthology.orchestra.run.smithi112.stdout:(13/15): sqlite-3.26.0-18.el8.x86_64.rpm 4.4 MB/s | 668 kB 00:00 2023-09-12T16:08:48.074 INFO:teuthology.orchestra.run.smithi112.stdout:(14/15): sqlite-libs-3.26.0-18.el8.x86_64.rpm 906 kB/s | 581 kB 00:00 2023-09-12T16:08:48.308 INFO:teuthology.orchestra.run.smithi112.stdout:(15/15): gcc-8.5.0-20.el8.x86_64.rpm 11 MB/s | 24 MB 00:02 2023-09-12T16:08:48.308 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2023-09-12T16:08:48.309 INFO:teuthology.orchestra.run.smithi112.stdout:Total 12 MB/s | 37 MB 00:03 2023-09-12T16:08:48.812 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2023-09-12T16:08:48.917 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2023-09-12T16:08:48.917 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2023-09-12T16:08:49.305 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2023-09-12T16:08:49.308 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2023-09-12T16:08:50.182 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2023-09-12T16:08:50.314 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : libgcc-8.5.0-20.el8.x86_64 1/23 2023-09-12T16:08:50.393 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libgcc-8.5.0-20.el8.x86_64 1/23 2023-09-12T16:08:50.556 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : daxctl-libs-71.1-7.el8.x86_64 2/23 2023-09-12T16:08:50.669 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: daxctl-libs-71.1-7.el8.x86_64 2/23 2023-09-12T16:08:50.839 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ndctl-libs-71.1-7.el8.x86_64 3/23 2023-09-12T16:08:50.916 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ndctl-libs-71.1-7.el8.x86_64 3/23 2023-09-12T16:08:51.055 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 4/23 2023-09-12T16:08:51.166 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 4/23 2023-09-12T16:08:51.362 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : sqlite-libs-3.26.0-18.el8.x86_64 5/23 2023-09-12T16:08:51.530 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : libgomp-8.5.0-20.el8.x86_64 6/23 2023-09-12T16:08:52.558 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libgomp-8.5.0-20.el8.x86_64 6/23 2023-09-12T16:08:52.847 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : cpp-8.5.0-20.el8.x86_64 7/23 2023-09-12T16:08:53.983 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:08:53.988 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:08:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cpp-8.5.0-20.el8.x86_64 7/23 2023-09-12T16:08:55.263 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : gcc-8.5.0-20.el8.x86_64 8/23 2023-09-12T16:08:55.375 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: gcc-8.5.0-20.el8.x86_64 8/23 2023-09-12T16:08:55.568 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 9/23 2023-09-12T16:08:55.746 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 10/23 2023-09-12T16:08:55.913 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : gcc-gdb-plugin-8.5.0-20.el8.x86_64 11/23 2023-09-12T16:08:55.994 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: gcc-gdb-plugin-8.5.0-20.el8.x86_64 11/23 2023-09-12T16:08:56.147 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : gcc-plugin-annobin-8.5.0-20.el8.x86_64 12/23 2023-09-12T16:08:56.238 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: gcc-plugin-annobin-8.5.0-20.el8.x86_64 12/23 2023-09-12T16:08:56.505 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : sqlite-3.26.0-18.el8.x86_64 13/23 2023-09-12T16:08:56.768 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fio-3.19-4.el8.x86_64 14/23 2023-09-12T16:08:56.965 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : indent-2.2.13-4.el8.x86_64 15/23 2023-09-12T16:08:56.965 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : gcc-gdb-plugin-8.5.0-19.el8.x86_64 16/23 2023-09-12T16:08:57.190 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: gcc-gdb-plugin-8.5.0-19.el8.x86_64 16/23 2023-09-12T16:08:57.190 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : gcc-plugin-annobin-8.5.0-19.el8.x86_64 17/23 2023-09-12T16:08:57.364 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: gcc-plugin-annobin-8.5.0-19.el8.x86_64 17/23 2023-09-12T16:08:57.386 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: gcc-8.5.0-19.el8.x86_64 18/23 2023-09-12T16:08:57.614 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : gcc-8.5.0-19.el8.x86_64 18/23 2023-09-12T16:08:57.764 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : sqlite-3.26.0-17.el8.x86_64 19/23 2023-09-12T16:08:57.946 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : sqlite-libs-3.26.0-17.el8.x86_64 20/23 2023-09-12T16:08:57.962 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cpp-8.5.0-19.el8.x86_64 21/23 2023-09-12T16:08:58.114 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : cpp-8.5.0-19.el8.x86_64 21/23 2023-09-12T16:08:58.115 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : libgcc-8.5.0-19.el8.x86_64 22/23 2023-09-12T16:08:58.289 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libgcc-8.5.0-19.el8.x86_64 22/23 2023-09-12T16:08:58.304 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libgomp-8.5.0-19.el8.x86_64 23/23 2023-09-12T16:08:58.305 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : libgomp-8.5.0-19.el8.x86_64 23/23 2023-09-12T16:08:59.118 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libgomp-8.5.0-19.el8.x86_64 23/23 2023-09-12T16:08:59.119 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fio-3.19-4.el8.x86_64 1/23 2023-09-12T16:08:59.119 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 2/23 2023-09-12T16:08:59.119 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : daxctl-libs-71.1-7.el8.x86_64 3/23 2023-09-12T16:08:59.119 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 4/23 2023-09-12T16:08:59.120 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ndctl-libs-71.1-7.el8.x86_64 5/23 2023-09-12T16:08:59.120 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 6/23 2023-09-12T16:08:59.120 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : indent-2.2.13-4.el8.x86_64 7/23 2023-09-12T16:08:59.120 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gcc-gdb-plugin-8.5.0-20.el8.x86_64 8/23 2023-09-12T16:08:59.120 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gcc-gdb-plugin-8.5.0-19.el8.x86_64 9/23 2023-09-12T16:08:59.120 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cpp-8.5.0-20.el8.x86_64 10/23 2023-09-12T16:08:59.121 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cpp-8.5.0-19.el8.x86_64 11/23 2023-09-12T16:08:59.121 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gcc-8.5.0-20.el8.x86_64 12/23 2023-09-12T16:08:59.121 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gcc-8.5.0-19.el8.x86_64 13/23 2023-09-12T16:08:59.121 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gcc-plugin-annobin-8.5.0-20.el8.x86_64 14/23 2023-09-12T16:08:59.121 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gcc-plugin-annobin-8.5.0-19.el8.x86_64 15/23 2023-09-12T16:08:59.122 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgcc-8.5.0-20.el8.x86_64 16/23 2023-09-12T16:08:59.122 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgcc-8.5.0-19.el8.x86_64 17/23 2023-09-12T16:08:59.122 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgomp-8.5.0-20.el8.x86_64 18/23 2023-09-12T16:08:59.122 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgomp-8.5.0-19.el8.x86_64 19/23 2023-09-12T16:08:59.122 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : sqlite-3.26.0-18.el8.x86_64 20/23 2023-09-12T16:08:59.123 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : sqlite-3.26.0-17.el8.x86_64 21/23 2023-09-12T16:08:59.123 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : sqlite-libs-3.26.0-18.el8.x86_64 22/23 2023-09-12T16:09:00.052 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : sqlite-libs-3.26.0-17.el8.x86_64 23/23 2023-09-12T16:09:00.053 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:09:00.053 INFO:teuthology.orchestra.run.smithi112.stdout:Upgraded: 2023-09-12T16:09:00.053 INFO:teuthology.orchestra.run.smithi112.stdout: cpp-8.5.0-20.el8.x86_64 gcc-8.5.0-20.el8.x86_64 2023-09-12T16:09:00.053 INFO:teuthology.orchestra.run.smithi112.stdout: gcc-gdb-plugin-8.5.0-20.el8.x86_64 gcc-plugin-annobin-8.5.0-20.el8.x86_64 2023-09-12T16:09:00.053 INFO:teuthology.orchestra.run.smithi112.stdout: libgcc-8.5.0-20.el8.x86_64 libgomp-8.5.0-20.el8.x86_64 2023-09-12T16:09:00.054 INFO:teuthology.orchestra.run.smithi112.stdout: sqlite-3.26.0-18.el8.x86_64 sqlite-libs-3.26.0-18.el8.x86_64 2023-09-12T16:09:00.054 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2023-09-12T16:09:00.054 INFO:teuthology.orchestra.run.smithi112.stdout: daxctl-libs-71.1-7.el8.x86_64 dump-1:0.4-0.36.b46.el8.x86_64 2023-09-12T16:09:00.054 INFO:teuthology.orchestra.run.smithi112.stdout: fio-3.19-4.el8.x86_64 indent-2.2.13-4.el8.x86_64 2023-09-12T16:09:00.054 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemblk-1.6.1-1.el8.x86_64 ndctl-libs-71.1-7.el8.x86_64 2023-09-12T16:09:00.055 INFO:teuthology.orchestra.run.smithi112.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-09-12T16:09:00.055 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:09:00.055 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2023-09-12T16:09:00.232 DEBUG:teuthology.orchestra.run.smithi112:> sudo useradd -m fsgqa 2023-09-12T16:09:00.305 INFO:teuthology.orchestra.run.smithi112.stderr:useradd: user 'fsgqa' already exists 2023-09-12T16:09:00.308 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-09-12T16:09:00.309 DEBUG:teuthology.orchestra.run.smithi112:> sudo groupadd fsgqa 2023-09-12T16:09:00.377 INFO:teuthology.orchestra.run.smithi112.stderr:groupadd: group 'fsgqa' already exists 2023-09-12T16:09:00.379 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-09-12T16:09:00.380 DEBUG:teuthology.orchestra.run.smithi112:> sudo useradd fsgqa2 2023-09-12T16:09:01.305 DEBUG:teuthology.orchestra.run.smithi112:> sudo useradd 123456-fsgqa 2023-09-12T16:09:02.155 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-09-12T16:09:02.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.353+0000 7fba363ff700 1 -- 172.21.15.112:0/3929034387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba18004850 msgr2=0x7fba18004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:09:02.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.353+0000 7fba363ff700 1 --2- 172.21.15.112:0/3929034387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba18004850 0x7fba18004cd0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fba2400c340 tx=0x7fba18005880 comp rx=0 tx=0).stop 2023-09-12T16:09:02.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.353+0000 7fba3499c700 1 -- 172.21.15.112:0/3929034387 reap_dead start 2023-09-12T16:09:02.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.353+0000 7fba363ff700 1 -- 172.21.15.112:0/3929034387 shutdown_connections 2023-09-12T16:09:02.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.353+0000 7fba363ff700 1 -- 172.21.15.112:0/3929034387 >> 172.21.15.112:0/3929034387 conn(0x7fba3006a650 msgr2=0x7fba3006c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:09:02.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.353+0000 7fba363ff700 1 -- 172.21.15.112:0/3929034387 shutdown_connections 2023-09-12T16:09:02.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.353+0000 7fba363ff700 1 -- 172.21.15.112:0/3929034387 wait complete. 2023-09-12T16:09:02.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.355+0000 7fba363ff700 1 Processor -- start 2023-09-12T16:09:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.355+0000 7fba363ff700 1 -- start start 2023-09-12T16:09:02.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.356+0000 7fba363ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba18004850 0x7fba30149880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:09:02.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.356+0000 7fba363ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba300a6990 0x7fba301f5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:09:02.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.356+0000 7fba363ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba300ae0d0 0x7fba300ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:09:02.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.356+0000 7fba363ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3014a3f0 con 0x7fba18004850 2023-09-12T16:09:02.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.356+0000 7fba363ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba300aea90 con 0x7fba300a6990 2023-09-12T16:09:02.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.356+0000 7fba363ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba301f60c0 con 0x7fba300ae0d0 2023-09-12T16:09:02.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.356+0000 7fba2ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba18004850 0x7fba30149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:09:02.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.356+0000 7fba2ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba18004850 0x7fba30149880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45494/0 (socket says 172.21.15.112:45494) 2023-09-12T16:09:02.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.356+0000 7fba2ffff700 1 -- 172.21.15.112:0/3468750066 learned_addr learned my addr 172.21.15.112:0/3468750066 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:09:02.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.357+0000 7fba3499c700 1 --2- 172.21.15.112:0/3468750066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba300ae0d0 0x7fba300ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:09:02.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.357+0000 7fba2f7fe700 1 --2- 172.21.15.112:0/3468750066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba300a6990 0x7fba301f5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:09:02.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.357+0000 7fba2ffff700 1 -- 172.21.15.112:0/3468750066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba300ae0d0 msgr2=0x7fba300ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:09:02.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.357+0000 7fba2ffff700 1 --2- 172.21.15.112:0/3468750066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba300ae0d0 0x7fba300ae550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:09:02.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.357+0000 7fba2ffff700 1 -- 172.21.15.112:0/3468750066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba300a6990 msgr2=0x7fba301f5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:09:02.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.357+0000 7fba2ffff700 1 --2- 172.21.15.112:0/3468750066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba300a6990 0x7fba301f5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:09:02.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.357+0000 7fba2ffff700 1 -- 172.21.15.112:0/3468750066 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba301f5b00 con 0x7fba18004850 2023-09-12T16:09:02.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.357+0000 7fba2f7fe700 1 --2- 172.21.15.112:0/3468750066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba300a6990 0x7fba301f5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T16:09:02.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.357+0000 7fba2ffff700 1 --2- 172.21.15.112:0/3468750066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba18004850 0x7fba30149880 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fba2000fa00 tx=0x7fba2000fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:09:02.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.357+0000 7fba2cff9700 1 -- 172.21.15.112:0/3468750066 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2000bb60 con 0x7fba18004850 2023-09-12T16:09:02.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.357+0000 7fba2cff9700 1 -- 172.21.15.112:0/3468750066 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fba2000bdb0 con 0x7fba18004850 2023-09-12T16:09:02.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.357+0000 7fba363ff700 1 -- 172.21.15.112:0/3468750066 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba301f5de0 con 0x7fba18004850 2023-09-12T16:09:02.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.357+0000 7fba2cff9700 1 -- 172.21.15.112:0/3468750066 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba20004280 con 0x7fba18004850 2023-09-12T16:09:02.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.357+0000 7fba363ff700 1 -- 172.21.15.112:0/3468750066 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3015a620 con 0x7fba18004850 2023-09-12T16:09:02.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.358+0000 7fba363ff700 1 -- 172.21.15.112:0/3468750066 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba3004e300 con 0x7fba18004850 2023-09-12T16:09:02.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.359+0000 7fba2cff9700 1 -- 172.21.15.112:0/3468750066 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fba200043e0 con 0x7fba18004850 2023-09-12T16:09:02.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.360+0000 7fba2cff9700 1 --2- 172.21.15.112:0/3468750066 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fba1c06a580 0x7fba1c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:09:02.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.360+0000 7fba2cff9700 1 -- 172.21.15.112:0/3468750066 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fba200895f0 con 0x7fba18004850 2023-09-12T16:09:02.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.360+0000 7fba2f7fe700 1 --2- 172.21.15.112:0/3468750066 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fba1c06a580 0x7fba1c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:09:02.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.361+0000 7fba2f7fe700 1 --2- 172.21.15.112:0/3468750066 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fba1c06a580 0x7fba1c06ca40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fba300aef50 tx=0x7fba24001a70 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:09:02.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.365+0000 7fba2cff9700 1 -- 172.21.15.112:0/3468750066 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fba20054a10 con 0x7fba18004850 2023-09-12T16:09:02.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.642+0000 7fba363ff700 1 -- 172.21.15.112:0/3468750066 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fba300cd460 con 0x7fba18004850 2023-09-12T16:09:02.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.643+0000 7fba2cff9700 1 -- 172.21.15.112:0/3468750066 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1280 (secure 0 0 0) 0x7fba20058030 con 0x7fba18004850 2023-09-12T16:09:02.643 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:09:02.643 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","modified":"2023-09-12T16:05:55.251013Z","created":"2023-09-12T16:05:55.251013Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:3300","nonce":0},{"type":"v1","addr":"172.21.15.144:6789","nonce":0}]},"addr":"172.21.15.144:6789/0","public_addr":"172.21.15.144:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:3301","nonce":0},{"type":"v1","addr":"172.21.15.144:6790","nonce":0}]},"addr":"172.21.15.144:6790/0","public_addr":"172.21.15.144:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-09-12T16:09:02.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.645+0000 7fba363ff700 1 -- 172.21.15.112:0/3468750066 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fba1c06a580 msgr2=0x7fba1c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:09:02.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.645+0000 7fba363ff700 1 --2- 172.21.15.112:0/3468750066 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fba1c06a580 0x7fba1c06ca40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fba300aef50 tx=0x7fba24001a70 comp rx=0 tx=0).stop 2023-09-12T16:09:02.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.645+0000 7fba363ff700 1 -- 172.21.15.112:0/3468750066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba18004850 msgr2=0x7fba30149880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:09:02.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.645+0000 7fba363ff700 1 --2- 172.21.15.112:0/3468750066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba18004850 0x7fba30149880 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fba2000fa00 tx=0x7fba2000fd10 comp rx=0 tx=0).stop 2023-09-12T16:09:02.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.645+0000 7fba363ff700 1 -- 172.21.15.112:0/3468750066 shutdown_connections 2023-09-12T16:09:02.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.645+0000 7fba363ff700 1 --2- 172.21.15.112:0/3468750066 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fba1c06a580 0x7fba1c06ca40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:09:02.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.645+0000 7fba363ff700 1 --2- 172.21.15.112:0/3468750066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba300ae0d0 0x7fba300ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:09:02.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.645+0000 7fba363ff700 1 --2- 172.21.15.112:0/3468750066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba18004850 0x7fba30149880 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:09:02.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.645+0000 7fba363ff700 1 --2- 172.21.15.112:0/3468750066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba300a6990 0x7fba301f5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:09:02.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.645+0000 7fba363ff700 1 -- 172.21.15.112:0/3468750066 >> 172.21.15.112:0/3468750066 conn(0x7fba3006a650 msgr2=0x7fba30071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:09:02.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.645+0000 7fba363ff700 1 -- 172.21.15.112:0/3468750066 shutdown_connections 2023-09-12T16:09:02.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.645+0000 7fba363ff700 1 -- 172.21.15.112:0/3468750066 wait complete. 2023-09-12T16:09:02.648 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2023-09-12T16:09:02.664 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-09-12T16:09:02.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.864+0000 7f45499ff700 1 -- 172.21.15.112:0/151922419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f452c004850 msgr2=0x7f452c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:09:02.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.864+0000 7f45499ff700 1 --2- 172.21.15.112:0/151922419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f452c004850 0x7f452c004cd0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4538006fd0 tx=0x7f452c005880 comp rx=0 tx=0).stop 2023-09-12T16:09:02.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.864+0000 7f45437fe700 1 -- 172.21.15.112:0/151922419 reap_dead start 2023-09-12T16:09:02.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.864+0000 7f45499ff700 1 -- 172.21.15.112:0/151922419 shutdown_connections 2023-09-12T16:09:02.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.864+0000 7f45499ff700 1 -- 172.21.15.112:0/151922419 >> 172.21.15.112:0/151922419 conn(0x7f45440d1930 msgr2=0x7f45440d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:09:02.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.864+0000 7f45499ff700 1 -- 172.21.15.112:0/151922419 shutdown_connections 2023-09-12T16:09:02.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.864+0000 7f45499ff700 1 -- 172.21.15.112:0/151922419 wait complete. 2023-09-12T16:09:02.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.866+0000 7f45499ff700 1 Processor -- start 2023-09-12T16:09:02.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.866+0000 7f45499ff700 1 -- start start 2023-09-12T16:09:02.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.867+0000 7f45499ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f452c004850 0x7f4544151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:09:02.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.867+0000 7f45499ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45441e7180 0x7f45440b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:09:02.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.867+0000 7f45499ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45440b5310 0x7f45441f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:09:02.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.867+0000 7f45499ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45440b4e80 con 0x7f452c004850 2023-09-12T16:09:02.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.867+0000 7f45499ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45440b7190 con 0x7f45441e7180 2023-09-12T16:09:02.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.867+0000 7f45499ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45440b4550 con 0x7f45440b5310 2023-09-12T16:09:02.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.867+0000 7f4542ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f452c004850 0x7f4544151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:09:02.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.868+0000 7f4542ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f452c004850 0x7f4544151aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45522/0 (socket says 172.21.15.112:45522) 2023-09-12T16:09:02.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.868+0000 7f4542ffd700 1 -- 172.21.15.112:0/1291794136 learned_addr learned my addr 172.21.15.112:0/1291794136 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T16:09:02.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.868+0000 7f45427fc700 1 --2- 172.21.15.112:0/1291794136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45441e7180 0x7f45440b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:09:02.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.868+0000 7f45437fe700 1 --2- 172.21.15.112:0/1291794136 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45440b5310 0x7f45441f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:09:02.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.868+0000 7f4542ffd700 1 -- 172.21.15.112:0/1291794136 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45440b5310 msgr2=0x7f45441f2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:09:02.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.868+0000 7f4542ffd700 1 --2- 172.21.15.112:0/1291794136 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45440b5310 0x7f45441f2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:09:02.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.868+0000 7f4542ffd700 1 -- 172.21.15.112:0/1291794136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45441e7180 msgr2=0x7f45440b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:09:02.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.868+0000 7f4542ffd700 1 --2- 172.21.15.112:0/1291794136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45441e7180 0x7f45440b68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:09:02.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.868+0000 7f4542ffd700 1 -- 172.21.15.112:0/1291794136 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45440b2ba0 con 0x7f452c004850 2023-09-12T16:09:02.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.868+0000 7f4542ffd700 1 --2- 172.21.15.112:0/1291794136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f452c004850 0x7f4544151aa0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4534006630 tx=0x7f4534006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:09:02.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.868+0000 7f452bfff700 1 -- 172.21.15.112:0/1291794136 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4534011840 con 0x7f452c004850 2023-09-12T16:09:02.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.869+0000 7f452bfff700 1 -- 172.21.15.112:0/1291794136 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f45340119a0 con 0x7f452c004850 2023-09-12T16:09:02.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.869+0000 7f452bfff700 1 -- 172.21.15.112:0/1291794136 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4534011df0 con 0x7f452c004850 2023-09-12T16:09:02.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.869+0000 7f45499ff700 1 -- 172.21.15.112:0/1291794136 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45440b4830 con 0x7f452c004850 2023-09-12T16:09:02.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.869+0000 7f45499ff700 1 -- 172.21.15.112:0/1291794136 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4544151fe0 con 0x7f452c004850 2023-09-12T16:09:02.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.870+0000 7f45499ff700 1 -- 172.21.15.112:0/1291794136 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454404e300 con 0x7f452c004850 2023-09-12T16:09:02.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.871+0000 7f452bfff700 1 -- 172.21.15.112:0/1291794136 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f45340103c0 con 0x7f452c004850 2023-09-12T16:09:02.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.872+0000 7f452bfff700 1 --2- 172.21.15.112:0/1291794136 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f453006a580 0x7f453006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T16:09:02.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.872+0000 7f452bfff700 1 -- 172.21.15.112:0/1291794136 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4534089b10 con 0x7f452c004850 2023-09-12T16:09:02.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.872+0000 7f45427fc700 1 --2- 172.21.15.112:0/1291794136 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f453006a580 0x7f453006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T16:09:02.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.873+0000 7f45427fc700 1 --2- 172.21.15.112:0/1291794136 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f453006a580 0x7f453006ca40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4544089110 tx=0x7f4538001190 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T16:09:02.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:02.877+0000 7f452bfff700 1 -- 172.21.15.112:0/1291794136 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f4534054e90 con 0x7f452c004850 2023-09-12T16:09:03.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:03.153+0000 7f45499ff700 1 -- 172.21.15.112:0/1291794136 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f45440cbf90 con 0x7f452c004850 2023-09-12T16:09:03.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:03.153+0000 7f452bfff700 1 -- 172.21.15.112:0/1291794136 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v9) v1 ==== 92+0+63 (secure 0 0 0) 0x7f4534015070 con 0x7f452c004850 2023-09-12T16:09:03.154 INFO:teuthology.orchestra.run.smithi112.stdout:[client.admin] 2023-09-12T16:09:03.154 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== 2023-09-12T16:09:03.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:03.155+0000 7f45499ff700 1 -- 172.21.15.112:0/1291794136 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f453006a580 msgr2=0x7f453006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:09:03.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:03.155+0000 7f45499ff700 1 --2- 172.21.15.112:0/1291794136 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f453006a580 0x7f453006ca40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4544089110 tx=0x7f4538001190 comp rx=0 tx=0).stop 2023-09-12T16:09:03.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:03.155+0000 7f45499ff700 1 -- 172.21.15.112:0/1291794136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f452c004850 msgr2=0x7f4544151aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T16:09:03.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:03.155+0000 7f45499ff700 1 --2- 172.21.15.112:0/1291794136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f452c004850 0x7f4544151aa0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4534006630 tx=0x7f4534006660 comp rx=0 tx=0).stop 2023-09-12T16:09:03.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:03.156+0000 7f45499ff700 1 -- 172.21.15.112:0/1291794136 shutdown_connections 2023-09-12T16:09:03.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:03.156+0000 7f45499ff700 1 --2- 172.21.15.112:0/1291794136 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f453006a580 0x7f453006ca40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:09:03.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:03.156+0000 7f45499ff700 1 --2- 172.21.15.112:0/1291794136 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45440b5310 0x7f45441f2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:09:03.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:03.156+0000 7f45499ff700 1 --2- 172.21.15.112:0/1291794136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f452c004850 0x7f4544151aa0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:09:03.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:03.156+0000 7f45499ff700 1 --2- 172.21.15.112:0/1291794136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45441e7180 0x7f45440b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T16:09:03.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:03.156+0000 7f45499ff700 1 -- 172.21.15.112:0/1291794136 >> 172.21.15.112:0/1291794136 conn(0x7f45440d1930 msgr2=0x7f4544153ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T16:09:03.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:03.156+0000 7f45499ff700 1 -- 172.21.15.112:0/1291794136 shutdown_connections 2023-09-12T16:09:03.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T16:09:03.156+0000 7f45499ff700 1 -- 172.21.15.112:0/1291794136 wait complete. 2023-09-12T16:09:03.174 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:09:03.175 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/tmp/tmp.X1XCSigEoUxfstests-dev/local.config 2023-09-12T16:09:03.244 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.112:6789:/test export TEST_DIR=/tmp/tmp.pXerGKKTHMtest export SCRATCH_DEV=172.21.15.112:6789:/scratch export SCRATCH_MNT=/tmp/tmp.IcsVAEpwo7scratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg==" 2023-09-12T16:09:03.245 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T16:09:03.245 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/tmp/tmp.X1XCSigEoUxfstests-dev/ceph.exclude 2023-09-12T16:09:03.354 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo make) 2023-09-12T16:09:03.493 INFO:teuthology.orchestra.run.smithi112.stdout:libtoolize -cfi 2023-09-12T16:09:03.981 INFO:teuthology.orchestra.run.smithi112.stdout:libtoolize: putting auxiliary files in '.'. 2023-09-12T16:09:03.981 INFO:teuthology.orchestra.run.smithi112.stdout:libtoolize: copying file './config.guess' 2023-09-12T16:09:03.991 INFO:teuthology.orchestra.run.smithi112.stdout:libtoolize: copying file './config.sub' 2023-09-12T16:09:04.001 INFO:teuthology.orchestra.run.smithi112.stdout:libtoolize: copying file './install-sh' 2023-09-12T16:09:04.012 INFO:teuthology.orchestra.run.smithi112.stdout:libtoolize: copying file './ltmain.sh' 2023-09-12T16:09:04.074 INFO:teuthology.orchestra.run.smithi112.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-09-12T16:09:04.074 INFO:teuthology.orchestra.run.smithi112.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-09-12T16:09:04.086 INFO:teuthology.orchestra.run.smithi112.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-09-12T16:09:04.100 INFO:teuthology.orchestra.run.smithi112.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-09-12T16:09:04.113 INFO:teuthology.orchestra.run.smithi112.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-09-12T16:09:04.126 INFO:teuthology.orchestra.run.smithi112.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-09-12T16:09:04.142 INFO:teuthology.orchestra.run.smithi112.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-09-12T16:09:04.146 INFO:teuthology.orchestra.run.smithi112.stdout:cp include/install-sh . 2023-09-12T16:09:04.148 INFO:teuthology.orchestra.run.smithi112.stdout:aclocal -I m4 2023-09-12T16:09:05.394 INFO:teuthology.orchestra.run.smithi112.stdout:autoheader 2023-09-12T16:09:05.760 INFO:teuthology.orchestra.run.smithi112.stdout:autoconf 2023-09-12T16:09:05.967 INFO:teuthology.orchestra.run.smithi112.stdout:./configure \ 2023-09-12T16:09:05.968 INFO:teuthology.orchestra.run.smithi112.stdout: --libexecdir=/usr/lib \ 2023-09-12T16:09:05.968 INFO:teuthology.orchestra.run.smithi112.stdout: --exec_prefix=/var/lib 2023-09-12T16:09:06.339 INFO:teuthology.orchestra.run.smithi112.stdout:checking build system type... x86_64-pc-linux-gnu 2023-09-12T16:09:06.339 INFO:teuthology.orchestra.run.smithi112.stdout:checking host system type... x86_64-pc-linux-gnu 2023-09-12T16:09:06.342 INFO:teuthology.orchestra.run.smithi112.stdout:checking how to print strings... printf 2023-09-12T16:09:06.343 INFO:teuthology.orchestra.run.smithi112.stdout:checking for gcc... gcc 2023-09-12T16:09:06.481 INFO:teuthology.orchestra.run.smithi112.stdout:checking whether the C compiler works... yes 2023-09-12T16:09:06.482 INFO:teuthology.orchestra.run.smithi112.stdout:checking for C compiler default output file name... a.out 2023-09-12T16:09:06.532 INFO:teuthology.orchestra.run.smithi112.stdout:checking for suffix of executables... 2023-09-12T16:09:06.603 INFO:teuthology.orchestra.run.smithi112.stdout:checking whether we are cross compiling... no 2023-09-12T16:09:06.641 INFO:teuthology.orchestra.run.smithi112.stdout:checking for suffix of object files... o 2023-09-12T16:09:06.674 INFO:teuthology.orchestra.run.smithi112.stdout:checking whether we are using the GNU C compiler... yes 2023-09-12T16:09:06.708 INFO:teuthology.orchestra.run.smithi112.stdout:checking whether gcc accepts -g... yes 2023-09-12T16:09:06.756 INFO:teuthology.orchestra.run.smithi112.stdout:checking for gcc option to accept ISO C89... none needed 2023-09-12T16:09:06.764 INFO:teuthology.orchestra.run.smithi112.stdout:checking for a sed that does not truncate output... /bin/sed 2023-09-12T16:09:06.769 INFO:teuthology.orchestra.run.smithi112.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-09-12T16:09:06.773 INFO:teuthology.orchestra.run.smithi112.stdout:checking for egrep... /bin/grep -E 2023-09-12T16:09:06.775 INFO:teuthology.orchestra.run.smithi112.stdout:checking for fgrep... /bin/grep -F 2023-09-12T16:09:06.783 INFO:teuthology.orchestra.run.smithi112.stdout:checking for ld used by gcc... /bin/ld 2023-09-12T16:09:06.787 INFO:teuthology.orchestra.run.smithi112.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-09-12T16:09:06.796 INFO:teuthology.orchestra.run.smithi112.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-09-12T16:09:06.835 INFO:teuthology.orchestra.run.smithi112.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-09-12T16:09:06.835 INFO:teuthology.orchestra.run.smithi112.stdout:checking whether ln -s works... yes 2023-09-12T16:09:06.848 INFO:teuthology.orchestra.run.smithi112.stdout:checking the maximum length of command line arguments... 1572864 2023-09-12T16:09:06.854 INFO:teuthology.orchestra.run.smithi112.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-09-12T16:09:06.854 INFO:teuthology.orchestra.run.smithi112.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-09-12T16:09:06.854 INFO:teuthology.orchestra.run.smithi112.stdout:checking for /bin/ld option to reload object files... -r 2023-09-12T16:09:06.855 INFO:teuthology.orchestra.run.smithi112.stdout:checking for objdump... objdump 2023-09-12T16:09:06.856 INFO:teuthology.orchestra.run.smithi112.stdout:checking how to recognize dependent libraries... pass_all 2023-09-12T16:09:06.856 INFO:teuthology.orchestra.run.smithi112.stdout:checking for dlltool... no 2023-09-12T16:09:06.856 INFO:teuthology.orchestra.run.smithi112.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-09-12T16:09:06.857 INFO:teuthology.orchestra.run.smithi112.stdout:checking for ar... ar 2023-09-12T16:09:06.912 INFO:teuthology.orchestra.run.smithi112.stdout:checking for archiver @FILE support... @ 2023-09-12T16:09:06.912 INFO:teuthology.orchestra.run.smithi112.stdout:checking for strip... strip 2023-09-12T16:09:06.912 INFO:teuthology.orchestra.run.smithi112.stdout:checking for ranlib... ranlib 2023-09-12T16:09:06.913 INFO:teuthology.orchestra.run.smithi112.stdout:checking for gawk... gawk 2023-09-12T16:09:07.023 INFO:teuthology.orchestra.run.smithi112.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-09-12T16:09:07.026 INFO:teuthology.orchestra.run.smithi112.stdout:checking for sysroot... no 2023-09-12T16:09:07.033 INFO:teuthology.orchestra.run.smithi112.stdout:checking for a working dd... /bin/dd 2023-09-12T16:09:07.040 INFO:teuthology.orchestra.run.smithi112.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-09-12T16:09:07.069 INFO:teuthology.orchestra.run.smithi112.stdout:checking for mt... no 2023-09-12T16:09:07.075 INFO:teuthology.orchestra.run.smithi112.stdout:checking if : is a manifest tool... no 2023-09-12T16:09:07.139 INFO:teuthology.orchestra.run.smithi112.stdout:checking how to run the C preprocessor... gcc -E 2023-09-12T16:09:07.379 INFO:teuthology.orchestra.run.smithi112.stdout:checking for ANSI C header files... yes 2023-09-12T16:09:07.422 INFO:teuthology.orchestra.run.smithi112.stdout:checking for sys/types.h... yes 2023-09-12T16:09:07.481 INFO:teuthology.orchestra.run.smithi112.stdout:checking for sys/stat.h... yes 2023-09-12T16:09:07.533 INFO:teuthology.orchestra.run.smithi112.stdout:checking for stdlib.h... yes 2023-09-12T16:09:07.586 INFO:teuthology.orchestra.run.smithi112.stdout:checking for string.h... yes 2023-09-12T16:09:07.639 INFO:teuthology.orchestra.run.smithi112.stdout:checking for memory.h... yes 2023-09-12T16:09:07.692 INFO:teuthology.orchestra.run.smithi112.stdout:checking for strings.h... yes 2023-09-12T16:09:07.758 INFO:teuthology.orchestra.run.smithi112.stdout:checking for inttypes.h... yes 2023-09-12T16:09:07.812 INFO:teuthology.orchestra.run.smithi112.stdout:checking for stdint.h... yes 2023-09-12T16:09:07.870 INFO:teuthology.orchestra.run.smithi112.stdout:checking for unistd.h... yes 2023-09-12T16:09:07.932 INFO:teuthology.orchestra.run.smithi112.stdout:checking for dlfcn.h... yes 2023-09-12T16:09:07.940 INFO:teuthology.orchestra.run.smithi112.stdout:checking for objdir... .libs 2023-09-12T16:09:08.075 INFO:teuthology.orchestra.run.smithi112.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-09-12T16:09:08.076 INFO:teuthology.orchestra.run.smithi112.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-09-12T16:09:08.114 INFO:teuthology.orchestra.run.smithi112.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-09-12T16:09:08.151 INFO:teuthology.orchestra.run.smithi112.stdout:checking if gcc static flag -static works... no 2023-09-12T16:09:08.205 INFO:teuthology.orchestra.run.smithi112.stdout:checking if gcc supports -c -o file.o... yes 2023-09-12T16:09:08.206 INFO:teuthology.orchestra.run.smithi112.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-09-12T16:09:08.221 INFO:teuthology.orchestra.run.smithi112.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-09-12T16:09:08.269 INFO:teuthology.orchestra.run.smithi112.stdout:checking whether -lc should be explicitly linked in... no 2023-09-12T16:09:08.363 INFO:teuthology.orchestra.run.smithi112.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-09-12T16:09:08.364 INFO:teuthology.orchestra.run.smithi112.stdout:checking how to hardcode library paths into programs... immediate 2023-09-12T16:09:08.376 INFO:teuthology.orchestra.run.smithi112.stdout:checking whether stripping libraries is possible... yes 2023-09-12T16:09:08.376 INFO:teuthology.orchestra.run.smithi112.stdout:checking if libtool supports shared libraries... yes 2023-09-12T16:09:08.376 INFO:teuthology.orchestra.run.smithi112.stdout:checking whether to build shared libraries... yes 2023-09-12T16:09:08.377 INFO:teuthology.orchestra.run.smithi112.stdout:checking whether to build static libraries... yes 2023-09-12T16:09:08.388 INFO:teuthology.orchestra.run.smithi112.stdout:checking for gcc... (cached) gcc 2023-09-12T16:09:08.427 INFO:teuthology.orchestra.run.smithi112.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-09-12T16:09:08.427 INFO:teuthology.orchestra.run.smithi112.stdout:checking whether gcc accepts -g... (cached) yes 2023-09-12T16:09:08.427 INFO:teuthology.orchestra.run.smithi112.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-09-12T16:09:08.428 INFO:teuthology.orchestra.run.smithi112.stdout:checking for gmake... /usr/bin/gmake 2023-09-12T16:09:08.428 INFO:teuthology.orchestra.run.smithi112.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-09-12T16:09:08.429 INFO:teuthology.orchestra.run.smithi112.stdout:checking for tar... /bin/tar 2023-09-12T16:09:08.429 INFO:teuthology.orchestra.run.smithi112.stdout:checking for gzip... /bin/gzip 2023-09-12T16:09:08.444 INFO:teuthology.orchestra.run.smithi112.stdout:checking whether gcc -MM is supported... yes 2023-09-12T16:09:08.445 INFO:teuthology.orchestra.run.smithi112.stdout:checking for sort... /bin/sort 2023-09-12T16:09:08.445 INFO:teuthology.orchestra.run.smithi112.stdout:checking whether ln -s works... yes 2023-09-12T16:09:08.446 INFO:teuthology.orchestra.run.smithi112.stdout:checking for rpm... /bin/rpm 2023-09-12T16:09:08.454 INFO:teuthology.orchestra.run.smithi112.stdout:checking for rpmbuild... no 2023-09-12T16:09:08.517 INFO:teuthology.orchestra.run.smithi112.stdout:checking assert.h usability... yes 2023-09-12T16:09:08.533 INFO:teuthology.orchestra.run.smithi112.stdout:checking assert.h presence... yes 2023-09-12T16:09:08.533 INFO:teuthology.orchestra.run.smithi112.stdout:checking for assert.h... yes 2023-09-12T16:09:08.589 INFO:teuthology.orchestra.run.smithi112.stdout:checking bstring.h usability... no 2023-09-12T16:09:08.614 INFO:teuthology.orchestra.run.smithi112.stdout:checking bstring.h presence... no 2023-09-12T16:09:08.614 INFO:teuthology.orchestra.run.smithi112.stdout:checking for bstring.h... no 2023-09-12T16:09:08.663 INFO:teuthology.orchestra.run.smithi112.stdout:checking libgen.h usability... yes 2023-09-12T16:09:08.678 INFO:teuthology.orchestra.run.smithi112.stdout:checking libgen.h presence... yes 2023-09-12T16:09:08.679 INFO:teuthology.orchestra.run.smithi112.stdout:checking for libgen.h... yes 2023-09-12T16:09:08.737 INFO:teuthology.orchestra.run.smithi112.stdout:checking dirent.h usability... yes 2023-09-12T16:09:08.754 INFO:teuthology.orchestra.run.smithi112.stdout:checking dirent.h presence... yes 2023-09-12T16:09:08.754 INFO:teuthology.orchestra.run.smithi112.stdout:checking for dirent.h... yes 2023-09-12T16:09:08.833 INFO:teuthology.orchestra.run.smithi112.stdout:checking errno.h usability... yes 2023-09-12T16:09:08.850 INFO:teuthology.orchestra.run.smithi112.stdout:checking errno.h presence... yes 2023-09-12T16:09:08.850 INFO:teuthology.orchestra.run.smithi112.stdout:checking for errno.h... yes 2023-09-12T16:09:08.918 INFO:teuthology.orchestra.run.smithi112.stdout:checking malloc.h usability... yes 2023-09-12T16:09:08.936 INFO:teuthology.orchestra.run.smithi112.stdout:checking malloc.h presence... yes 2023-09-12T16:09:08.936 INFO:teuthology.orchestra.run.smithi112.stdout:checking for malloc.h... yes 2023-09-12T16:09:08.993 INFO:teuthology.orchestra.run.smithi112.stdout:checking uuid.h usability... no 2023-09-12T16:09:09.017 INFO:teuthology.orchestra.run.smithi112.stdout:checking uuid.h presence... no 2023-09-12T16:09:09.017 INFO:teuthology.orchestra.run.smithi112.stdout:checking for uuid.h... no 2023-09-12T16:09:09.089 INFO:teuthology.orchestra.run.smithi112.stdout:checking uuid/uuid.h usability... yes 2023-09-12T16:09:09.108 INFO:teuthology.orchestra.run.smithi112.stdout:checking uuid/uuid.h presence... yes 2023-09-12T16:09:09.108 INFO:teuthology.orchestra.run.smithi112.stdout:checking for uuid/uuid.h... yes 2023-09-12T16:09:09.164 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/uuid.h usability... no 2023-09-12T16:09:09.189 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/uuid.h presence... no 2023-09-12T16:09:09.189 INFO:teuthology.orchestra.run.smithi112.stdout:checking for sys/uuid.h... no 2023-09-12T16:09:09.240 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/file.h usability... yes 2023-09-12T16:09:09.257 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/file.h presence... yes 2023-09-12T16:09:09.257 INFO:teuthology.orchestra.run.smithi112.stdout:checking for sys/file.h... yes 2023-09-12T16:09:09.316 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/fcntl.h usability... yes 2023-09-12T16:09:09.332 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/fcntl.h presence... yes 2023-09-12T16:09:09.333 INFO:teuthology.orchestra.run.smithi112.stdout:checking for sys/fcntl.h... yes 2023-09-12T16:09:09.389 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/syssgi.h usability... no 2023-09-12T16:09:09.413 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/syssgi.h presence... no 2023-09-12T16:09:09.413 INFO:teuthology.orchestra.run.smithi112.stdout:checking for sys/syssgi.h... no 2023-09-12T16:09:09.484 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/param.h usability... yes 2023-09-12T16:09:09.505 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/param.h presence... yes 2023-09-12T16:09:09.505 INFO:teuthology.orchestra.run.smithi112.stdout:checking for sys/param.h... yes 2023-09-12T16:09:09.519 INFO:teuthology.orchestra.run.smithi112.stdout:checking for sys/stat.h... (cached) yes 2023-09-12T16:09:09.586 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/statvfs.h usability... yes 2023-09-12T16:09:09.602 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/statvfs.h presence... yes 2023-09-12T16:09:09.602 INFO:teuthology.orchestra.run.smithi112.stdout:checking for sys/statvfs.h... yes 2023-09-12T16:09:09.660 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/time.h usability... yes 2023-09-12T16:09:09.677 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/time.h presence... yes 2023-09-12T16:09:09.677 INFO:teuthology.orchestra.run.smithi112.stdout:checking for sys/time.h... yes 2023-09-12T16:09:09.750 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/ioctl.h usability... yes 2023-09-12T16:09:09.767 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/ioctl.h presence... yes 2023-09-12T16:09:09.767 INFO:teuthology.orchestra.run.smithi112.stdout:checking for sys/ioctl.h... yes 2023-09-12T16:09:09.826 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/wait.h usability... yes 2023-09-12T16:09:09.846 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/wait.h presence... yes 2023-09-12T16:09:09.846 INFO:teuthology.orchestra.run.smithi112.stdout:checking for sys/wait.h... yes 2023-09-12T16:09:09.861 INFO:teuthology.orchestra.run.smithi112.stdout:checking for sys/types.h... (cached) yes 2023-09-12T16:09:09.875 INFO:teuthology.orchestra.run.smithi112.stdout:checking for strings.h... (cached) yes 2023-09-12T16:09:09.945 INFO:teuthology.orchestra.run.smithi112.stdout:checking err.h usability... yes 2023-09-12T16:09:09.961 INFO:teuthology.orchestra.run.smithi112.stdout:checking err.h presence... yes 2023-09-12T16:09:09.961 INFO:teuthology.orchestra.run.smithi112.stdout:checking for err.h... yes 2023-09-12T16:09:10.036 INFO:teuthology.orchestra.run.smithi112.stdout:checking linux/falloc.h usability... yes 2023-09-12T16:09:10.051 INFO:teuthology.orchestra.run.smithi112.stdout:checking linux/falloc.h presence... yes 2023-09-12T16:09:10.052 INFO:teuthology.orchestra.run.smithi112.stdout:checking for linux/falloc.h... yes 2023-09-12T16:09:10.108 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-09-12T16:09:10.133 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-09-12T16:09:10.133 INFO:teuthology.orchestra.run.smithi112.stdout:checking for sys/fs/xfs_fsops.h... no 2023-09-12T16:09:10.181 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/fs/xfs_itable.h usability... no 2023-09-12T16:09:10.205 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/fs/xfs_itable.h presence... no 2023-09-12T16:09:10.205 INFO:teuthology.orchestra.run.smithi112.stdout:checking for sys/fs/xfs_itable.h... no 2023-09-12T16:09:10.254 INFO:teuthology.orchestra.run.smithi112.stdout:checking xfs/platform_defs.h usability... no 2023-09-12T16:09:10.278 INFO:teuthology.orchestra.run.smithi112.stdout:checking xfs/platform_defs.h presence... no 2023-09-12T16:09:10.278 INFO:teuthology.orchestra.run.smithi112.stdout:checking for xfs/platform_defs.h... no 2023-09-12T16:09:10.326 INFO:teuthology.orchestra.run.smithi112.stdout:checking btrfs/ioctl.h usability... no 2023-09-12T16:09:10.351 INFO:teuthology.orchestra.run.smithi112.stdout:checking btrfs/ioctl.h presence... no 2023-09-12T16:09:10.352 INFO:teuthology.orchestra.run.smithi112.stdout:checking for btrfs/ioctl.h... no 2023-09-12T16:09:10.400 INFO:teuthology.orchestra.run.smithi112.stdout:checking cifs/ioctl.h usability... no 2023-09-12T16:09:10.424 INFO:teuthology.orchestra.run.smithi112.stdout:checking cifs/ioctl.h presence... no 2023-09-12T16:09:10.424 INFO:teuthology.orchestra.run.smithi112.stdout:checking for cifs/ioctl.h... no 2023-09-12T16:09:10.475 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/mman.h usability... yes 2023-09-12T16:09:10.492 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/mman.h presence... yes 2023-09-12T16:09:10.492 INFO:teuthology.orchestra.run.smithi112.stdout:checking for sys/mman.h... yes 2023-09-12T16:09:10.532 INFO:teuthology.orchestra.run.smithi112.stdout:checking for xfs/xfs_log_format.h... no 2023-09-12T16:09:10.600 INFO:teuthology.orchestra.run.smithi112.stdout:checking for uuid_compare... no 2023-09-12T16:09:10.657 INFO:teuthology.orchestra.run.smithi112.stdout:checking for uuid_compare in -luuid... yes 2023-09-12T16:09:10.742 INFO:teuthology.orchestra.run.smithi112.stdout:checking for xfs/xfs.h... yes 2023-09-12T16:09:10.774 INFO:teuthology.orchestra.run.smithi112.stdout:checking for xfs/libxfs.h... no 2023-09-12T16:09:10.812 INFO:teuthology.orchestra.run.smithi112.stdout:checking whether xlog_assign_lsn is declared... no 2023-09-12T16:09:10.864 INFO:teuthology.orchestra.run.smithi112.stdout:checking for xfs/xqm.h... yes 2023-09-12T16:09:10.945 INFO:teuthology.orchestra.run.smithi112.stdout:checking xfsctl from xfs/xfs.h... ok 2023-09-12T16:09:10.990 INFO:teuthology.orchestra.run.smithi112.stdout:checking xfs/handle.h usability... yes 2023-09-12T16:09:11.006 INFO:teuthology.orchestra.run.smithi112.stdout:checking xfs/handle.h presence... yes 2023-09-12T16:09:11.006 INFO:teuthology.orchestra.run.smithi112.stdout:checking for xfs/handle.h... yes 2023-09-12T16:09:11.065 INFO:teuthology.orchestra.run.smithi112.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-09-12T16:09:11.113 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/acl.h usability... yes 2023-09-12T16:09:11.131 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/acl.h presence... yes 2023-09-12T16:09:11.132 INFO:teuthology.orchestra.run.smithi112.stdout:checking for sys/acl.h... yes 2023-09-12T16:09:11.193 INFO:teuthology.orchestra.run.smithi112.stdout:checking acl/libacl.h usability... yes 2023-09-12T16:09:11.211 INFO:teuthology.orchestra.run.smithi112.stdout:checking acl/libacl.h presence... yes 2023-09-12T16:09:11.211 INFO:teuthology.orchestra.run.smithi112.stdout:checking for acl/libacl.h... yes 2023-09-12T16:09:11.271 INFO:teuthology.orchestra.run.smithi112.stdout:checking for acl_init in -lacl... yes 2023-09-12T16:09:11.316 INFO:teuthology.orchestra.run.smithi112.stdout:checking gdbm-ndbm.h usability... no 2023-09-12T16:09:11.341 INFO:teuthology.orchestra.run.smithi112.stdout:checking gdbm-ndbm.h presence... no 2023-09-12T16:09:11.341 INFO:teuthology.orchestra.run.smithi112.stdout:checking for gdbm-ndbm.h... no 2023-09-12T16:09:11.383 INFO:teuthology.orchestra.run.smithi112.stdout:checking gdbm/ndbm.h usability... no 2023-09-12T16:09:11.408 INFO:teuthology.orchestra.run.smithi112.stdout:checking gdbm/ndbm.h presence... no 2023-09-12T16:09:11.408 INFO:teuthology.orchestra.run.smithi112.stdout:checking for gdbm/ndbm.h... no 2023-09-12T16:09:11.450 INFO:teuthology.orchestra.run.smithi112.stdout:checking ndbm.h usability... no 2023-09-12T16:09:11.475 INFO:teuthology.orchestra.run.smithi112.stdout:checking ndbm.h presence... no 2023-09-12T16:09:11.475 INFO:teuthology.orchestra.run.smithi112.stdout:checking for ndbm.h... no 2023-09-12T16:09:11.522 INFO:teuthology.orchestra.run.smithi112.stdout:checking libaio.h usability... yes 2023-09-12T16:09:11.543 INFO:teuthology.orchestra.run.smithi112.stdout:checking libaio.h presence... yes 2023-09-12T16:09:11.543 INFO:teuthology.orchestra.run.smithi112.stdout:checking for libaio.h... yes 2023-09-12T16:09:11.589 INFO:teuthology.orchestra.run.smithi112.stdout:checking liburing.h usability... no 2023-09-12T16:09:11.613 INFO:teuthology.orchestra.run.smithi112.stdout:checking liburing.h presence... no 2023-09-12T16:09:11.613 INFO:teuthology.orchestra.run.smithi112.stdout:checking for liburing.h... no 2023-09-12T16:09:11.655 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/capability.h usability... no 2023-09-12T16:09:11.679 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/capability.h presence... no 2023-09-12T16:09:11.680 INFO:teuthology.orchestra.run.smithi112.stdout:checking for sys/capability.h... no 2023-09-12T16:09:11.723 INFO:teuthology.orchestra.run.smithi112.stdout:checking linux/fiemap.h usability... yes 2023-09-12T16:09:11.740 INFO:teuthology.orchestra.run.smithi112.stdout:checking linux/fiemap.h presence... yes 2023-09-12T16:09:11.740 INFO:teuthology.orchestra.run.smithi112.stdout:checking for linux/fiemap.h... yes 2023-09-12T16:09:11.801 INFO:teuthology.orchestra.run.smithi112.stdout:checking for fallocate... yes 2023-09-12T16:09:11.860 INFO:teuthology.orchestra.run.smithi112.stdout:checking for open_by_handle_at... yes 2023-09-12T16:09:11.909 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/prctl.h usability... yes 2023-09-12T16:09:11.925 INFO:teuthology.orchestra.run.smithi112.stdout:checking sys/prctl.h presence... yes 2023-09-12T16:09:11.925 INFO:teuthology.orchestra.run.smithi112.stdout:checking for sys/prctl.h... yes 2023-09-12T16:09:11.972 INFO:teuthology.orchestra.run.smithi112.stdout:checking linux/fs.h usability... yes 2023-09-12T16:09:11.989 INFO:teuthology.orchestra.run.smithi112.stdout:checking linux/fs.h presence... yes 2023-09-12T16:09:11.989 INFO:teuthology.orchestra.run.smithi112.stdout:checking for linux/fs.h... yes 2023-09-12T16:09:12.031 INFO:teuthology.orchestra.run.smithi112.stdout:checking btrfsutil.h usability... no 2023-09-12T16:09:12.056 INFO:teuthology.orchestra.run.smithi112.stdout:checking btrfsutil.h presence... no 2023-09-12T16:09:12.057 INFO:teuthology.orchestra.run.smithi112.stdout:checking for btrfsutil.h... no 2023-09-12T16:09:12.120 INFO:teuthology.orchestra.run.smithi112.stdout:checking for copy_file_range... yes 2023-09-12T16:09:12.184 INFO:teuthology.orchestra.run.smithi112.stdout:checking for SEEK_DATA... yes 2023-09-12T16:09:12.264 INFO:teuthology.orchestra.run.smithi112.stdout:checking for BMV_OF_SHARED... yes 2023-09-12T16:09:12.328 INFO:teuthology.orchestra.run.smithi112.stdout:checking for nftw... yes 2023-09-12T16:09:12.390 INFO:teuthology.orchestra.run.smithi112.stdout:checking for RLIMIT_NOFILE... yes 2023-09-12T16:09:12.429 INFO:teuthology.orchestra.run.smithi112.stdout:checking for FIEXCHANGE_RANGE... no 2023-09-12T16:09:12.489 INFO:teuthology.orchestra.run.smithi112.stdout:checking for renameat2... yes 2023-09-12T16:09:12.551 INFO:teuthology.orchestra.run.smithi112.stdout:checking for reallocarray... yes 2023-09-12T16:09:12.584 INFO:teuthology.orchestra.run.smithi112.stdout:checking for struct mount_attr... no 2023-09-12T16:09:12.656 INFO:teuthology.orchestra.run.smithi112.stdout:checking for struct btrfs_qgroup_limit... yes 2023-09-12T16:09:12.729 INFO:teuthology.orchestra.run.smithi112.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-09-12T16:09:12.802 INFO:teuthology.orchestra.run.smithi112.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-09-12T16:09:12.876 INFO:teuthology.orchestra.run.smithi112.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-09-12T16:09:12.950 INFO:teuthology.orchestra.run.smithi112.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-09-12T16:09:13.023 INFO:teuthology.orchestra.run.smithi112.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-09-12T16:09:13.096 INFO:teuthology.orchestra.run.smithi112.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-09-12T16:09:13.152 INFO:teuthology.orchestra.run.smithi112.stdout:checking linux/btrfs.h usability... yes 2023-09-12T16:09:13.168 INFO:teuthology.orchestra.run.smithi112.stdout:checking linux/btrfs.h presence... yes 2023-09-12T16:09:13.169 INFO:teuthology.orchestra.run.smithi112.stdout:checking for linux/btrfs.h... yes 2023-09-12T16:09:13.229 INFO:teuthology.orchestra.run.smithi112.stdout:checking linux/btrfs_tree.h usability... yes 2023-09-12T16:09:13.246 INFO:teuthology.orchestra.run.smithi112.stdout:checking linux/btrfs_tree.h presence... yes 2023-09-12T16:09:13.247 INFO:teuthology.orchestra.run.smithi112.stdout:checking for linux/btrfs_tree.h... yes 2023-09-12T16:09:13.319 INFO:teuthology.orchestra.run.smithi112.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-09-12T16:09:13.348 INFO:teuthology.orchestra.run.smithi112.stdout:configure: creating ./config.status 2023-09-12T16:09:14.258 INFO:teuthology.orchestra.run.smithi112.stdout:config.status: creating include/builddefs 2023-09-12T16:09:14.287 INFO:teuthology.orchestra.run.smithi112.stdout:config.status: creating include/config.h 2023-09-12T16:09:14.309 INFO:teuthology.orchestra.run.smithi112.stdout:config.status: executing libtool commands 2023-09-12T16:09:14.388 INFO:teuthology.orchestra.run.smithi112.stdout:Building include 2023-09-12T16:09:14.395 INFO:teuthology.orchestra.run.smithi112.stdout:Building lib 2023-09-12T16:09:14.401 INFO:teuthology.orchestra.run.smithi112.stdout: [LTDEP] 2023-09-12T16:09:14.612 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] dataascii.lo 2023-09-12T16:09:14.816 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] databin.lo 2023-09-12T16:09:15.049 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] datapid.lo 2023-09-12T16:09:15.238 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] file_lock.lo 2023-09-12T16:09:15.486 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] forker.lo 2023-09-12T16:09:15.704 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] pattern.lo 2023-09-12T16:09:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] open_flags.lo 2023-09-12T16:09:16.136 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] random_range.lo 2023-09-12T16:09:16.442 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] string_to_tokens.lo 2023-09-12T16:09:16.628 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] str_to_bytes.lo 2023-09-12T16:09:16.843 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] tlibio.lo 2023-09-12T16:09:17.166 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] write_log.lo 2023-09-12T16:09:17.490 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] random.lo 2023-09-12T16:09:17.688 INFO:teuthology.orchestra.run.smithi112.stdout: [LD] 2023-09-12T16:09:17.819 INFO:teuthology.orchestra.run.smithi112.stdout:Building ltp 2023-09-12T16:09:17.826 INFO:teuthology.orchestra.run.smithi112.stdout: [DEP] 2023-09-12T16:09:18.024 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] doio 2023-09-12T16:09:18.763 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] fsstress 2023-09-12T16:09:20.141 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] fsx 2023-09-12T16:09:21.081 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] growfiles 2023-09-12T16:09:21.684 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] iogen 2023-09-12T16:09:22.137 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] aio-stress 2023-09-12T16:09:22.650 INFO:teuthology.orchestra.run.smithi112.stdout:Building src 2023-09-12T16:09:22.659 INFO:teuthology.orchestra.run.smithi112.stdout: [DEP] 2023-09-12T16:09:24.094 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:09:24.101 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:09:25.153 INFO:teuthology.orchestra.run.smithi112.stdout: [DEP] 2023-09-12T16:09:25.203 INFO:teuthology.orchestra.run.smithi112.stdout: [DEP] 2023-09-12T16:09:25.219 INFO:teuthology.orchestra.run.smithi112.stdout: [DEP] 2023-09-12T16:09:25.562 INFO:teuthology.orchestra.run.smithi112.stdout: [DEP] 2023-09-12T16:09:25.602 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] dirstress 2023-09-12T16:09:25.952 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] fill 2023-09-12T16:09:26.204 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] fill2 2023-09-12T16:09:26.533 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] getpagesize 2023-09-12T16:09:26.766 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] holes 2023-09-12T16:09:27.064 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] lstat64 2023-09-12T16:09:27.347 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] nametest 2023-09-12T16:09:27.688 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] permname 2023-09-12T16:09:27.989 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] randholes 2023-09-12T16:09:28.339 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] runas 2023-09-12T16:09:28.615 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] truncfile 2023-09-12T16:09:28.898 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] usemem 2023-09-12T16:09:29.152 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] mmapcat 2023-09-12T16:09:29.401 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] append_reader 2023-09-12T16:09:29.652 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] append_writer 2023-09-12T16:09:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] dirperf 2023-09-12T16:09:30.226 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] metaperf 2023-09-12T16:09:30.577 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] devzero 2023-09-12T16:09:30.854 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] feature 2023-09-12T16:09:31.171 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] alloc 2023-09-12T16:09:31.484 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] fault 2023-09-12T16:09:31.751 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] fstest 2023-09-12T16:09:32.088 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_access_root 2023-09-12T16:09:32.343 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] godown 2023-09-12T16:09:32.614 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] resvtest 2023-09-12T16:09:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] writemod 2023-09-12T16:09:33.148 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] writev_on_pagefault 2023-09-12T16:09:33.410 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] makeextents 2023-09-12T16:09:33.690 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] itrash 2023-09-12T16:09:33.946 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] rename 2023-09-12T16:09:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] multi_open_unlink 2023-09-12T16:09:34.450 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] unwritten_sync 2023-09-12T16:09:34.733 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] genhashnames 2023-09-12T16:09:35.019 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_holes 2023-09-12T16:09:35.266 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_mmap_writev 2023-09-12T16:09:35.513 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_truncate_cmtime 2023-09-12T16:09:35.773 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] dirhash_collide 2023-09-12T16:09:36.055 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_rename_overwrite 2023-09-12T16:09:36.297 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] holetest 2023-09-12T16:09:36.613 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_truncate_self 2023-09-12T16:09:36.852 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] af_unix 2023-09-12T16:09:37.106 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_mmap_stale_pmd 2023-09-12T16:09:37.361 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_mmap_cow_race 2023-09-12T16:09:37.627 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_mmap_fallocate 2023-09-12T16:09:37.878 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] fsync-err 2023-09-12T16:09:38.164 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_mmap_write_ro 2023-09-12T16:09:38.416 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_ext4_dax_journal_corruption 2023-09-12T16:09:38.676 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_ext4_dax_inline_corruption 2023-09-12T16:09:38.933 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_ofd_locks 2023-09-12T16:09:39.229 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_mmap_collision 2023-09-12T16:09:39.526 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] mmap-write-concurrent 2023-09-12T16:09:39.797 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_get_file_time 2023-09-12T16:09:40.044 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_create_short_dirs 2023-09-12T16:09:40.310 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_create_long_dirs 2023-09-12T16:09:40.575 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_enospc 2023-09-12T16:09:40.860 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_mmap_writev_overlap 2023-09-12T16:09:41.131 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] checkpoint_journal 2023-09-12T16:09:41.386 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] mmap-rw-fault 2023-09-12T16:09:41.671 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] allocstale 2023-09-12T16:09:41.944 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_mmap_cow_memory_failure 2023-09-12T16:09:42.215 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] fake-dump-rootino 2023-09-12T16:09:42.466 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] dio-buf-fault 2023-09-12T16:09:42.720 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] xfsctl 2023-09-12T16:09:43.014 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] bstat 2023-09-12T16:09:43.319 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_mtab 2023-09-12T16:09:43.603 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] getdevicesize 2023-09-12T16:09:43.850 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] preallo_rw_pattern_reader 2023-09-12T16:09:44.116 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] preallo_rw_pattern_writer 2023-09-12T16:09:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] ftrunc 2023-09-12T16:09:44.629 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] trunc 2023-09-12T16:09:44.890 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] fs_perms 2023-09-12T16:09:45.159 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] testx 2023-09-12T16:09:45.390 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] looptest 2023-09-12T16:09:45.683 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] locktest 2023-09-12T16:09:46.087 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] unwritten_mmap 2023-09-12T16:09:46.353 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] bulkstat_unlink_test 2023-09-12T16:09:46.655 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] deduperace 2023-09-12T16:09:46.950 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] bulkstat_unlink_test_modified 2023-09-12T16:09:47.251 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_dir_offset 2023-09-12T16:09:47.500 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_futimens 2023-09-12T16:09:47.740 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_immutable 2023-09-12T16:09:48.432 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] stale_handle 2023-09-12T16:09:48.704 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] pwrite_mmap_blocked 2023-09-12T16:09:48.961 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_dir_offset2 2023-09-12T16:09:49.254 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] seek_sanity_test 2023-09-12T16:09:49.759 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] seek_copy_test 2023-09-12T16:09:50.037 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_readdir_1 2023-09-12T16:09:50.286 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_readdir_2 2023-09-12T16:09:50.538 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] fsync-tester 2023-09-12T16:09:50.883 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] nsexec 2023-09-12T16:09:51.160 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] cloner 2023-09-12T16:09:51.439 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] renameat2 2023-09-12T16:09:51.708 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_getcwd 2023-09-12T16:09:51.968 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] e4compact 2023-09-12T16:09:52.271 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] test-nextquota 2023-09-12T16:09:52.544 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] punch-alternating 2023-09-12T16:09:52.818 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] attr-list-by-handle-cursor-test 2023-09-12T16:09:53.090 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] listxattr 2023-09-12T16:09:53.338 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] dio-interleaved 2023-09-12T16:09:53.599 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_dir_type 2023-09-12T16:09:53.855 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] dio-invalidate-cache 2023-09-12T16:09:54.160 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] stat_test 2023-09-12T16:09:54.373 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:09:54.380 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:09:54.563 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_encrypted_d_revalidate 2023-09-12T16:09:54.831 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] attr_replace_test 2023-09-12T16:09:55.097 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] swapon 2023-09-12T16:09:55.362 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] mkswap 2023-09-12T16:09:55.615 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_attr_corruption 2023-09-12T16:09:55.866 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_open_tmpfiles 2023-09-12T16:09:56.150 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] fscrypt-crypt-util 2023-09-12T16:09:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] bulkstat_null_ocount 2023-09-12T16:09:57.134 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] splice-test 2023-09-12T16:09:57.415 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] chprojid_fail 2023-09-12T16:09:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] detached_mounts_propagation 2023-09-12T16:09:57.969 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] ext4_resize 2023-09-12T16:09:58.218 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_readdir_3 2023-09-12T16:09:58.512 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] splice2pipe 2023-09-12T16:09:58.776 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] uuid_ioctl 2023-09-12T16:09:59.034 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] fiemap-tester 2023-09-12T16:09:59.401 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_stripealign 2023-09-12T16:09:59.655 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] open_by_handle 2023-09-12T16:10:00.009 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] t_mmap_dio 2023-09-12T16:10:00.273 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] xfsfind 2023-09-12T16:10:00.570 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] fssum 2023-09-12T16:10:01.101 INFO:teuthology.orchestra.run.smithi112.stdout:Building log-writes 2023-09-12T16:10:01.111 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] replay-log 2023-09-12T16:10:01.524 INFO:teuthology.orchestra.run.smithi112.stdout:Building perf 2023-09-12T16:10:01.531 INFO:teuthology.orchestra.run.smithi112.stdout:Building aio-dio-regress 2023-09-12T16:10:01.542 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] aio-dio-append-write-fallocate-race 2023-09-12T16:10:01.821 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] aio-dio-fcntl-race 2023-09-12T16:10:02.090 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] aio-dio-subblock-eof-read 2023-09-12T16:10:02.338 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] aio-dio-append-write-read-race 2023-09-12T16:10:02.619 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] aio-dio-invalidate-readahead 2023-09-12T16:10:02.887 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] aio-dio-hole-filling-race 2023-09-12T16:10:03.142 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-09-12T16:10:03.381 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] aio-last-ref-held-by-io 2023-09-12T16:10:03.659 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] aio-dio-cycle-write 2023-09-12T16:10:03.948 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] aio-dio-extend-stat 2023-09-12T16:10:04.219 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-09-12T16:10:04.456 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] aio-dio-invalidate-failure 2023-09-12T16:10:04.720 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] aiodio_sparse2 2023-09-12T16:10:05.039 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] aiocp 2023-09-12T16:10:05.366 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] aio-dio-cow-race 2023-09-12T16:10:05.625 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] aio-dio-write-verify 2023-09-12T16:10:05.920 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] aio-dio-eof-race 2023-09-12T16:10:06.209 INFO:teuthology.orchestra.run.smithi112.stdout:Building vfs 2023-09-12T16:10:06.219 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] vfstest 2023-09-12T16:10:08.226 INFO:teuthology.orchestra.run.smithi112.stdout: [CC] mount-idmapped 2023-09-12T16:10:08.711 INFO:teuthology.orchestra.run.smithi112.stdout:Building m4 2023-09-12T16:10:08.718 INFO:teuthology.orchestra.run.smithi112.stdout:Building common 2023-09-12T16:10:08.725 INFO:teuthology.orchestra.run.smithi112.stdout:Building tests 2023-09-12T16:10:08.735 INFO:teuthology.orchestra.run.smithi112.stdout:Building perf 2023-09-12T16:10:08.745 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/perf/group.list 2023-09-12T16:10:08.775 INFO:teuthology.orchestra.run.smithi112.stdout:Building ext4 2023-09-12T16:10:08.784 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/ext4/group.list 2023-09-12T16:10:08.879 INFO:teuthology.orchestra.run.smithi112.stdout:Building ocfs2 2023-09-12T16:10:08.889 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/ocfs2/group.list 2023-09-12T16:10:08.924 INFO:teuthology.orchestra.run.smithi112.stdout:Building overlay 2023-09-12T16:10:08.934 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/overlay/group.list 2023-09-12T16:10:09.034 INFO:teuthology.orchestra.run.smithi112.stdout:Building cifs 2023-09-12T16:10:09.043 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/cifs/group.list 2023-09-12T16:10:09.075 INFO:teuthology.orchestra.run.smithi112.stdout:Building generic 2023-09-12T16:10:09.087 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/generic/group.list 2023-09-12T16:10:09.339 INFO:teuthology.orchestra.run.smithi112.stdout:Building shared 2023-09-12T16:10:09.349 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/shared/group.list 2023-09-12T16:10:09.393 INFO:teuthology.orchestra.run.smithi112.stdout:Building nfs 2023-09-12T16:10:09.402 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/nfs/group.list 2023-09-12T16:10:09.439 INFO:teuthology.orchestra.run.smithi112.stdout:Building f2fs 2023-09-12T16:10:09.449 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/f2fs/group.list 2023-09-12T16:10:09.493 INFO:teuthology.orchestra.run.smithi112.stdout:Building udf 2023-09-12T16:10:09.503 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/udf/group.list 2023-09-12T16:10:09.532 INFO:teuthology.orchestra.run.smithi112.stdout:Building ceph 2023-09-12T16:10:09.542 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/ceph/group.list 2023-09-12T16:10:09.579 INFO:teuthology.orchestra.run.smithi112.stdout:Building xfs 2023-09-12T16:10:09.591 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/xfs/group.list 2023-09-12T16:10:09.837 INFO:teuthology.orchestra.run.smithi112.stdout:Building btrfs 2023-09-12T16:10:09.848 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/btrfs/group.list 2023-09-12T16:10:09.997 INFO:teuthology.orchestra.run.smithi112.stdout:Building tmpfs 2023-09-12T16:10:10.008 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/tmpfs/group.list 2023-09-12T16:10:10.042 INFO:teuthology.orchestra.run.smithi112.stdout:Building selftest 2023-09-12T16:10:10.052 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/selftest/group.list 2023-09-12T16:10:10.087 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo make install) 2023-09-12T16:10:10.187 INFO:teuthology.orchestra.run.smithi112.stdout:Building include 2023-09-12T16:10:10.194 INFO:teuthology.orchestra.run.smithi112.stdout:Building lib 2023-09-12T16:10:10.202 INFO:teuthology.orchestra.run.smithi112.stdout:Building ltp 2023-09-12T16:10:10.210 INFO:teuthology.orchestra.run.smithi112.stdout:Building src 2023-09-12T16:10:10.272 INFO:teuthology.orchestra.run.smithi112.stdout:Building log-writes 2023-09-12T16:10:10.279 INFO:teuthology.orchestra.run.smithi112.stdout:Building perf 2023-09-12T16:10:10.286 INFO:teuthology.orchestra.run.smithi112.stdout:Building aio-dio-regress 2023-09-12T16:10:10.294 INFO:teuthology.orchestra.run.smithi112.stdout:Building vfs 2023-09-12T16:10:10.302 INFO:teuthology.orchestra.run.smithi112.stdout:Building m4 2023-09-12T16:10:10.309 INFO:teuthology.orchestra.run.smithi112.stdout:Building common 2023-09-12T16:10:10.316 INFO:teuthology.orchestra.run.smithi112.stdout:Building tests 2023-09-12T16:10:10.326 INFO:teuthology.orchestra.run.smithi112.stdout:Building perf 2023-09-12T16:10:10.336 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/perf/group.list 2023-09-12T16:10:10.366 INFO:teuthology.orchestra.run.smithi112.stdout:Building ext4 2023-09-12T16:10:10.376 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/ext4/group.list 2023-09-12T16:10:10.471 INFO:teuthology.orchestra.run.smithi112.stdout:Building ocfs2 2023-09-12T16:10:10.481 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/ocfs2/group.list 2023-09-12T16:10:10.515 INFO:teuthology.orchestra.run.smithi112.stdout:Building overlay 2023-09-12T16:10:10.525 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/overlay/group.list 2023-09-12T16:10:10.624 INFO:teuthology.orchestra.run.smithi112.stdout:Building cifs 2023-09-12T16:10:10.634 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/cifs/group.list 2023-09-12T16:10:10.666 INFO:teuthology.orchestra.run.smithi112.stdout:Building generic 2023-09-12T16:10:10.678 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/generic/group.list 2023-09-12T16:10:10.921 INFO:teuthology.orchestra.run.smithi112.stdout:Building shared 2023-09-12T16:10:10.931 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/shared/group.list 2023-09-12T16:10:10.975 INFO:teuthology.orchestra.run.smithi112.stdout:Building nfs 2023-09-12T16:10:10.985 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/nfs/group.list 2023-09-12T16:10:11.022 INFO:teuthology.orchestra.run.smithi112.stdout:Building f2fs 2023-09-12T16:10:11.032 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/f2fs/group.list 2023-09-12T16:10:11.076 INFO:teuthology.orchestra.run.smithi112.stdout:Building udf 2023-09-12T16:10:11.085 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/udf/group.list 2023-09-12T16:10:11.115 INFO:teuthology.orchestra.run.smithi112.stdout:Building ceph 2023-09-12T16:10:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/ceph/group.list 2023-09-12T16:10:11.161 INFO:teuthology.orchestra.run.smithi112.stdout:Building xfs 2023-09-12T16:10:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/xfs/group.list 2023-09-12T16:10:11.414 INFO:teuthology.orchestra.run.smithi112.stdout:Building btrfs 2023-09-12T16:10:11.425 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/btrfs/group.list 2023-09-12T16:10:11.571 INFO:teuthology.orchestra.run.smithi112.stdout:Building tmpfs 2023-09-12T16:10:11.581 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/tmpfs/group.list 2023-09-12T16:10:11.616 INFO:teuthology.orchestra.run.smithi112.stdout:Building selftest 2023-09-12T16:10:11.626 INFO:teuthology.orchestra.run.smithi112.stdout: [GROUP] /tmp/tmp.X1XCSigEoUxfstests-dev/tests/selftest/group.list 2023-09-12T16:10:11.656 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-09-12T16:10:11.659 INFO:teuthology.orchestra.run.smithi112.stdout:gmake[1]: Nothing to be done for 'install'. 2023-09-12T16:10:11.659 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-09-12T16:10:11.662 INFO:teuthology.orchestra.run.smithi112.stdout:gmake[1]: Nothing to be done for 'install'. 2023-09-12T16:10:11.663 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-09-12T16:10:11.666 INFO:teuthology.orchestra.run.smithi112.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-09-12T16:10:11.689 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-09-12T16:10:11.864 INFO:teuthology.orchestra.run.smithi112.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-09-12T16:10:11.888 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-09-12T16:10:11.918 INFO:teuthology.orchestra.run.smithi112.stdout:Building log-writes 2023-09-12T16:10:11.926 INFO:teuthology.orchestra.run.smithi112.stdout:Building perf 2023-09-12T16:10:11.933 INFO:teuthology.orchestra.run.smithi112.stdout:Building aio-dio-regress 2023-09-12T16:10:11.941 INFO:teuthology.orchestra.run.smithi112.stdout:Building vfs 2023-09-12T16:10:11.946 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake -C log-writes install 2023-09-12T16:10:11.949 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-09-12T16:10:11.973 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-09-12T16:10:11.996 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake -C perf install 2023-09-12T16:10:11.999 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-09-12T16:10:12.023 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-09-12T16:10:12.082 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-09-12T16:10:12.085 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-09-12T16:10:12.109 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-dio-append-write-fallocate-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-09-12T16:10:12.252 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake -C vfs install 2023-09-12T16:10:12.254 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-09-12T16:10:12.277 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-09-12T16:10:12.310 INFO:teuthology.orchestra.run.smithi112.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-09-12T16:10:12.333 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-09-12T16:10:15.331 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-09-12T16:10:15.574 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-09-12T16:10:15.630 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-09-12T16:10:15.632 INFO:teuthology.orchestra.run.smithi112.stdout:gmake[1]: Nothing to be done for 'install'. 2023-09-12T16:10:15.633 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-09-12T16:10:15.635 INFO:teuthology.orchestra.run.smithi112.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-09-12T16:10:15.658 INFO:teuthology.orchestra.run.smithi112.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-09-12T16:10:16.022 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-09-12T16:10:16.025 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.X1XCSigEoUxfstests-dev/tests/btrfs/ install 2023-09-12T16:10:16.029 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-09-12T16:10:16.052 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 299 300 /var/lib/xfstests/tests/btrfs 2023-09-12T16:10:18.265 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-09-12T16:10:18.288 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 016.out 175.out 193.out 240.out 180.out 069.out 282.out 092.out 015.out 280.out 140.out 056.out 206.out 008.out 004.out 233.out 194.out 234.out 248.out 033.out 252.out 270.out 148.out 040.out 089.out 296.out 137.out 102.out 096.out 125.out 025.out 152.out 243.out 192.out 075.out 077.out 284.out 052.out 256.out 207.out 228.out 143.out 028.out 183.out 225.out 094.out 046.out 273.out 135.out 086.out 036.out 020.out 215.out 115.out 205.out 250.out 266.out 051.out 011.out 219.out 119.out 244.out 128.out 232.out 195.out 107.out 162.out 185.out 070.out 147.out 288.out 242.out 187.out 024.out 220.out 202.out 002.out 171.out 261.out 156.out 292.out 082.out 072.out 068.out 006.out 048.out 062.out 073.out 129.out 029.out 229.out 211.out 111.out 155.out 275.out 134.out 170.out 260.out 034.out 065.out 161.out 043.out 247.out 216.out 116.out 157.out 274.out 110.out 101.out 238.out 214.out 276.out 295.out 113.out 154.out 038.out 145.out 160.out 091.out 081.out 264.out 061.out 085.out 265.out 300.out 200.out 100.out 165.out 258.out 286.out 269.out 039.out 196.out 098.out 080.out 060.out 209.out 109.out 009.out 167.out 217.out 120.out 191.out 117.out 017.out 246.out 158.out 182.out 066.out 146.out 212.out 188.out 293.out 204.out 104.out 177.out 254.out 281.out 241.out 235.out 268.out 253.out 257.out 124.out 035.out 172.out 278.out 063.out 058.out 262.out 169.out 042.out 297.out 153.out 097.out 283.out 199.out 236.out 186.out 053.out 279.out 133.out 164.out 239.out 189.out 037.out 139.out 178.out 141.out 114.out 074.out 041.out 223.out 150.out 132.out 179.out 144.out 032.out 277.out 136.out 005.out 176.out 198.out 108.out 190.out 173.out 050.out 105.out 106.out 291.out 084.out 067.out 044.out 088.out 285.out 123.out 201.out 019.out 001.out 287.out 142.out 237.out 151.out 231.out 163.out 131.out 213.out 095.out 013.out 031.out 027.out 057.out 272.out 078.out 184.out 259.out 210.out 227.out 197.out 010.out 263.out 127.out 230.out 071.out 083.out 130.out 023.out 099.out 030.out 203.out 103.out 003.out 055.out 166.out 245.out 014.out 222.out 159.out 249.out 122.out 076.out 022.out 289.out 174.out 045.out 064.out 290.out 299.out 224.out 181.out 271.out 149.out 267.out 218.out 118.out 018.out 047.out 168.out 007.out 251.out 093.out 079.out 054.out 059.out 049.out 226.out 208.out 138.out 126.out 026.out 021.out 255.out 090.out 221.out 087.out 294.out 121.out 112.out 012.out /var/lib/xfstests/tests/btrfs 2023-09-12T16:10:20.498 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.X1XCSigEoUxfstests-dev/tests/ceph/ install 2023-09-12T16:10:20.501 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-09-12T16:10:20.524 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-09-12T16:10:20.577 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-09-12T16:10:20.600 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-09-12T16:10:20.653 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.X1XCSigEoUxfstests-dev/tests/cifs/ install 2023-09-12T16:10:20.656 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-09-12T16:10:20.679 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-09-12T16:10:20.702 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-09-12T16:10:20.726 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-09-12T16:10:20.749 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.X1XCSigEoUxfstests-dev/tests/ext4/ install 2023-09-12T16:10:20.752 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-09-12T16:10:20.775 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-09-12T16:10:21.288 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-09-12T16:10:21.311 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 005.out 026.out 308.out 008.out 040.out 304.out 007.out 021.out 016.out 037.out 044.out 012.out 009.out 033.out 057.out 050.out 301.out 019.out 034.out 046.out 058.out 047.out 302.out 020.out 002.out 024.out 013.out 031.out 025.out 306.out 017.out 004.out 048.out 038.out 056.out 042.out 052.out 307.out 029.out 011.out 027.out 303.out 003.out 045.out 055.out 053.out 035.out 043.out 059.out 010.out 023.out 022.out 014.out 006.out 015.out 305.out 036.out 271.out 051.out 041.out 030.out 018.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-09-12T16:10:21.849 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.X1XCSigEoUxfstests-dev/tests/f2fs/ install 2023-09-12T16:10:21.852 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-09-12T16:10:21.876 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-09-12T16:10:21.906 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-09-12T16:10:21.930 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-09-12T16:10:21.962 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.X1XCSigEoUxfstests-dev/tests/generic/ install 2023-09-12T16:10:21.967 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-09-12T16:10:21.991 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 /var/lib/xfstests/tests/generic 2023-09-12T16:10:24.494 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:10:24.500 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:10:27.381 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-09-12T16:10:27.405 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 050.out.xfsquota 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 537.out 194.out 133.out 683.out 033.out 489.out 696.out 237.out 502.out 310.out 202.out 137.out 586.out 181.out 664.out 571.out 126.out 243.out 592.out 282.out 272.out 728.out 178.out 628.out 528.out 607.out 428.out 507.out 407.out 328.out 171.out 028.out 620.out 273.out 570.out 468.out 182.out 265.out 420.out 492.out 120.out 059.out 595.out 346.out 466.out 443.out 700.out 632.out 652.out 311.out 655.out 591.out 064.out 719.out 432.out 255.out 623.out 371.out 319.out 177.out 523.out 119.out 423.out 232.out 547.out 673.out 260.out 312.out 718.out 034.out 465.out 716.out 616.out 246.out 416.out 247.out 216.out 116.out 041.out 358.out 338.out 287.out 238.out 295.out 390.out 497.out 160.out 691.out 274.out 061.out 239.out 457.out 025.out 530.out 258.out 362.out 039.out 098.out 690.out 573.out 706.out 606.out 506.out 406.out 306.out 106.out 642.out 217.out 446.out 017.out 211.out 130.out 158.out 370.out 442.out 188.out 640.out 199.out 467.out 281.out 174.out 163.out 324.out 224.out 355.out 124.out 672.out 278.out 058.out 384.out 296.out 042.out 193.out 097.out 271.out 283.out 541.out 709.out 609.out 045.out 509.out 309.out 391.out 441.out 009.out 356.out 341.out 494.out 189.out 037.out 555.out 712.out 241.out 501.out 612.out 540.out 084.out 412.out 614.out 514.out 414.out 314.out 440.out 114.out 316.out 014.out 026.out 012.out 634.out 340.out 156.out 572.out 240.out 180.out 549.out 633.out 321.out 140.out 348.out 568.out 185.out 408.out 308.out 566.out 433.out 704.out 108.out 504.out 404.out 304.out 104.out 175.out 096.out 297.out 393.out 333.out 599.out 476.out 099.out 233.out 639.out 107.out 086.out 053.out 500.out 164.out 339.out 294.out 352.out 498.out 139.out 267.out 317.out 399.out 220.out 552.out 695.out 480.out 436.out 544.out 169.out 593.out 067.out 186.out 187.out 679.out 252.out 585.out 003.out 376.out 724.out 206.out 663.out 394.out 651.out 248.out 533.out 625.out 525.out 670.out 488.out 040.out 325.out 551.out 225.out 636.out 125.out 142.out 715.out 279.out 515.out 650.out 152.out 658.out 563.out 215.out 451.out 015.out 392.out 682.out 472.out 684.out 674.out 550.out 052.out 351.out 430.out 276.out 094.out 266.out 450.out 463.out 157.out 600.out 349.out 444.out 644.out 487.out 688.out 643.out 615.out 395.out 151.out 415.out 315.out 344.out 115.out 539.out 179.out 542.out 250.out 705.out 475.out 536.out 228.out 518.out 101.out 030.out 244.out 385.out 005.out 336.out 579.out 236.out 405.out 365.out 205.out 136.out 598.out 036.out 198.out 723.out 008.out 680.out 605.out 505.out 305.out 105.out 263.out 144.out 291.out 437.out 044.out 619.out 721.out 323.out 685.out 088.out 382.out 337.out 219.out 527.out 019.out 577.out 481.out 574.out 556.out 332.out 060.out 521.out 027.out 191.out 582.out 372.out 478.out 584.out 462.out 597.out 350.out 132.out 693.out 638.out 448.out 660.out 676.out 063.out 561.out 214.out 074.out 648.out 387.out 594.out 335.out 438.out 076.out 289.out 699.out 545.out 516.out 477.out 621.out 519.out 290.out 548.out 560.out 166.out 707.out 461.out 381.out 445.out 647.out 626.out 380.out 562.out 526.out 479.out 426.out 192.out 150.out 613.out 326.out 082.out 226.out 668.out 454.out 121.out 447.out 499.out 580.out 460.out 485.out 694.out 347.out 077.out 361.out 564.out 455.out 089.out 558.out 162.out 686.out 147.out 173.out 197.out 396.out 051.out 354.out 298.out 024.out 148.out 360.out 543.out 270.out 261.out 251.out 657.out 692.out 482.out 046.out 726.out 729.out 378.out 004.out 458.out 062.out 529.out 231.out 343.out 662.out 503.out 329.out 334.out 590.out 254.out 363.out 131.out 155.out 661.out 368.out 486.out 223.out 123.out 669.out 023.out 459.out 032.out 277.out 398.out 366.out 161.out 190.out 280.out 470.out 484.out 257.out 006.out 016.out 091.out 201.out 656.out 227.out 731.out 374.out 583.out 285.out 127.out 256.out 654.out 389.out 649.out 301.out 431.out 635.out 288.out 722.out 331.out 128.out 377.out 713.out 535.out 513.out 554.out 622.out 313.out 213.out 730.out 113.out 013.out 031.out 435.out 630.out 645.out 057.out 727.out 078.out 510.out 627.out 184.out 534.out 427.out 210.out 449.out 327.out 330.out 493.out 604.out 419.out 230.out 071.out 083.out 292.out 299.out 434.out 575.out 073.out 603.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 532.out 245.out 522.out 422.out 624.out 322.out 222.out 159.out 524.out 122.out 689.out 234.out 022.out 424.out 637.out 578.out 490.out 439.out 517.out 154.out 149.out 618.out 675.out 418.out 318.out 264.out 218.out 118.out 018.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 569.out 456.out 268.out 421.out 667.out 512.out 221.out 087.out 212.out 538.out 112.out 342.out 021.out 195.out 388.out 483.out 397.out 070.out 596.out 720.out 565.out 196.out 520.out 242.out 576.out 587.out 320.out 629.out 702.out 602.out 153.out 402.out 302.out 020.out 102.out 002.out 717.out 617.out 129.out 429.out 417.out 138.out 167.out 092.out 117.out 357.out 072.out 068.out 143.out 229.out 038.out 473.out 369.out 711.out 262.out 611.out 511.out 411.out 029.out 111.out 011.out 659.out 183.out 170.out 065.out 286.out 043.out 056.out 714.out 559.out 710.out 610.out 687.out 413.out 410.out 701.out 601.out 401.out 110.out 010.out 001.out 141.out 495.out 048.out 665.out 589.out 095.out 581.out 697.out 145.out 641.out 464.out 491.out 081.out 075.out 653.out 671.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 677.out 698.out 553.out 375.out 259.out 090.out 080.out 708.out 608.out 508.out 409.out 307.out 209.out 109.out 007.out 567.out 284.out 557.out 453.out 666.out 364.out 725.out 383.out 085.out 066.out 588.out 146.out 631.out 204.out 353.out 425.out 069.out 093.out 681.out 249.out 207.out 531.out 235.out 646.out 474.out 703.out 253.out 275.out 678.out 496.out 373.out 176.out 134.out 452.out /var/lib/xfstests/tests/generic 2023-09-12T16:10:32.851 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.X1XCSigEoUxfstests-dev/tests/nfs/ install 2023-09-12T16:10:32.854 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-09-12T16:10:32.877 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-09-12T16:10:32.901 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-09-12T16:10:32.924 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-09-12T16:10:32.948 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.X1XCSigEoUxfstests-dev/tests/ocfs2/ install 2023-09-12T16:10:32.951 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-09-12T16:10:32.974 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-09-12T16:10:32.997 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-09-12T16:10:33.021 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-09-12T16:10:33.045 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.X1XCSigEoUxfstests-dev/tests/overlay/ install 2023-09-12T16:10:33.048 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-09-12T16:10:33.072 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-09-12T16:10:33.803 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-09-12T16:10:33.827 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 067.out 018.out 024.out 010.out 065.out 020.out 102.out 002.out 113.out 013.out 031.out 045.out 117.out 046.out 075.out 072.out 068.out 063.out 014.out 062.out 038.out 042.out 052.out 029.out 027.out 043.out 112.out 073.out 078.out 037.out 030.out 058.out 103.out 003.out 004.out 055.out 053.out 109.out 035.out 116.out 016.out 059.out 101.out 001.out 023.out 047.out 076.out 022.out 074.out 006.out 044.out 115.out 015.out 064.out 114.out 026.out 071.out 111.out 061.out 011.out 041.out 048.out 100.out 019.out 007.out 028.out 079.out 069.out 054.out 049.out 032.out 039.out 077.out 105.out 080.out 107.out 025.out 056.out 108.out 070.out 060.out 008.out 040.out 106.out 005.out 021.out 017.out 012.out 057.out 009.out 033.out 066.out 050.out 036.out 051.out 034.out 104.out 110.out /var/lib/xfstests/tests/overlay 2023-09-12T16:10:34.564 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.X1XCSigEoUxfstests-dev/tests/perf/ install 2023-09-12T16:10:34.567 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-09-12T16:10:34.590 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-09-12T16:10:34.614 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-09-12T16:10:34.637 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-09-12T16:10:34.661 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.X1XCSigEoUxfstests-dev/tests/selftest/ install 2023-09-12T16:10:34.663 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-09-12T16:10:34.687 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-09-12T16:10:34.746 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-09-12T16:10:34.769 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-09-12T16:10:34.829 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.X1XCSigEoUxfstests-dev/tests/shared/ install 2023-09-12T16:10:34.832 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-09-12T16:10:34.855 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-09-12T16:10:34.894 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-09-12T16:10:34.917 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-09-12T16:10:34.956 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.X1XCSigEoUxfstests-dev/tests/tmpfs/ install 2023-09-12T16:10:34.958 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-09-12T16:10:34.981 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-09-12T16:10:35.005 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-09-12T16:10:35.029 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-09-12T16:10:35.053 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.X1XCSigEoUxfstests-dev/tests/udf/ install 2023-09-12T16:10:35.056 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-09-12T16:10:35.079 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-09-12T16:10:35.103 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-09-12T16:10:35.126 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-09-12T16:10:35.150 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.X1XCSigEoUxfstests-dev/tests/xfs/ install 2023-09-12T16:10:35.156 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-09-12T16:10:35.179 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-09-12T16:10:40.297 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-09-12T16:10:40.321 INFO:teuthology.orchestra.run.smithi112.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 737.out 108.out 504.out 404.out 104.out 004.out 377.out 537.out 194.out 158.out 337.out 082.out 237.out 473.out 502.out 088.out 202.out 137.out 102.out 746.out 110.out 586.out 181.out 571.out 264.out 567.out 592.out 282.out 266.out 728.out 178.out 528.out 769.out 428.out 507.out 407.out 328.out 171.out 028.out 046.out 273.out 570.out 468.out 017.out 059.out 346.out 732.out 784.out 443.out 411.out 532.out 591.out 064.out 471.out 111.out 432.out 255.out 371.out 319.out 177.out 523.out 119.out 775.out 232.out 590.out 363.out 131.out 183.out 547.out 738.out 260.out 034.out 757.out 716.out 161.out 246.out 416.out 247.out 116.out 016.out 041.out 358.out 338.out 287.out 099.out 238.out 065.out 566.out 295.out 138.out 765.out 160.out 291.out 274.out 722.out 061.out 239.out 457.out 025.out 772.out 530.out 258.out 322.out 039.out 498.out 098.out 517.out 573.out 060.out 506.out 406.out 306.out 106.out 006.out 003.out 217.out 120.out 191.out 133.out 455.out 130.out 442.out 188.out 030.out 199.out 595.out 467.out 281.out 242.out 163.out 771.out 324.out 224.out 050.out 764.out 124.out 382.out 278.out 058.out 741.out 384.out 042.out 497.out 193.out 097.out 392.out 271.out 283.out 541.out 770.out 709.out 755.out 441.out 157.out 740.out 356.out 474.out 341.out 494.out 189.out 555.out 241.out 540.out 077.out 412.out 514.out 414.out 314.out 440.out 114.out 316.out 074.out 147.out 012.out 155.out 340.out 793.out 156.out 572.out 568.out 240.out 279.out 180.out 733.out 788.out 280.out 434.out 140.out 766.out 185.out 408.out 308.out 254.out 335.out 207.out 531.out 235.out 556.out 253.out 503.out 418.out 275.out 272.out 751.out 433.out 036.out 134.out 393.out 333.out 599.out 476.out 535.out 739.out 233.out 752.out 736.out 107.out 053.out 164.out 587.out 339.out 294.out 521.out 352.out 799.out 489.out 139.out 774.out 481.out 267.out 390.out 399.out 781.out 357.out 169.out 175.out 593.out 565.out 186.out 452.out 252.out 585.out 167.out 724.out 206.out 794.out 348.out 394.out 509.out 466.out 248.out 785.out 424.out 750.out 525.out 488.out 040.out 325.out 551.out 225.out 125.out 142.out 715.out 789.out 581.out 415.out 152.out 563.out 215.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 351.out 430.out 583.out 290.out 094.out 450.out 744.out 043.out 086.out 349.out 444.out 500.out 487.out 762.out 544.out 395.out 515.out 451.out 389.out 315.out 344.out 115.out 015.out 542.out 250.out 791.out 475.out 536.out 228.out 518.out 101.out 439.out 244.out 128.out 385.out 005.out 336.out 150.out 579.out 236.out 405.out 305.out 580.out 136.out 598.out 176.out 198.out 723.out 008.out 790.out 505.out 588.out 205.out 105.out 144.out 768.out 437.out 037.out 044.out 719.out 381.out 721.out 323.out 519.out 419.out 219.out 527.out 056.out 019.out 577.out 151.out 760.out 574.out 332.out 796.out 027.out 372.out 584.out 462.out 220.out 597.out 350.out 132.out 312.out 492.out 745.out 076.out 112.out 063.out 561.out 214.out 776.out 014.out 758.out 362.out 387.out 594.out 438.out 265.out 289.out 554.out 516.out 477.out 548.out 560.out 166.out 461.out 445.out 296.out 307.out 493.out 786.out 007.out 448.out 251.out 380.out 562.out 526.out 479.out 426.out 192.out 326.out 226.out 454.out 126.out 121.out 447.out 761.out 773.out 460.out 485.out 347.out 035.out 361.out 564.out 748.out 795.out 089.out 747.out 558.out 162.out 743.out 288.out 197.out 396.out 576.out 051.out 354.out 355.out 575.out 446.out 148.out 129.out 360.out 543.out 263.out 270.out 261.out 734.out 045.out 292.out 482.out 726.out 729.out 378.out 458.out 062.out 249.out 231.out 343.out 334.out 368.out 486.out 223.out 123.out 023.out 459.out 032.out 798.out 277.out 373.out 146.out 398.out 366.out 085.out 427.out 190.out 173.out 470.out 484.out 754.out 767.out 749.out 187.out 091.out 201.out 725.out 731.out 782.out 374.out 285.out 127.out 256.out 501.out 301.out 431.out 068.out 331.out 179.out 713.out 024.out 513.out 413.out 313.out 549.out 213.out 730.out 113.out 013.out 031.out 435.out 182.out 057.out 727.out 078.out 510.out 184.out 797.out 534.out 545.out 210.out 449.out 327.out 330.out 067.out 227.out 230.out 083.out 299.out 073.out 370.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 742.out 245.out 243.out 522.out 787.out 422.out 222.out 159.out 539.out 524.out 122.out 234.out 022.out 174.out 779.out 490.out 090.out 423.out 154.out 718.out 149.out 318.out 465.out 218.out 118.out 018.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 569.out 456.out 268.out 421.out 712.out 321.out 533.out 512.out 221.out 087.out 212.out 538.out 342.out 021.out 195.out 388.out 483.out 397.out 070.out 596.out 720.out 329.out 196.out 520.out 026.out 420.out 478.out 320.out 499.out 153.out 402.out 302.out 020.out 529.out 002.out 717.out 429.out 417.out 317.out 365.out 092.out 117.out 759.out 072.out 778.out 143.out 229.out 038.out 084.out 369.out 711.out 262.out 511.out 029.out 311.out 211.out 011.out 783.out 170.out 286.out 756.out 496.out 376.out 714.out 559.out 710.out 410.out 310.out 401.out 010.out 001.out 141.out 495.out 048.out 276.out 589.out 753.out 095.out 297.out 480.out 145.out 257.out 464.out 491.out 081.out 800.out 777.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 780.out 553.out 763.out 375.out 298.out 259.out 080.out 708.out 508.out 409.out 309.out 209.out 109.out 009.out 391.out 284.out 557.out 453.out 364.out 582.out 735.out 383.out 066.out 552.out 304.out 204.out 353.out 425.out 069.out 093.out /var/lib/xfstests/tests/xfs 2023-09-12T16:10:45.479 INFO:teuthology.orchestra.run.smithi112.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-09-12T16:10:45.502 INFO:teuthology.orchestra.run.smithi112.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-09-12T16:10:45.525 INFO:teuthology.orchestra.run.smithi112.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-09-12T16:10:45.549 INFO:teuthology.orchestra.run.smithi112.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-09-12T16:10:45.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T16:10:45.577 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec ls tests/generic) 2023-09-12T16:10:45.626 INFO:teuthology.orchestra.run.smithi112.stdout:001 2023-09-12T16:10:45.626 INFO:teuthology.orchestra.run.smithi112.stdout:001.out 2023-09-12T16:10:45.627 INFO:teuthology.orchestra.run.smithi112.stdout:002 2023-09-12T16:10:45.627 INFO:teuthology.orchestra.run.smithi112.stdout:002.out 2023-09-12T16:10:45.627 INFO:teuthology.orchestra.run.smithi112.stdout:003 2023-09-12T16:10:45.627 INFO:teuthology.orchestra.run.smithi112.stdout:003.out 2023-09-12T16:10:45.628 INFO:teuthology.orchestra.run.smithi112.stdout:004 2023-09-12T16:10:45.628 INFO:teuthology.orchestra.run.smithi112.stdout:004.out 2023-09-12T16:10:45.628 INFO:teuthology.orchestra.run.smithi112.stdout:005 2023-09-12T16:10:45.628 INFO:teuthology.orchestra.run.smithi112.stdout:005.out 2023-09-12T16:10:45.628 INFO:teuthology.orchestra.run.smithi112.stdout:006 2023-09-12T16:10:45.628 INFO:teuthology.orchestra.run.smithi112.stdout:006.out 2023-09-12T16:10:45.629 INFO:teuthology.orchestra.run.smithi112.stdout:007 2023-09-12T16:10:45.629 INFO:teuthology.orchestra.run.smithi112.stdout:007.out 2023-09-12T16:10:45.629 INFO:teuthology.orchestra.run.smithi112.stdout:008 2023-09-12T16:10:45.629 INFO:teuthology.orchestra.run.smithi112.stdout:008.out 2023-09-12T16:10:45.629 INFO:teuthology.orchestra.run.smithi112.stdout:009 2023-09-12T16:10:45.630 INFO:teuthology.orchestra.run.smithi112.stdout:009.out 2023-09-12T16:10:45.630 INFO:teuthology.orchestra.run.smithi112.stdout:010 2023-09-12T16:10:45.630 INFO:teuthology.orchestra.run.smithi112.stdout:010.out 2023-09-12T16:10:45.630 INFO:teuthology.orchestra.run.smithi112.stdout:011 2023-09-12T16:10:45.630 INFO:teuthology.orchestra.run.smithi112.stdout:011.out 2023-09-12T16:10:45.631 INFO:teuthology.orchestra.run.smithi112.stdout:012 2023-09-12T16:10:45.631 INFO:teuthology.orchestra.run.smithi112.stdout:012.out 2023-09-12T16:10:45.631 INFO:teuthology.orchestra.run.smithi112.stdout:013 2023-09-12T16:10:45.631 INFO:teuthology.orchestra.run.smithi112.stdout:013.out 2023-09-12T16:10:45.631 INFO:teuthology.orchestra.run.smithi112.stdout:014 2023-09-12T16:10:45.631 INFO:teuthology.orchestra.run.smithi112.stdout:014.out 2023-09-12T16:10:45.632 INFO:teuthology.orchestra.run.smithi112.stdout:015 2023-09-12T16:10:45.632 INFO:teuthology.orchestra.run.smithi112.stdout:015.out 2023-09-12T16:10:45.632 INFO:teuthology.orchestra.run.smithi112.stdout:016 2023-09-12T16:10:45.632 INFO:teuthology.orchestra.run.smithi112.stdout:016.out 2023-09-12T16:10:45.632 INFO:teuthology.orchestra.run.smithi112.stdout:017 2023-09-12T16:10:45.633 INFO:teuthology.orchestra.run.smithi112.stdout:017.out 2023-09-12T16:10:45.633 INFO:teuthology.orchestra.run.smithi112.stdout:018 2023-09-12T16:10:45.633 INFO:teuthology.orchestra.run.smithi112.stdout:018.out 2023-09-12T16:10:45.633 INFO:teuthology.orchestra.run.smithi112.stdout:019 2023-09-12T16:10:45.633 INFO:teuthology.orchestra.run.smithi112.stdout:019.out 2023-09-12T16:10:45.634 INFO:teuthology.orchestra.run.smithi112.stdout:020 2023-09-12T16:10:45.634 INFO:teuthology.orchestra.run.smithi112.stdout:020.out 2023-09-12T16:10:45.634 INFO:teuthology.orchestra.run.smithi112.stdout:021 2023-09-12T16:10:45.634 INFO:teuthology.orchestra.run.smithi112.stdout:021.out 2023-09-12T16:10:45.634 INFO:teuthology.orchestra.run.smithi112.stdout:022 2023-09-12T16:10:45.635 INFO:teuthology.orchestra.run.smithi112.stdout:022.out 2023-09-12T16:10:45.635 INFO:teuthology.orchestra.run.smithi112.stdout:023 2023-09-12T16:10:45.635 INFO:teuthology.orchestra.run.smithi112.stdout:023.out 2023-09-12T16:10:45.635 INFO:teuthology.orchestra.run.smithi112.stdout:024 2023-09-12T16:10:45.635 INFO:teuthology.orchestra.run.smithi112.stdout:024.out 2023-09-12T16:10:45.636 INFO:teuthology.orchestra.run.smithi112.stdout:025 2023-09-12T16:10:45.636 INFO:teuthology.orchestra.run.smithi112.stdout:025.out 2023-09-12T16:10:45.636 INFO:teuthology.orchestra.run.smithi112.stdout:026 2023-09-12T16:10:45.636 INFO:teuthology.orchestra.run.smithi112.stdout:026.out 2023-09-12T16:10:45.636 INFO:teuthology.orchestra.run.smithi112.stdout:027 2023-09-12T16:10:45.636 INFO:teuthology.orchestra.run.smithi112.stdout:027.out 2023-09-12T16:10:45.637 INFO:teuthology.orchestra.run.smithi112.stdout:028 2023-09-12T16:10:45.637 INFO:teuthology.orchestra.run.smithi112.stdout:028.out 2023-09-12T16:10:45.637 INFO:teuthology.orchestra.run.smithi112.stdout:029 2023-09-12T16:10:45.637 INFO:teuthology.orchestra.run.smithi112.stdout:029.out 2023-09-12T16:10:45.637 INFO:teuthology.orchestra.run.smithi112.stdout:030 2023-09-12T16:10:45.638 INFO:teuthology.orchestra.run.smithi112.stdout:030.out 2023-09-12T16:10:45.638 INFO:teuthology.orchestra.run.smithi112.stdout:031 2023-09-12T16:10:45.638 INFO:teuthology.orchestra.run.smithi112.stdout:031.out 2023-09-12T16:10:45.638 INFO:teuthology.orchestra.run.smithi112.stdout:032 2023-09-12T16:10:45.638 INFO:teuthology.orchestra.run.smithi112.stdout:032.out 2023-09-12T16:10:45.639 INFO:teuthology.orchestra.run.smithi112.stdout:033 2023-09-12T16:10:45.639 INFO:teuthology.orchestra.run.smithi112.stdout:033.out 2023-09-12T16:10:45.639 INFO:teuthology.orchestra.run.smithi112.stdout:034 2023-09-12T16:10:45.639 INFO:teuthology.orchestra.run.smithi112.stdout:034.out 2023-09-12T16:10:45.639 INFO:teuthology.orchestra.run.smithi112.stdout:035 2023-09-12T16:10:45.639 INFO:teuthology.orchestra.run.smithi112.stdout:035.cfg 2023-09-12T16:10:45.640 INFO:teuthology.orchestra.run.smithi112.stdout:035.out.default 2023-09-12T16:10:45.640 INFO:teuthology.orchestra.run.smithi112.stdout:035.out.nfs 2023-09-12T16:10:45.640 INFO:teuthology.orchestra.run.smithi112.stdout:036 2023-09-12T16:10:45.640 INFO:teuthology.orchestra.run.smithi112.stdout:036.out 2023-09-12T16:10:45.640 INFO:teuthology.orchestra.run.smithi112.stdout:037 2023-09-12T16:10:45.641 INFO:teuthology.orchestra.run.smithi112.stdout:037.out 2023-09-12T16:10:45.641 INFO:teuthology.orchestra.run.smithi112.stdout:038 2023-09-12T16:10:45.641 INFO:teuthology.orchestra.run.smithi112.stdout:038.out 2023-09-12T16:10:45.641 INFO:teuthology.orchestra.run.smithi112.stdout:039 2023-09-12T16:10:45.641 INFO:teuthology.orchestra.run.smithi112.stdout:039.out 2023-09-12T16:10:45.642 INFO:teuthology.orchestra.run.smithi112.stdout:040 2023-09-12T16:10:45.642 INFO:teuthology.orchestra.run.smithi112.stdout:040.out 2023-09-12T16:10:45.642 INFO:teuthology.orchestra.run.smithi112.stdout:041 2023-09-12T16:10:45.642 INFO:teuthology.orchestra.run.smithi112.stdout:041.out 2023-09-12T16:10:45.642 INFO:teuthology.orchestra.run.smithi112.stdout:042 2023-09-12T16:10:45.643 INFO:teuthology.orchestra.run.smithi112.stdout:042.out 2023-09-12T16:10:45.643 INFO:teuthology.orchestra.run.smithi112.stdout:043 2023-09-12T16:10:45.643 INFO:teuthology.orchestra.run.smithi112.stdout:043.out 2023-09-12T16:10:45.643 INFO:teuthology.orchestra.run.smithi112.stdout:044 2023-09-12T16:10:45.643 INFO:teuthology.orchestra.run.smithi112.stdout:044.out 2023-09-12T16:10:45.643 INFO:teuthology.orchestra.run.smithi112.stdout:045 2023-09-12T16:10:45.644 INFO:teuthology.orchestra.run.smithi112.stdout:045.out 2023-09-12T16:10:45.644 INFO:teuthology.orchestra.run.smithi112.stdout:046 2023-09-12T16:10:45.644 INFO:teuthology.orchestra.run.smithi112.stdout:046.out 2023-09-12T16:10:45.644 INFO:teuthology.orchestra.run.smithi112.stdout:047 2023-09-12T16:10:45.644 INFO:teuthology.orchestra.run.smithi112.stdout:047.out 2023-09-12T16:10:45.645 INFO:teuthology.orchestra.run.smithi112.stdout:048 2023-09-12T16:10:45.645 INFO:teuthology.orchestra.run.smithi112.stdout:048.out 2023-09-12T16:10:45.645 INFO:teuthology.orchestra.run.smithi112.stdout:049 2023-09-12T16:10:45.645 INFO:teuthology.orchestra.run.smithi112.stdout:049.out 2023-09-12T16:10:45.645 INFO:teuthology.orchestra.run.smithi112.stdout:050 2023-09-12T16:10:45.646 INFO:teuthology.orchestra.run.smithi112.stdout:050.cfg 2023-09-12T16:10:45.646 INFO:teuthology.orchestra.run.smithi112.stdout:050.out.default 2023-09-12T16:10:45.646 INFO:teuthology.orchestra.run.smithi112.stdout:050.out.nojournal 2023-09-12T16:10:45.646 INFO:teuthology.orchestra.run.smithi112.stdout:050.out.xfsquota 2023-09-12T16:10:45.646 INFO:teuthology.orchestra.run.smithi112.stdout:051 2023-09-12T16:10:45.647 INFO:teuthology.orchestra.run.smithi112.stdout:051.out 2023-09-12T16:10:45.647 INFO:teuthology.orchestra.run.smithi112.stdout:052 2023-09-12T16:10:45.647 INFO:teuthology.orchestra.run.smithi112.stdout:052.out 2023-09-12T16:10:45.647 INFO:teuthology.orchestra.run.smithi112.stdout:053 2023-09-12T16:10:45.647 INFO:teuthology.orchestra.run.smithi112.stdout:053.out 2023-09-12T16:10:45.648 INFO:teuthology.orchestra.run.smithi112.stdout:054 2023-09-12T16:10:45.648 INFO:teuthology.orchestra.run.smithi112.stdout:054.out 2023-09-12T16:10:45.648 INFO:teuthology.orchestra.run.smithi112.stdout:055 2023-09-12T16:10:45.648 INFO:teuthology.orchestra.run.smithi112.stdout:055.out 2023-09-12T16:10:45.648 INFO:teuthology.orchestra.run.smithi112.stdout:056 2023-09-12T16:10:45.648 INFO:teuthology.orchestra.run.smithi112.stdout:056.out 2023-09-12T16:10:45.649 INFO:teuthology.orchestra.run.smithi112.stdout:057 2023-09-12T16:10:45.649 INFO:teuthology.orchestra.run.smithi112.stdout:057.out 2023-09-12T16:10:45.649 INFO:teuthology.orchestra.run.smithi112.stdout:058 2023-09-12T16:10:45.649 INFO:teuthology.orchestra.run.smithi112.stdout:058.out 2023-09-12T16:10:45.649 INFO:teuthology.orchestra.run.smithi112.stdout:059 2023-09-12T16:10:45.650 INFO:teuthology.orchestra.run.smithi112.stdout:059.out 2023-09-12T16:10:45.650 INFO:teuthology.orchestra.run.smithi112.stdout:060 2023-09-12T16:10:45.650 INFO:teuthology.orchestra.run.smithi112.stdout:060.out 2023-09-12T16:10:45.650 INFO:teuthology.orchestra.run.smithi112.stdout:061 2023-09-12T16:10:45.650 INFO:teuthology.orchestra.run.smithi112.stdout:061.out 2023-09-12T16:10:45.651 INFO:teuthology.orchestra.run.smithi112.stdout:062 2023-09-12T16:10:45.651 INFO:teuthology.orchestra.run.smithi112.stdout:062.out 2023-09-12T16:10:45.651 INFO:teuthology.orchestra.run.smithi112.stdout:063 2023-09-12T16:10:45.651 INFO:teuthology.orchestra.run.smithi112.stdout:063.out 2023-09-12T16:10:45.651 INFO:teuthology.orchestra.run.smithi112.stdout:064 2023-09-12T16:10:45.652 INFO:teuthology.orchestra.run.smithi112.stdout:064.out 2023-09-12T16:10:45.652 INFO:teuthology.orchestra.run.smithi112.stdout:065 2023-09-12T16:10:45.652 INFO:teuthology.orchestra.run.smithi112.stdout:065.out 2023-09-12T16:10:45.652 INFO:teuthology.orchestra.run.smithi112.stdout:066 2023-09-12T16:10:45.652 INFO:teuthology.orchestra.run.smithi112.stdout:066.out 2023-09-12T16:10:45.652 INFO:teuthology.orchestra.run.smithi112.stdout:067 2023-09-12T16:10:45.653 INFO:teuthology.orchestra.run.smithi112.stdout:067.out 2023-09-12T16:10:45.653 INFO:teuthology.orchestra.run.smithi112.stdout:068 2023-09-12T16:10:45.653 INFO:teuthology.orchestra.run.smithi112.stdout:068.out 2023-09-12T16:10:45.653 INFO:teuthology.orchestra.run.smithi112.stdout:069 2023-09-12T16:10:45.653 INFO:teuthology.orchestra.run.smithi112.stdout:069.out 2023-09-12T16:10:45.654 INFO:teuthology.orchestra.run.smithi112.stdout:070 2023-09-12T16:10:45.654 INFO:teuthology.orchestra.run.smithi112.stdout:070.out 2023-09-12T16:10:45.654 INFO:teuthology.orchestra.run.smithi112.stdout:071 2023-09-12T16:10:45.654 INFO:teuthology.orchestra.run.smithi112.stdout:071.out 2023-09-12T16:10:45.654 INFO:teuthology.orchestra.run.smithi112.stdout:072 2023-09-12T16:10:45.654 INFO:teuthology.orchestra.run.smithi112.stdout:072.out 2023-09-12T16:10:45.655 INFO:teuthology.orchestra.run.smithi112.stdout:073 2023-09-12T16:10:45.655 INFO:teuthology.orchestra.run.smithi112.stdout:073.out 2023-09-12T16:10:45.655 INFO:teuthology.orchestra.run.smithi112.stdout:074 2023-09-12T16:10:45.655 INFO:teuthology.orchestra.run.smithi112.stdout:074.out 2023-09-12T16:10:45.655 INFO:teuthology.orchestra.run.smithi112.stdout:075 2023-09-12T16:10:45.656 INFO:teuthology.orchestra.run.smithi112.stdout:075.out 2023-09-12T16:10:45.656 INFO:teuthology.orchestra.run.smithi112.stdout:076 2023-09-12T16:10:45.656 INFO:teuthology.orchestra.run.smithi112.stdout:076.out 2023-09-12T16:10:45.656 INFO:teuthology.orchestra.run.smithi112.stdout:077 2023-09-12T16:10:45.656 INFO:teuthology.orchestra.run.smithi112.stdout:077.out 2023-09-12T16:10:45.657 INFO:teuthology.orchestra.run.smithi112.stdout:078 2023-09-12T16:10:45.657 INFO:teuthology.orchestra.run.smithi112.stdout:078.out 2023-09-12T16:10:45.657 INFO:teuthology.orchestra.run.smithi112.stdout:079 2023-09-12T16:10:45.657 INFO:teuthology.orchestra.run.smithi112.stdout:079.out 2023-09-12T16:10:45.657 INFO:teuthology.orchestra.run.smithi112.stdout:080 2023-09-12T16:10:45.658 INFO:teuthology.orchestra.run.smithi112.stdout:080.out 2023-09-12T16:10:45.658 INFO:teuthology.orchestra.run.smithi112.stdout:081 2023-09-12T16:10:45.658 INFO:teuthology.orchestra.run.smithi112.stdout:081.out 2023-09-12T16:10:45.658 INFO:teuthology.orchestra.run.smithi112.stdout:082 2023-09-12T16:10:45.658 INFO:teuthology.orchestra.run.smithi112.stdout:082.out 2023-09-12T16:10:45.659 INFO:teuthology.orchestra.run.smithi112.stdout:083 2023-09-12T16:10:45.659 INFO:teuthology.orchestra.run.smithi112.stdout:083.out 2023-09-12T16:10:45.659 INFO:teuthology.orchestra.run.smithi112.stdout:084 2023-09-12T16:10:45.659 INFO:teuthology.orchestra.run.smithi112.stdout:084.out 2023-09-12T16:10:45.659 INFO:teuthology.orchestra.run.smithi112.stdout:085 2023-09-12T16:10:45.659 INFO:teuthology.orchestra.run.smithi112.stdout:085.out 2023-09-12T16:10:45.660 INFO:teuthology.orchestra.run.smithi112.stdout:086 2023-09-12T16:10:45.660 INFO:teuthology.orchestra.run.smithi112.stdout:086.out 2023-09-12T16:10:45.660 INFO:teuthology.orchestra.run.smithi112.stdout:087 2023-09-12T16:10:45.660 INFO:teuthology.orchestra.run.smithi112.stdout:087.out 2023-09-12T16:10:45.660 INFO:teuthology.orchestra.run.smithi112.stdout:088 2023-09-12T16:10:45.661 INFO:teuthology.orchestra.run.smithi112.stdout:088.out 2023-09-12T16:10:45.661 INFO:teuthology.orchestra.run.smithi112.stdout:089 2023-09-12T16:10:45.661 INFO:teuthology.orchestra.run.smithi112.stdout:089.out 2023-09-12T16:10:45.661 INFO:teuthology.orchestra.run.smithi112.stdout:090 2023-09-12T16:10:45.661 INFO:teuthology.orchestra.run.smithi112.stdout:090.out 2023-09-12T16:10:45.661 INFO:teuthology.orchestra.run.smithi112.stdout:091 2023-09-12T16:10:45.662 INFO:teuthology.orchestra.run.smithi112.stdout:091.out 2023-09-12T16:10:45.662 INFO:teuthology.orchestra.run.smithi112.stdout:092 2023-09-12T16:10:45.662 INFO:teuthology.orchestra.run.smithi112.stdout:092.out 2023-09-12T16:10:45.662 INFO:teuthology.orchestra.run.smithi112.stdout:093 2023-09-12T16:10:45.662 INFO:teuthology.orchestra.run.smithi112.stdout:093.out 2023-09-12T16:10:45.663 INFO:teuthology.orchestra.run.smithi112.stdout:094 2023-09-12T16:10:45.663 INFO:teuthology.orchestra.run.smithi112.stdout:094.out 2023-09-12T16:10:45.663 INFO:teuthology.orchestra.run.smithi112.stdout:095 2023-09-12T16:10:45.663 INFO:teuthology.orchestra.run.smithi112.stdout:095.out 2023-09-12T16:10:45.663 INFO:teuthology.orchestra.run.smithi112.stdout:096 2023-09-12T16:10:45.664 INFO:teuthology.orchestra.run.smithi112.stdout:096.out 2023-09-12T16:10:45.664 INFO:teuthology.orchestra.run.smithi112.stdout:097 2023-09-12T16:10:45.664 INFO:teuthology.orchestra.run.smithi112.stdout:097.out 2023-09-12T16:10:45.664 INFO:teuthology.orchestra.run.smithi112.stdout:098 2023-09-12T16:10:45.664 INFO:teuthology.orchestra.run.smithi112.stdout:098.out 2023-09-12T16:10:45.664 INFO:teuthology.orchestra.run.smithi112.stdout:099 2023-09-12T16:10:45.665 INFO:teuthology.orchestra.run.smithi112.stdout:099.out 2023-09-12T16:10:45.665 INFO:teuthology.orchestra.run.smithi112.stdout:100 2023-09-12T16:10:45.665 INFO:teuthology.orchestra.run.smithi112.stdout:100.out 2023-09-12T16:10:45.665 INFO:teuthology.orchestra.run.smithi112.stdout:101 2023-09-12T16:10:45.665 INFO:teuthology.orchestra.run.smithi112.stdout:101.out 2023-09-12T16:10:45.666 INFO:teuthology.orchestra.run.smithi112.stdout:102 2023-09-12T16:10:45.666 INFO:teuthology.orchestra.run.smithi112.stdout:102.out 2023-09-12T16:10:45.666 INFO:teuthology.orchestra.run.smithi112.stdout:103 2023-09-12T16:10:45.666 INFO:teuthology.orchestra.run.smithi112.stdout:103.out 2023-09-12T16:10:45.666 INFO:teuthology.orchestra.run.smithi112.stdout:104 2023-09-12T16:10:45.667 INFO:teuthology.orchestra.run.smithi112.stdout:104.out 2023-09-12T16:10:45.667 INFO:teuthology.orchestra.run.smithi112.stdout:105 2023-09-12T16:10:45.667 INFO:teuthology.orchestra.run.smithi112.stdout:105.out 2023-09-12T16:10:45.667 INFO:teuthology.orchestra.run.smithi112.stdout:106 2023-09-12T16:10:45.667 INFO:teuthology.orchestra.run.smithi112.stdout:106.out 2023-09-12T16:10:45.667 INFO:teuthology.orchestra.run.smithi112.stdout:107 2023-09-12T16:10:45.668 INFO:teuthology.orchestra.run.smithi112.stdout:107.out 2023-09-12T16:10:45.668 INFO:teuthology.orchestra.run.smithi112.stdout:108 2023-09-12T16:10:45.668 INFO:teuthology.orchestra.run.smithi112.stdout:108.out 2023-09-12T16:10:45.668 INFO:teuthology.orchestra.run.smithi112.stdout:109 2023-09-12T16:10:45.668 INFO:teuthology.orchestra.run.smithi112.stdout:109.out 2023-09-12T16:10:45.669 INFO:teuthology.orchestra.run.smithi112.stdout:110 2023-09-12T16:10:45.669 INFO:teuthology.orchestra.run.smithi112.stdout:110.out 2023-09-12T16:10:45.669 INFO:teuthology.orchestra.run.smithi112.stdout:111 2023-09-12T16:10:45.669 INFO:teuthology.orchestra.run.smithi112.stdout:111.out 2023-09-12T16:10:45.669 INFO:teuthology.orchestra.run.smithi112.stdout:112 2023-09-12T16:10:45.670 INFO:teuthology.orchestra.run.smithi112.stdout:112.out 2023-09-12T16:10:45.670 INFO:teuthology.orchestra.run.smithi112.stdout:113 2023-09-12T16:10:45.670 INFO:teuthology.orchestra.run.smithi112.stdout:113.out 2023-09-12T16:10:45.670 INFO:teuthology.orchestra.run.smithi112.stdout:114 2023-09-12T16:10:45.670 INFO:teuthology.orchestra.run.smithi112.stdout:114.out 2023-09-12T16:10:45.671 INFO:teuthology.orchestra.run.smithi112.stdout:115 2023-09-12T16:10:45.671 INFO:teuthology.orchestra.run.smithi112.stdout:115.out 2023-09-12T16:10:45.671 INFO:teuthology.orchestra.run.smithi112.stdout:116 2023-09-12T16:10:45.671 INFO:teuthology.orchestra.run.smithi112.stdout:116.out 2023-09-12T16:10:45.671 INFO:teuthology.orchestra.run.smithi112.stdout:117 2023-09-12T16:10:45.672 INFO:teuthology.orchestra.run.smithi112.stdout:117.out 2023-09-12T16:10:45.672 INFO:teuthology.orchestra.run.smithi112.stdout:118 2023-09-12T16:10:45.672 INFO:teuthology.orchestra.run.smithi112.stdout:118.out 2023-09-12T16:10:45.672 INFO:teuthology.orchestra.run.smithi112.stdout:119 2023-09-12T16:10:45.672 INFO:teuthology.orchestra.run.smithi112.stdout:119.out 2023-09-12T16:10:45.672 INFO:teuthology.orchestra.run.smithi112.stdout:120 2023-09-12T16:10:45.673 INFO:teuthology.orchestra.run.smithi112.stdout:120.out 2023-09-12T16:10:45.673 INFO:teuthology.orchestra.run.smithi112.stdout:121 2023-09-12T16:10:45.673 INFO:teuthology.orchestra.run.smithi112.stdout:121.out 2023-09-12T16:10:45.673 INFO:teuthology.orchestra.run.smithi112.stdout:122 2023-09-12T16:10:45.673 INFO:teuthology.orchestra.run.smithi112.stdout:122.out 2023-09-12T16:10:45.674 INFO:teuthology.orchestra.run.smithi112.stdout:123 2023-09-12T16:10:45.674 INFO:teuthology.orchestra.run.smithi112.stdout:123.out 2023-09-12T16:10:45.674 INFO:teuthology.orchestra.run.smithi112.stdout:124 2023-09-12T16:10:45.674 INFO:teuthology.orchestra.run.smithi112.stdout:124.out 2023-09-12T16:10:45.674 INFO:teuthology.orchestra.run.smithi112.stdout:125 2023-09-12T16:10:45.675 INFO:teuthology.orchestra.run.smithi112.stdout:125.out 2023-09-12T16:10:45.675 INFO:teuthology.orchestra.run.smithi112.stdout:126 2023-09-12T16:10:45.675 INFO:teuthology.orchestra.run.smithi112.stdout:126.out 2023-09-12T16:10:45.675 INFO:teuthology.orchestra.run.smithi112.stdout:127 2023-09-12T16:10:45.675 INFO:teuthology.orchestra.run.smithi112.stdout:127.out 2023-09-12T16:10:45.676 INFO:teuthology.orchestra.run.smithi112.stdout:128 2023-09-12T16:10:45.676 INFO:teuthology.orchestra.run.smithi112.stdout:128.out 2023-09-12T16:10:45.676 INFO:teuthology.orchestra.run.smithi112.stdout:129 2023-09-12T16:10:45.676 INFO:teuthology.orchestra.run.smithi112.stdout:129.out 2023-09-12T16:10:45.676 INFO:teuthology.orchestra.run.smithi112.stdout:130 2023-09-12T16:10:45.677 INFO:teuthology.orchestra.run.smithi112.stdout:130.out 2023-09-12T16:10:45.677 INFO:teuthology.orchestra.run.smithi112.stdout:131 2023-09-12T16:10:45.677 INFO:teuthology.orchestra.run.smithi112.stdout:131.out 2023-09-12T16:10:45.677 INFO:teuthology.orchestra.run.smithi112.stdout:132 2023-09-12T16:10:45.677 INFO:teuthology.orchestra.run.smithi112.stdout:132.out 2023-09-12T16:10:45.678 INFO:teuthology.orchestra.run.smithi112.stdout:133 2023-09-12T16:10:45.678 INFO:teuthology.orchestra.run.smithi112.stdout:133.out 2023-09-12T16:10:45.678 INFO:teuthology.orchestra.run.smithi112.stdout:134 2023-09-12T16:10:45.678 INFO:teuthology.orchestra.run.smithi112.stdout:134.out 2023-09-12T16:10:45.678 INFO:teuthology.orchestra.run.smithi112.stdout:135 2023-09-12T16:10:45.678 INFO:teuthology.orchestra.run.smithi112.stdout:135.out 2023-09-12T16:10:45.679 INFO:teuthology.orchestra.run.smithi112.stdout:136 2023-09-12T16:10:45.679 INFO:teuthology.orchestra.run.smithi112.stdout:136.out 2023-09-12T16:10:45.679 INFO:teuthology.orchestra.run.smithi112.stdout:137 2023-09-12T16:10:45.679 INFO:teuthology.orchestra.run.smithi112.stdout:137.out 2023-09-12T16:10:45.679 INFO:teuthology.orchestra.run.smithi112.stdout:138 2023-09-12T16:10:45.680 INFO:teuthology.orchestra.run.smithi112.stdout:138.out 2023-09-12T16:10:45.680 INFO:teuthology.orchestra.run.smithi112.stdout:139 2023-09-12T16:10:45.680 INFO:teuthology.orchestra.run.smithi112.stdout:139.out 2023-09-12T16:10:45.680 INFO:teuthology.orchestra.run.smithi112.stdout:140 2023-09-12T16:10:45.680 INFO:teuthology.orchestra.run.smithi112.stdout:140.out 2023-09-12T16:10:45.681 INFO:teuthology.orchestra.run.smithi112.stdout:141 2023-09-12T16:10:45.681 INFO:teuthology.orchestra.run.smithi112.stdout:141.out 2023-09-12T16:10:45.681 INFO:teuthology.orchestra.run.smithi112.stdout:142 2023-09-12T16:10:45.681 INFO:teuthology.orchestra.run.smithi112.stdout:142.out 2023-09-12T16:10:45.681 INFO:teuthology.orchestra.run.smithi112.stdout:143 2023-09-12T16:10:45.681 INFO:teuthology.orchestra.run.smithi112.stdout:143.out 2023-09-12T16:10:45.682 INFO:teuthology.orchestra.run.smithi112.stdout:144 2023-09-12T16:10:45.682 INFO:teuthology.orchestra.run.smithi112.stdout:144.out 2023-09-12T16:10:45.682 INFO:teuthology.orchestra.run.smithi112.stdout:145 2023-09-12T16:10:45.682 INFO:teuthology.orchestra.run.smithi112.stdout:145.out 2023-09-12T16:10:45.682 INFO:teuthology.orchestra.run.smithi112.stdout:146 2023-09-12T16:10:45.683 INFO:teuthology.orchestra.run.smithi112.stdout:146.out 2023-09-12T16:10:45.683 INFO:teuthology.orchestra.run.smithi112.stdout:147 2023-09-12T16:10:45.683 INFO:teuthology.orchestra.run.smithi112.stdout:147.out 2023-09-12T16:10:45.683 INFO:teuthology.orchestra.run.smithi112.stdout:148 2023-09-12T16:10:45.683 INFO:teuthology.orchestra.run.smithi112.stdout:148.out 2023-09-12T16:10:45.684 INFO:teuthology.orchestra.run.smithi112.stdout:149 2023-09-12T16:10:45.684 INFO:teuthology.orchestra.run.smithi112.stdout:149.out 2023-09-12T16:10:45.684 INFO:teuthology.orchestra.run.smithi112.stdout:150 2023-09-12T16:10:45.684 INFO:teuthology.orchestra.run.smithi112.stdout:150.out 2023-09-12T16:10:45.684 INFO:teuthology.orchestra.run.smithi112.stdout:151 2023-09-12T16:10:45.684 INFO:teuthology.orchestra.run.smithi112.stdout:151.out 2023-09-12T16:10:45.685 INFO:teuthology.orchestra.run.smithi112.stdout:152 2023-09-12T16:10:45.685 INFO:teuthology.orchestra.run.smithi112.stdout:152.out 2023-09-12T16:10:45.685 INFO:teuthology.orchestra.run.smithi112.stdout:153 2023-09-12T16:10:45.685 INFO:teuthology.orchestra.run.smithi112.stdout:153.out 2023-09-12T16:10:45.685 INFO:teuthology.orchestra.run.smithi112.stdout:154 2023-09-12T16:10:45.686 INFO:teuthology.orchestra.run.smithi112.stdout:154.out 2023-09-12T16:10:45.686 INFO:teuthology.orchestra.run.smithi112.stdout:155 2023-09-12T16:10:45.686 INFO:teuthology.orchestra.run.smithi112.stdout:155.out 2023-09-12T16:10:45.686 INFO:teuthology.orchestra.run.smithi112.stdout:156 2023-09-12T16:10:45.686 INFO:teuthology.orchestra.run.smithi112.stdout:156.out 2023-09-12T16:10:45.687 INFO:teuthology.orchestra.run.smithi112.stdout:157 2023-09-12T16:10:45.687 INFO:teuthology.orchestra.run.smithi112.stdout:157.out 2023-09-12T16:10:45.687 INFO:teuthology.orchestra.run.smithi112.stdout:158 2023-09-12T16:10:45.687 INFO:teuthology.orchestra.run.smithi112.stdout:158.out 2023-09-12T16:10:45.687 INFO:teuthology.orchestra.run.smithi112.stdout:159 2023-09-12T16:10:45.687 INFO:teuthology.orchestra.run.smithi112.stdout:159.out 2023-09-12T16:10:45.688 INFO:teuthology.orchestra.run.smithi112.stdout:160 2023-09-12T16:10:45.688 INFO:teuthology.orchestra.run.smithi112.stdout:160.out 2023-09-12T16:10:45.688 INFO:teuthology.orchestra.run.smithi112.stdout:161 2023-09-12T16:10:45.688 INFO:teuthology.orchestra.run.smithi112.stdout:161.out 2023-09-12T16:10:45.688 INFO:teuthology.orchestra.run.smithi112.stdout:162 2023-09-12T16:10:45.689 INFO:teuthology.orchestra.run.smithi112.stdout:162.out 2023-09-12T16:10:45.689 INFO:teuthology.orchestra.run.smithi112.stdout:163 2023-09-12T16:10:45.689 INFO:teuthology.orchestra.run.smithi112.stdout:163.out 2023-09-12T16:10:45.689 INFO:teuthology.orchestra.run.smithi112.stdout:164 2023-09-12T16:10:45.689 INFO:teuthology.orchestra.run.smithi112.stdout:164.out 2023-09-12T16:10:45.689 INFO:teuthology.orchestra.run.smithi112.stdout:165 2023-09-12T16:10:45.690 INFO:teuthology.orchestra.run.smithi112.stdout:165.out 2023-09-12T16:10:45.690 INFO:teuthology.orchestra.run.smithi112.stdout:166 2023-09-12T16:10:45.690 INFO:teuthology.orchestra.run.smithi112.stdout:166.out 2023-09-12T16:10:45.690 INFO:teuthology.orchestra.run.smithi112.stdout:167 2023-09-12T16:10:45.690 INFO:teuthology.orchestra.run.smithi112.stdout:167.out 2023-09-12T16:10:45.691 INFO:teuthology.orchestra.run.smithi112.stdout:168 2023-09-12T16:10:45.691 INFO:teuthology.orchestra.run.smithi112.stdout:168.out 2023-09-12T16:10:45.691 INFO:teuthology.orchestra.run.smithi112.stdout:169 2023-09-12T16:10:45.691 INFO:teuthology.orchestra.run.smithi112.stdout:169.out 2023-09-12T16:10:45.691 INFO:teuthology.orchestra.run.smithi112.stdout:170 2023-09-12T16:10:45.692 INFO:teuthology.orchestra.run.smithi112.stdout:170.out 2023-09-12T16:10:45.692 INFO:teuthology.orchestra.run.smithi112.stdout:171 2023-09-12T16:10:45.692 INFO:teuthology.orchestra.run.smithi112.stdout:171.out 2023-09-12T16:10:45.692 INFO:teuthology.orchestra.run.smithi112.stdout:172 2023-09-12T16:10:45.692 INFO:teuthology.orchestra.run.smithi112.stdout:172.out 2023-09-12T16:10:45.693 INFO:teuthology.orchestra.run.smithi112.stdout:173 2023-09-12T16:10:45.693 INFO:teuthology.orchestra.run.smithi112.stdout:173.out 2023-09-12T16:10:45.693 INFO:teuthology.orchestra.run.smithi112.stdout:174 2023-09-12T16:10:45.693 INFO:teuthology.orchestra.run.smithi112.stdout:174.out 2023-09-12T16:10:45.693 INFO:teuthology.orchestra.run.smithi112.stdout:175 2023-09-12T16:10:45.693 INFO:teuthology.orchestra.run.smithi112.stdout:175.out 2023-09-12T16:10:45.694 INFO:teuthology.orchestra.run.smithi112.stdout:176 2023-09-12T16:10:45.694 INFO:teuthology.orchestra.run.smithi112.stdout:176.out 2023-09-12T16:10:45.694 INFO:teuthology.orchestra.run.smithi112.stdout:177 2023-09-12T16:10:45.694 INFO:teuthology.orchestra.run.smithi112.stdout:177.out 2023-09-12T16:10:45.694 INFO:teuthology.orchestra.run.smithi112.stdout:178 2023-09-12T16:10:45.695 INFO:teuthology.orchestra.run.smithi112.stdout:178.out 2023-09-12T16:10:45.695 INFO:teuthology.orchestra.run.smithi112.stdout:179 2023-09-12T16:10:45.695 INFO:teuthology.orchestra.run.smithi112.stdout:179.out 2023-09-12T16:10:45.695 INFO:teuthology.orchestra.run.smithi112.stdout:180 2023-09-12T16:10:45.695 INFO:teuthology.orchestra.run.smithi112.stdout:180.out 2023-09-12T16:10:45.696 INFO:teuthology.orchestra.run.smithi112.stdout:181 2023-09-12T16:10:45.696 INFO:teuthology.orchestra.run.smithi112.stdout:181.out 2023-09-12T16:10:45.696 INFO:teuthology.orchestra.run.smithi112.stdout:182 2023-09-12T16:10:45.696 INFO:teuthology.orchestra.run.smithi112.stdout:182.out 2023-09-12T16:10:45.696 INFO:teuthology.orchestra.run.smithi112.stdout:183 2023-09-12T16:10:45.696 INFO:teuthology.orchestra.run.smithi112.stdout:183.out 2023-09-12T16:10:45.697 INFO:teuthology.orchestra.run.smithi112.stdout:184 2023-09-12T16:10:45.697 INFO:teuthology.orchestra.run.smithi112.stdout:184.out 2023-09-12T16:10:45.697 INFO:teuthology.orchestra.run.smithi112.stdout:185 2023-09-12T16:10:45.697 INFO:teuthology.orchestra.run.smithi112.stdout:185.out 2023-09-12T16:10:45.697 INFO:teuthology.orchestra.run.smithi112.stdout:186 2023-09-12T16:10:45.698 INFO:teuthology.orchestra.run.smithi112.stdout:186.out 2023-09-12T16:10:45.698 INFO:teuthology.orchestra.run.smithi112.stdout:187 2023-09-12T16:10:45.698 INFO:teuthology.orchestra.run.smithi112.stdout:187.out 2023-09-12T16:10:45.698 INFO:teuthology.orchestra.run.smithi112.stdout:188 2023-09-12T16:10:45.698 INFO:teuthology.orchestra.run.smithi112.stdout:188.out 2023-09-12T16:10:45.699 INFO:teuthology.orchestra.run.smithi112.stdout:189 2023-09-12T16:10:45.699 INFO:teuthology.orchestra.run.smithi112.stdout:189.out 2023-09-12T16:10:45.699 INFO:teuthology.orchestra.run.smithi112.stdout:190 2023-09-12T16:10:45.699 INFO:teuthology.orchestra.run.smithi112.stdout:190.out 2023-09-12T16:10:45.699 INFO:teuthology.orchestra.run.smithi112.stdout:191 2023-09-12T16:10:45.699 INFO:teuthology.orchestra.run.smithi112.stdout:191.out 2023-09-12T16:10:45.700 INFO:teuthology.orchestra.run.smithi112.stdout:192 2023-09-12T16:10:45.700 INFO:teuthology.orchestra.run.smithi112.stdout:192.out 2023-09-12T16:10:45.700 INFO:teuthology.orchestra.run.smithi112.stdout:193 2023-09-12T16:10:45.700 INFO:teuthology.orchestra.run.smithi112.stdout:193.out 2023-09-12T16:10:45.700 INFO:teuthology.orchestra.run.smithi112.stdout:194 2023-09-12T16:10:45.701 INFO:teuthology.orchestra.run.smithi112.stdout:194.out 2023-09-12T16:10:45.701 INFO:teuthology.orchestra.run.smithi112.stdout:195 2023-09-12T16:10:45.701 INFO:teuthology.orchestra.run.smithi112.stdout:195.out 2023-09-12T16:10:45.701 INFO:teuthology.orchestra.run.smithi112.stdout:196 2023-09-12T16:10:45.701 INFO:teuthology.orchestra.run.smithi112.stdout:196.out 2023-09-12T16:10:45.702 INFO:teuthology.orchestra.run.smithi112.stdout:197 2023-09-12T16:10:45.702 INFO:teuthology.orchestra.run.smithi112.stdout:197.out 2023-09-12T16:10:45.702 INFO:teuthology.orchestra.run.smithi112.stdout:198 2023-09-12T16:10:45.702 INFO:teuthology.orchestra.run.smithi112.stdout:198.out 2023-09-12T16:10:45.702 INFO:teuthology.orchestra.run.smithi112.stdout:199 2023-09-12T16:10:45.703 INFO:teuthology.orchestra.run.smithi112.stdout:199.out 2023-09-12T16:10:45.703 INFO:teuthology.orchestra.run.smithi112.stdout:200 2023-09-12T16:10:45.703 INFO:teuthology.orchestra.run.smithi112.stdout:200.out 2023-09-12T16:10:45.703 INFO:teuthology.orchestra.run.smithi112.stdout:201 2023-09-12T16:10:45.703 INFO:teuthology.orchestra.run.smithi112.stdout:201.out 2023-09-12T16:10:45.704 INFO:teuthology.orchestra.run.smithi112.stdout:202 2023-09-12T16:10:45.704 INFO:teuthology.orchestra.run.smithi112.stdout:202.out 2023-09-12T16:10:45.704 INFO:teuthology.orchestra.run.smithi112.stdout:203 2023-09-12T16:10:45.704 INFO:teuthology.orchestra.run.smithi112.stdout:203.out 2023-09-12T16:10:45.704 INFO:teuthology.orchestra.run.smithi112.stdout:204 2023-09-12T16:10:45.704 INFO:teuthology.orchestra.run.smithi112.stdout:204.out 2023-09-12T16:10:45.705 INFO:teuthology.orchestra.run.smithi112.stdout:205 2023-09-12T16:10:45.705 INFO:teuthology.orchestra.run.smithi112.stdout:205.out 2023-09-12T16:10:45.705 INFO:teuthology.orchestra.run.smithi112.stdout:206 2023-09-12T16:10:45.705 INFO:teuthology.orchestra.run.smithi112.stdout:206.out 2023-09-12T16:10:45.705 INFO:teuthology.orchestra.run.smithi112.stdout:207 2023-09-12T16:10:45.706 INFO:teuthology.orchestra.run.smithi112.stdout:207.out 2023-09-12T16:10:45.706 INFO:teuthology.orchestra.run.smithi112.stdout:208 2023-09-12T16:10:45.706 INFO:teuthology.orchestra.run.smithi112.stdout:208.out 2023-09-12T16:10:45.706 INFO:teuthology.orchestra.run.smithi112.stdout:209 2023-09-12T16:10:45.706 INFO:teuthology.orchestra.run.smithi112.stdout:209.out 2023-09-12T16:10:45.707 INFO:teuthology.orchestra.run.smithi112.stdout:210 2023-09-12T16:10:45.707 INFO:teuthology.orchestra.run.smithi112.stdout:210.out 2023-09-12T16:10:45.707 INFO:teuthology.orchestra.run.smithi112.stdout:211 2023-09-12T16:10:45.707 INFO:teuthology.orchestra.run.smithi112.stdout:211.out 2023-09-12T16:10:45.707 INFO:teuthology.orchestra.run.smithi112.stdout:212 2023-09-12T16:10:45.707 INFO:teuthology.orchestra.run.smithi112.stdout:212.out 2023-09-12T16:10:45.708 INFO:teuthology.orchestra.run.smithi112.stdout:213 2023-09-12T16:10:45.708 INFO:teuthology.orchestra.run.smithi112.stdout:213.out 2023-09-12T16:10:45.708 INFO:teuthology.orchestra.run.smithi112.stdout:214 2023-09-12T16:10:45.708 INFO:teuthology.orchestra.run.smithi112.stdout:214.out 2023-09-12T16:10:45.708 INFO:teuthology.orchestra.run.smithi112.stdout:215 2023-09-12T16:10:45.709 INFO:teuthology.orchestra.run.smithi112.stdout:215.out 2023-09-12T16:10:45.709 INFO:teuthology.orchestra.run.smithi112.stdout:216 2023-09-12T16:10:45.709 INFO:teuthology.orchestra.run.smithi112.stdout:216.out 2023-09-12T16:10:45.709 INFO:teuthology.orchestra.run.smithi112.stdout:217 2023-09-12T16:10:45.709 INFO:teuthology.orchestra.run.smithi112.stdout:217.out 2023-09-12T16:10:45.709 INFO:teuthology.orchestra.run.smithi112.stdout:218 2023-09-12T16:10:45.710 INFO:teuthology.orchestra.run.smithi112.stdout:218.out 2023-09-12T16:10:45.710 INFO:teuthology.orchestra.run.smithi112.stdout:219 2023-09-12T16:10:45.710 INFO:teuthology.orchestra.run.smithi112.stdout:219.out 2023-09-12T16:10:45.710 INFO:teuthology.orchestra.run.smithi112.stdout:220 2023-09-12T16:10:45.710 INFO:teuthology.orchestra.run.smithi112.stdout:220.out 2023-09-12T16:10:45.711 INFO:teuthology.orchestra.run.smithi112.stdout:221 2023-09-12T16:10:45.711 INFO:teuthology.orchestra.run.smithi112.stdout:221.out 2023-09-12T16:10:45.711 INFO:teuthology.orchestra.run.smithi112.stdout:222 2023-09-12T16:10:45.711 INFO:teuthology.orchestra.run.smithi112.stdout:222.out 2023-09-12T16:10:45.711 INFO:teuthology.orchestra.run.smithi112.stdout:223 2023-09-12T16:10:45.712 INFO:teuthology.orchestra.run.smithi112.stdout:223.out 2023-09-12T16:10:45.712 INFO:teuthology.orchestra.run.smithi112.stdout:224 2023-09-12T16:10:45.712 INFO:teuthology.orchestra.run.smithi112.stdout:224.out 2023-09-12T16:10:45.712 INFO:teuthology.orchestra.run.smithi112.stdout:225 2023-09-12T16:10:45.712 INFO:teuthology.orchestra.run.smithi112.stdout:225.out 2023-09-12T16:10:45.712 INFO:teuthology.orchestra.run.smithi112.stdout:226 2023-09-12T16:10:45.713 INFO:teuthology.orchestra.run.smithi112.stdout:226.out 2023-09-12T16:10:45.713 INFO:teuthology.orchestra.run.smithi112.stdout:227 2023-09-12T16:10:45.713 INFO:teuthology.orchestra.run.smithi112.stdout:227.out 2023-09-12T16:10:45.713 INFO:teuthology.orchestra.run.smithi112.stdout:228 2023-09-12T16:10:45.713 INFO:teuthology.orchestra.run.smithi112.stdout:228.out 2023-09-12T16:10:45.714 INFO:teuthology.orchestra.run.smithi112.stdout:229 2023-09-12T16:10:45.714 INFO:teuthology.orchestra.run.smithi112.stdout:229.out 2023-09-12T16:10:45.714 INFO:teuthology.orchestra.run.smithi112.stdout:230 2023-09-12T16:10:45.714 INFO:teuthology.orchestra.run.smithi112.stdout:230.out 2023-09-12T16:10:45.714 INFO:teuthology.orchestra.run.smithi112.stdout:231 2023-09-12T16:10:45.715 INFO:teuthology.orchestra.run.smithi112.stdout:231.out 2023-09-12T16:10:45.715 INFO:teuthology.orchestra.run.smithi112.stdout:232 2023-09-12T16:10:45.715 INFO:teuthology.orchestra.run.smithi112.stdout:232.out 2023-09-12T16:10:45.715 INFO:teuthology.orchestra.run.smithi112.stdout:233 2023-09-12T16:10:45.715 INFO:teuthology.orchestra.run.smithi112.stdout:233.out 2023-09-12T16:10:45.716 INFO:teuthology.orchestra.run.smithi112.stdout:234 2023-09-12T16:10:45.716 INFO:teuthology.orchestra.run.smithi112.stdout:234.out 2023-09-12T16:10:45.716 INFO:teuthology.orchestra.run.smithi112.stdout:235 2023-09-12T16:10:45.716 INFO:teuthology.orchestra.run.smithi112.stdout:235.out 2023-09-12T16:10:45.716 INFO:teuthology.orchestra.run.smithi112.stdout:236 2023-09-12T16:10:45.717 INFO:teuthology.orchestra.run.smithi112.stdout:236.out 2023-09-12T16:10:45.717 INFO:teuthology.orchestra.run.smithi112.stdout:237 2023-09-12T16:10:45.717 INFO:teuthology.orchestra.run.smithi112.stdout:237.out 2023-09-12T16:10:45.717 INFO:teuthology.orchestra.run.smithi112.stdout:238 2023-09-12T16:10:45.717 INFO:teuthology.orchestra.run.smithi112.stdout:238.out 2023-09-12T16:10:45.717 INFO:teuthology.orchestra.run.smithi112.stdout:239 2023-09-12T16:10:45.718 INFO:teuthology.orchestra.run.smithi112.stdout:239.out 2023-09-12T16:10:45.718 INFO:teuthology.orchestra.run.smithi112.stdout:240 2023-09-12T16:10:45.718 INFO:teuthology.orchestra.run.smithi112.stdout:240.out 2023-09-12T16:10:45.718 INFO:teuthology.orchestra.run.smithi112.stdout:241 2023-09-12T16:10:45.718 INFO:teuthology.orchestra.run.smithi112.stdout:241.out 2023-09-12T16:10:45.719 INFO:teuthology.orchestra.run.smithi112.stdout:242 2023-09-12T16:10:45.719 INFO:teuthology.orchestra.run.smithi112.stdout:242.out 2023-09-12T16:10:45.719 INFO:teuthology.orchestra.run.smithi112.stdout:243 2023-09-12T16:10:45.719 INFO:teuthology.orchestra.run.smithi112.stdout:243.out 2023-09-12T16:10:45.719 INFO:teuthology.orchestra.run.smithi112.stdout:244 2023-09-12T16:10:45.719 INFO:teuthology.orchestra.run.smithi112.stdout:244.out 2023-09-12T16:10:45.720 INFO:teuthology.orchestra.run.smithi112.stdout:245 2023-09-12T16:10:45.720 INFO:teuthology.orchestra.run.smithi112.stdout:245.out 2023-09-12T16:10:45.720 INFO:teuthology.orchestra.run.smithi112.stdout:246 2023-09-12T16:10:45.720 INFO:teuthology.orchestra.run.smithi112.stdout:246.out 2023-09-12T16:10:45.720 INFO:teuthology.orchestra.run.smithi112.stdout:247 2023-09-12T16:10:45.721 INFO:teuthology.orchestra.run.smithi112.stdout:247.out 2023-09-12T16:10:45.721 INFO:teuthology.orchestra.run.smithi112.stdout:248 2023-09-12T16:10:45.721 INFO:teuthology.orchestra.run.smithi112.stdout:248.out 2023-09-12T16:10:45.721 INFO:teuthology.orchestra.run.smithi112.stdout:249 2023-09-12T16:10:45.721 INFO:teuthology.orchestra.run.smithi112.stdout:249.out 2023-09-12T16:10:45.722 INFO:teuthology.orchestra.run.smithi112.stdout:250 2023-09-12T16:10:45.722 INFO:teuthology.orchestra.run.smithi112.stdout:250.out 2023-09-12T16:10:45.722 INFO:teuthology.orchestra.run.smithi112.stdout:251 2023-09-12T16:10:45.722 INFO:teuthology.orchestra.run.smithi112.stdout:251.out 2023-09-12T16:10:45.722 INFO:teuthology.orchestra.run.smithi112.stdout:252 2023-09-12T16:10:45.722 INFO:teuthology.orchestra.run.smithi112.stdout:252.out 2023-09-12T16:10:45.723 INFO:teuthology.orchestra.run.smithi112.stdout:253 2023-09-12T16:10:45.723 INFO:teuthology.orchestra.run.smithi112.stdout:253.out 2023-09-12T16:10:45.723 INFO:teuthology.orchestra.run.smithi112.stdout:254 2023-09-12T16:10:45.723 INFO:teuthology.orchestra.run.smithi112.stdout:254.out 2023-09-12T16:10:45.723 INFO:teuthology.orchestra.run.smithi112.stdout:255 2023-09-12T16:10:45.724 INFO:teuthology.orchestra.run.smithi112.stdout:255.out 2023-09-12T16:10:45.724 INFO:teuthology.orchestra.run.smithi112.stdout:256 2023-09-12T16:10:45.724 INFO:teuthology.orchestra.run.smithi112.stdout:256.out 2023-09-12T16:10:45.724 INFO:teuthology.orchestra.run.smithi112.stdout:257 2023-09-12T16:10:45.724 INFO:teuthology.orchestra.run.smithi112.stdout:257.out 2023-09-12T16:10:45.725 INFO:teuthology.orchestra.run.smithi112.stdout:258 2023-09-12T16:10:45.725 INFO:teuthology.orchestra.run.smithi112.stdout:258.out 2023-09-12T16:10:45.725 INFO:teuthology.orchestra.run.smithi112.stdout:259 2023-09-12T16:10:45.725 INFO:teuthology.orchestra.run.smithi112.stdout:259.out 2023-09-12T16:10:45.725 INFO:teuthology.orchestra.run.smithi112.stdout:260 2023-09-12T16:10:45.725 INFO:teuthology.orchestra.run.smithi112.stdout:260.out 2023-09-12T16:10:45.726 INFO:teuthology.orchestra.run.smithi112.stdout:261 2023-09-12T16:10:45.726 INFO:teuthology.orchestra.run.smithi112.stdout:261.out 2023-09-12T16:10:45.726 INFO:teuthology.orchestra.run.smithi112.stdout:262 2023-09-12T16:10:45.726 INFO:teuthology.orchestra.run.smithi112.stdout:262.out 2023-09-12T16:10:45.726 INFO:teuthology.orchestra.run.smithi112.stdout:263 2023-09-12T16:10:45.727 INFO:teuthology.orchestra.run.smithi112.stdout:263.out 2023-09-12T16:10:45.727 INFO:teuthology.orchestra.run.smithi112.stdout:264 2023-09-12T16:10:45.727 INFO:teuthology.orchestra.run.smithi112.stdout:264.out 2023-09-12T16:10:45.727 INFO:teuthology.orchestra.run.smithi112.stdout:265 2023-09-12T16:10:45.727 INFO:teuthology.orchestra.run.smithi112.stdout:265.out 2023-09-12T16:10:45.728 INFO:teuthology.orchestra.run.smithi112.stdout:266 2023-09-12T16:10:45.728 INFO:teuthology.orchestra.run.smithi112.stdout:266.out 2023-09-12T16:10:45.728 INFO:teuthology.orchestra.run.smithi112.stdout:267 2023-09-12T16:10:45.728 INFO:teuthology.orchestra.run.smithi112.stdout:267.out 2023-09-12T16:10:45.728 INFO:teuthology.orchestra.run.smithi112.stdout:268 2023-09-12T16:10:45.728 INFO:teuthology.orchestra.run.smithi112.stdout:268.out 2023-09-12T16:10:45.729 INFO:teuthology.orchestra.run.smithi112.stdout:269 2023-09-12T16:10:45.729 INFO:teuthology.orchestra.run.smithi112.stdout:269.out 2023-09-12T16:10:45.729 INFO:teuthology.orchestra.run.smithi112.stdout:270 2023-09-12T16:10:45.729 INFO:teuthology.orchestra.run.smithi112.stdout:270.out 2023-09-12T16:10:45.729 INFO:teuthology.orchestra.run.smithi112.stdout:271 2023-09-12T16:10:45.730 INFO:teuthology.orchestra.run.smithi112.stdout:271.out 2023-09-12T16:10:45.730 INFO:teuthology.orchestra.run.smithi112.stdout:272 2023-09-12T16:10:45.730 INFO:teuthology.orchestra.run.smithi112.stdout:272.out 2023-09-12T16:10:45.730 INFO:teuthology.orchestra.run.smithi112.stdout:273 2023-09-12T16:10:45.730 INFO:teuthology.orchestra.run.smithi112.stdout:273.out 2023-09-12T16:10:45.731 INFO:teuthology.orchestra.run.smithi112.stdout:274 2023-09-12T16:10:45.731 INFO:teuthology.orchestra.run.smithi112.stdout:274.out 2023-09-12T16:10:45.731 INFO:teuthology.orchestra.run.smithi112.stdout:275 2023-09-12T16:10:45.731 INFO:teuthology.orchestra.run.smithi112.stdout:275.out 2023-09-12T16:10:45.731 INFO:teuthology.orchestra.run.smithi112.stdout:276 2023-09-12T16:10:45.731 INFO:teuthology.orchestra.run.smithi112.stdout:276.out 2023-09-12T16:10:45.732 INFO:teuthology.orchestra.run.smithi112.stdout:277 2023-09-12T16:10:45.732 INFO:teuthology.orchestra.run.smithi112.stdout:277.out 2023-09-12T16:10:45.732 INFO:teuthology.orchestra.run.smithi112.stdout:278 2023-09-12T16:10:45.732 INFO:teuthology.orchestra.run.smithi112.stdout:278.out 2023-09-12T16:10:45.732 INFO:teuthology.orchestra.run.smithi112.stdout:279 2023-09-12T16:10:45.733 INFO:teuthology.orchestra.run.smithi112.stdout:279.out 2023-09-12T16:10:45.733 INFO:teuthology.orchestra.run.smithi112.stdout:280 2023-09-12T16:10:45.733 INFO:teuthology.orchestra.run.smithi112.stdout:280.out 2023-09-12T16:10:45.733 INFO:teuthology.orchestra.run.smithi112.stdout:281 2023-09-12T16:10:45.733 INFO:teuthology.orchestra.run.smithi112.stdout:281.out 2023-09-12T16:10:45.733 INFO:teuthology.orchestra.run.smithi112.stdout:282 2023-09-12T16:10:45.734 INFO:teuthology.orchestra.run.smithi112.stdout:282.out 2023-09-12T16:10:45.734 INFO:teuthology.orchestra.run.smithi112.stdout:283 2023-09-12T16:10:45.734 INFO:teuthology.orchestra.run.smithi112.stdout:283.out 2023-09-12T16:10:45.734 INFO:teuthology.orchestra.run.smithi112.stdout:284 2023-09-12T16:10:45.734 INFO:teuthology.orchestra.run.smithi112.stdout:284.out 2023-09-12T16:10:45.735 INFO:teuthology.orchestra.run.smithi112.stdout:285 2023-09-12T16:10:45.735 INFO:teuthology.orchestra.run.smithi112.stdout:285.out 2023-09-12T16:10:45.735 INFO:teuthology.orchestra.run.smithi112.stdout:286 2023-09-12T16:10:45.735 INFO:teuthology.orchestra.run.smithi112.stdout:286.out 2023-09-12T16:10:45.735 INFO:teuthology.orchestra.run.smithi112.stdout:287 2023-09-12T16:10:45.736 INFO:teuthology.orchestra.run.smithi112.stdout:287.out 2023-09-12T16:10:45.736 INFO:teuthology.orchestra.run.smithi112.stdout:288 2023-09-12T16:10:45.736 INFO:teuthology.orchestra.run.smithi112.stdout:288.out 2023-09-12T16:10:45.736 INFO:teuthology.orchestra.run.smithi112.stdout:289 2023-09-12T16:10:45.736 INFO:teuthology.orchestra.run.smithi112.stdout:289.out 2023-09-12T16:10:45.737 INFO:teuthology.orchestra.run.smithi112.stdout:290 2023-09-12T16:10:45.737 INFO:teuthology.orchestra.run.smithi112.stdout:290.out 2023-09-12T16:10:45.737 INFO:teuthology.orchestra.run.smithi112.stdout:291 2023-09-12T16:10:45.737 INFO:teuthology.orchestra.run.smithi112.stdout:291.out 2023-09-12T16:10:45.737 INFO:teuthology.orchestra.run.smithi112.stdout:292 2023-09-12T16:10:45.737 INFO:teuthology.orchestra.run.smithi112.stdout:292.out 2023-09-12T16:10:45.738 INFO:teuthology.orchestra.run.smithi112.stdout:293 2023-09-12T16:10:45.738 INFO:teuthology.orchestra.run.smithi112.stdout:293.out 2023-09-12T16:10:45.738 INFO:teuthology.orchestra.run.smithi112.stdout:294 2023-09-12T16:10:45.738 INFO:teuthology.orchestra.run.smithi112.stdout:294.out 2023-09-12T16:10:45.738 INFO:teuthology.orchestra.run.smithi112.stdout:295 2023-09-12T16:10:45.739 INFO:teuthology.orchestra.run.smithi112.stdout:295.out 2023-09-12T16:10:45.739 INFO:teuthology.orchestra.run.smithi112.stdout:296 2023-09-12T16:10:45.739 INFO:teuthology.orchestra.run.smithi112.stdout:296.out 2023-09-12T16:10:45.739 INFO:teuthology.orchestra.run.smithi112.stdout:297 2023-09-12T16:10:45.739 INFO:teuthology.orchestra.run.smithi112.stdout:297.out 2023-09-12T16:10:45.740 INFO:teuthology.orchestra.run.smithi112.stdout:298 2023-09-12T16:10:45.740 INFO:teuthology.orchestra.run.smithi112.stdout:298.out 2023-09-12T16:10:45.740 INFO:teuthology.orchestra.run.smithi112.stdout:299 2023-09-12T16:10:45.740 INFO:teuthology.orchestra.run.smithi112.stdout:299.out 2023-09-12T16:10:45.740 INFO:teuthology.orchestra.run.smithi112.stdout:300 2023-09-12T16:10:45.740 INFO:teuthology.orchestra.run.smithi112.stdout:300.out 2023-09-12T16:10:45.741 INFO:teuthology.orchestra.run.smithi112.stdout:301 2023-09-12T16:10:45.741 INFO:teuthology.orchestra.run.smithi112.stdout:301.out 2023-09-12T16:10:45.741 INFO:teuthology.orchestra.run.smithi112.stdout:302 2023-09-12T16:10:45.741 INFO:teuthology.orchestra.run.smithi112.stdout:302.out 2023-09-12T16:10:45.741 INFO:teuthology.orchestra.run.smithi112.stdout:303 2023-09-12T16:10:45.742 INFO:teuthology.orchestra.run.smithi112.stdout:303.out 2023-09-12T16:10:45.742 INFO:teuthology.orchestra.run.smithi112.stdout:304 2023-09-12T16:10:45.742 INFO:teuthology.orchestra.run.smithi112.stdout:304.out 2023-09-12T16:10:45.742 INFO:teuthology.orchestra.run.smithi112.stdout:305 2023-09-12T16:10:45.742 INFO:teuthology.orchestra.run.smithi112.stdout:305.out 2023-09-12T16:10:45.743 INFO:teuthology.orchestra.run.smithi112.stdout:306 2023-09-12T16:10:45.743 INFO:teuthology.orchestra.run.smithi112.stdout:306.out 2023-09-12T16:10:45.743 INFO:teuthology.orchestra.run.smithi112.stdout:307 2023-09-12T16:10:45.743 INFO:teuthology.orchestra.run.smithi112.stdout:307.out 2023-09-12T16:10:45.743 INFO:teuthology.orchestra.run.smithi112.stdout:308 2023-09-12T16:10:45.744 INFO:teuthology.orchestra.run.smithi112.stdout:308.out 2023-09-12T16:10:45.744 INFO:teuthology.orchestra.run.smithi112.stdout:309 2023-09-12T16:10:45.744 INFO:teuthology.orchestra.run.smithi112.stdout:309.out 2023-09-12T16:10:45.744 INFO:teuthology.orchestra.run.smithi112.stdout:310 2023-09-12T16:10:45.744 INFO:teuthology.orchestra.run.smithi112.stdout:310.out 2023-09-12T16:10:45.745 INFO:teuthology.orchestra.run.smithi112.stdout:311 2023-09-12T16:10:45.745 INFO:teuthology.orchestra.run.smithi112.stdout:311.out 2023-09-12T16:10:45.745 INFO:teuthology.orchestra.run.smithi112.stdout:312 2023-09-12T16:10:45.745 INFO:teuthology.orchestra.run.smithi112.stdout:312.out 2023-09-12T16:10:45.745 INFO:teuthology.orchestra.run.smithi112.stdout:313 2023-09-12T16:10:45.745 INFO:teuthology.orchestra.run.smithi112.stdout:313.out 2023-09-12T16:10:45.746 INFO:teuthology.orchestra.run.smithi112.stdout:314 2023-09-12T16:10:45.746 INFO:teuthology.orchestra.run.smithi112.stdout:314.out 2023-09-12T16:10:45.746 INFO:teuthology.orchestra.run.smithi112.stdout:315 2023-09-12T16:10:45.746 INFO:teuthology.orchestra.run.smithi112.stdout:315.out 2023-09-12T16:10:45.747 INFO:teuthology.orchestra.run.smithi112.stdout:316 2023-09-12T16:10:45.747 INFO:teuthology.orchestra.run.smithi112.stdout:316.out 2023-09-12T16:10:45.747 INFO:teuthology.orchestra.run.smithi112.stdout:317 2023-09-12T16:10:45.747 INFO:teuthology.orchestra.run.smithi112.stdout:317.out 2023-09-12T16:10:45.747 INFO:teuthology.orchestra.run.smithi112.stdout:318 2023-09-12T16:10:45.747 INFO:teuthology.orchestra.run.smithi112.stdout:318.out 2023-09-12T16:10:45.748 INFO:teuthology.orchestra.run.smithi112.stdout:319 2023-09-12T16:10:45.748 INFO:teuthology.orchestra.run.smithi112.stdout:319.out 2023-09-12T16:10:45.748 INFO:teuthology.orchestra.run.smithi112.stdout:320 2023-09-12T16:10:45.748 INFO:teuthology.orchestra.run.smithi112.stdout:320.out 2023-09-12T16:10:45.748 INFO:teuthology.orchestra.run.smithi112.stdout:321 2023-09-12T16:10:45.749 INFO:teuthology.orchestra.run.smithi112.stdout:321.out 2023-09-12T16:10:45.749 INFO:teuthology.orchestra.run.smithi112.stdout:322 2023-09-12T16:10:45.749 INFO:teuthology.orchestra.run.smithi112.stdout:322.out 2023-09-12T16:10:45.749 INFO:teuthology.orchestra.run.smithi112.stdout:323 2023-09-12T16:10:45.749 INFO:teuthology.orchestra.run.smithi112.stdout:323.out 2023-09-12T16:10:45.749 INFO:teuthology.orchestra.run.smithi112.stdout:324 2023-09-12T16:10:45.750 INFO:teuthology.orchestra.run.smithi112.stdout:324.out 2023-09-12T16:10:45.750 INFO:teuthology.orchestra.run.smithi112.stdout:325 2023-09-12T16:10:45.750 INFO:teuthology.orchestra.run.smithi112.stdout:325.out 2023-09-12T16:10:45.750 INFO:teuthology.orchestra.run.smithi112.stdout:326 2023-09-12T16:10:45.750 INFO:teuthology.orchestra.run.smithi112.stdout:326.out 2023-09-12T16:10:45.751 INFO:teuthology.orchestra.run.smithi112.stdout:327 2023-09-12T16:10:45.751 INFO:teuthology.orchestra.run.smithi112.stdout:327.out 2023-09-12T16:10:45.751 INFO:teuthology.orchestra.run.smithi112.stdout:328 2023-09-12T16:10:45.751 INFO:teuthology.orchestra.run.smithi112.stdout:328.out 2023-09-12T16:10:45.751 INFO:teuthology.orchestra.run.smithi112.stdout:329 2023-09-12T16:10:45.752 INFO:teuthology.orchestra.run.smithi112.stdout:329.out 2023-09-12T16:10:45.752 INFO:teuthology.orchestra.run.smithi112.stdout:330 2023-09-12T16:10:45.752 INFO:teuthology.orchestra.run.smithi112.stdout:330.out 2023-09-12T16:10:45.752 INFO:teuthology.orchestra.run.smithi112.stdout:331 2023-09-12T16:10:45.752 INFO:teuthology.orchestra.run.smithi112.stdout:331.out 2023-09-12T16:10:45.753 INFO:teuthology.orchestra.run.smithi112.stdout:332 2023-09-12T16:10:45.753 INFO:teuthology.orchestra.run.smithi112.stdout:332.out 2023-09-12T16:10:45.753 INFO:teuthology.orchestra.run.smithi112.stdout:333 2023-09-12T16:10:45.753 INFO:teuthology.orchestra.run.smithi112.stdout:333.out 2023-09-12T16:10:45.753 INFO:teuthology.orchestra.run.smithi112.stdout:334 2023-09-12T16:10:45.754 INFO:teuthology.orchestra.run.smithi112.stdout:334.out 2023-09-12T16:10:45.754 INFO:teuthology.orchestra.run.smithi112.stdout:335 2023-09-12T16:10:45.754 INFO:teuthology.orchestra.run.smithi112.stdout:335.out 2023-09-12T16:10:45.754 INFO:teuthology.orchestra.run.smithi112.stdout:336 2023-09-12T16:10:45.754 INFO:teuthology.orchestra.run.smithi112.stdout:336.out 2023-09-12T16:10:45.754 INFO:teuthology.orchestra.run.smithi112.stdout:337 2023-09-12T16:10:45.755 INFO:teuthology.orchestra.run.smithi112.stdout:337.out 2023-09-12T16:10:45.755 INFO:teuthology.orchestra.run.smithi112.stdout:338 2023-09-12T16:10:45.755 INFO:teuthology.orchestra.run.smithi112.stdout:338.out 2023-09-12T16:10:45.755 INFO:teuthology.orchestra.run.smithi112.stdout:339 2023-09-12T16:10:45.755 INFO:teuthology.orchestra.run.smithi112.stdout:339.out 2023-09-12T16:10:45.756 INFO:teuthology.orchestra.run.smithi112.stdout:340 2023-09-12T16:10:45.756 INFO:teuthology.orchestra.run.smithi112.stdout:340.out 2023-09-12T16:10:45.756 INFO:teuthology.orchestra.run.smithi112.stdout:341 2023-09-12T16:10:45.756 INFO:teuthology.orchestra.run.smithi112.stdout:341.out 2023-09-12T16:10:45.756 INFO:teuthology.orchestra.run.smithi112.stdout:342 2023-09-12T16:10:45.757 INFO:teuthology.orchestra.run.smithi112.stdout:342.out 2023-09-12T16:10:45.757 INFO:teuthology.orchestra.run.smithi112.stdout:343 2023-09-12T16:10:45.757 INFO:teuthology.orchestra.run.smithi112.stdout:343.out 2023-09-12T16:10:45.757 INFO:teuthology.orchestra.run.smithi112.stdout:344 2023-09-12T16:10:45.757 INFO:teuthology.orchestra.run.smithi112.stdout:344.out 2023-09-12T16:10:45.758 INFO:teuthology.orchestra.run.smithi112.stdout:345 2023-09-12T16:10:45.758 INFO:teuthology.orchestra.run.smithi112.stdout:345.out 2023-09-12T16:10:45.758 INFO:teuthology.orchestra.run.smithi112.stdout:346 2023-09-12T16:10:45.758 INFO:teuthology.orchestra.run.smithi112.stdout:346.out 2023-09-12T16:10:45.758 INFO:teuthology.orchestra.run.smithi112.stdout:347 2023-09-12T16:10:45.759 INFO:teuthology.orchestra.run.smithi112.stdout:347.out 2023-09-12T16:10:45.759 INFO:teuthology.orchestra.run.smithi112.stdout:348 2023-09-12T16:10:45.759 INFO:teuthology.orchestra.run.smithi112.stdout:348.out 2023-09-12T16:10:45.759 INFO:teuthology.orchestra.run.smithi112.stdout:349 2023-09-12T16:10:45.759 INFO:teuthology.orchestra.run.smithi112.stdout:349.out 2023-09-12T16:10:45.760 INFO:teuthology.orchestra.run.smithi112.stdout:350 2023-09-12T16:10:45.760 INFO:teuthology.orchestra.run.smithi112.stdout:350.out 2023-09-12T16:10:45.760 INFO:teuthology.orchestra.run.smithi112.stdout:351 2023-09-12T16:10:45.760 INFO:teuthology.orchestra.run.smithi112.stdout:351.out 2023-09-12T16:10:45.760 INFO:teuthology.orchestra.run.smithi112.stdout:352 2023-09-12T16:10:45.760 INFO:teuthology.orchestra.run.smithi112.stdout:352.out 2023-09-12T16:10:45.761 INFO:teuthology.orchestra.run.smithi112.stdout:353 2023-09-12T16:10:45.761 INFO:teuthology.orchestra.run.smithi112.stdout:353.out 2023-09-12T16:10:45.761 INFO:teuthology.orchestra.run.smithi112.stdout:354 2023-09-12T16:10:45.761 INFO:teuthology.orchestra.run.smithi112.stdout:354.out 2023-09-12T16:10:45.761 INFO:teuthology.orchestra.run.smithi112.stdout:355 2023-09-12T16:10:45.762 INFO:teuthology.orchestra.run.smithi112.stdout:355.out 2023-09-12T16:10:45.762 INFO:teuthology.orchestra.run.smithi112.stdout:356 2023-09-12T16:10:45.762 INFO:teuthology.orchestra.run.smithi112.stdout:356.out 2023-09-12T16:10:45.762 INFO:teuthology.orchestra.run.smithi112.stdout:357 2023-09-12T16:10:45.762 INFO:teuthology.orchestra.run.smithi112.stdout:357.out 2023-09-12T16:10:45.763 INFO:teuthology.orchestra.run.smithi112.stdout:358 2023-09-12T16:10:45.763 INFO:teuthology.orchestra.run.smithi112.stdout:358.out 2023-09-12T16:10:45.763 INFO:teuthology.orchestra.run.smithi112.stdout:359 2023-09-12T16:10:45.763 INFO:teuthology.orchestra.run.smithi112.stdout:359.out 2023-09-12T16:10:45.763 INFO:teuthology.orchestra.run.smithi112.stdout:360 2023-09-12T16:10:45.763 INFO:teuthology.orchestra.run.smithi112.stdout:360.out 2023-09-12T16:10:45.764 INFO:teuthology.orchestra.run.smithi112.stdout:361 2023-09-12T16:10:45.764 INFO:teuthology.orchestra.run.smithi112.stdout:361.out 2023-09-12T16:10:45.764 INFO:teuthology.orchestra.run.smithi112.stdout:362 2023-09-12T16:10:45.764 INFO:teuthology.orchestra.run.smithi112.stdout:362.out 2023-09-12T16:10:45.764 INFO:teuthology.orchestra.run.smithi112.stdout:363 2023-09-12T16:10:45.765 INFO:teuthology.orchestra.run.smithi112.stdout:363.out 2023-09-12T16:10:45.765 INFO:teuthology.orchestra.run.smithi112.stdout:364 2023-09-12T16:10:45.765 INFO:teuthology.orchestra.run.smithi112.stdout:364.out 2023-09-12T16:10:45.765 INFO:teuthology.orchestra.run.smithi112.stdout:365 2023-09-12T16:10:45.765 INFO:teuthology.orchestra.run.smithi112.stdout:365.out 2023-09-12T16:10:45.766 INFO:teuthology.orchestra.run.smithi112.stdout:366 2023-09-12T16:10:45.766 INFO:teuthology.orchestra.run.smithi112.stdout:366.out 2023-09-12T16:10:45.766 INFO:teuthology.orchestra.run.smithi112.stdout:367 2023-09-12T16:10:45.766 INFO:teuthology.orchestra.run.smithi112.stdout:367.out 2023-09-12T16:10:45.766 INFO:teuthology.orchestra.run.smithi112.stdout:368 2023-09-12T16:10:45.766 INFO:teuthology.orchestra.run.smithi112.stdout:368.out 2023-09-12T16:10:45.767 INFO:teuthology.orchestra.run.smithi112.stdout:369 2023-09-12T16:10:45.767 INFO:teuthology.orchestra.run.smithi112.stdout:369.out 2023-09-12T16:10:45.767 INFO:teuthology.orchestra.run.smithi112.stdout:370 2023-09-12T16:10:45.767 INFO:teuthology.orchestra.run.smithi112.stdout:370.out 2023-09-12T16:10:45.767 INFO:teuthology.orchestra.run.smithi112.stdout:371 2023-09-12T16:10:45.768 INFO:teuthology.orchestra.run.smithi112.stdout:371.out 2023-09-12T16:10:45.768 INFO:teuthology.orchestra.run.smithi112.stdout:372 2023-09-12T16:10:45.768 INFO:teuthology.orchestra.run.smithi112.stdout:372.out 2023-09-12T16:10:45.768 INFO:teuthology.orchestra.run.smithi112.stdout:373 2023-09-12T16:10:45.768 INFO:teuthology.orchestra.run.smithi112.stdout:373.out 2023-09-12T16:10:45.768 INFO:teuthology.orchestra.run.smithi112.stdout:374 2023-09-12T16:10:45.769 INFO:teuthology.orchestra.run.smithi112.stdout:374.out 2023-09-12T16:10:45.769 INFO:teuthology.orchestra.run.smithi112.stdout:375 2023-09-12T16:10:45.769 INFO:teuthology.orchestra.run.smithi112.stdout:375.out 2023-09-12T16:10:45.769 INFO:teuthology.orchestra.run.smithi112.stdout:376 2023-09-12T16:10:45.769 INFO:teuthology.orchestra.run.smithi112.stdout:376.out 2023-09-12T16:10:45.770 INFO:teuthology.orchestra.run.smithi112.stdout:377 2023-09-12T16:10:45.770 INFO:teuthology.orchestra.run.smithi112.stdout:377.out 2023-09-12T16:10:45.770 INFO:teuthology.orchestra.run.smithi112.stdout:378 2023-09-12T16:10:45.770 INFO:teuthology.orchestra.run.smithi112.stdout:378.out 2023-09-12T16:10:45.770 INFO:teuthology.orchestra.run.smithi112.stdout:379 2023-09-12T16:10:45.771 INFO:teuthology.orchestra.run.smithi112.stdout:379.out 2023-09-12T16:10:45.771 INFO:teuthology.orchestra.run.smithi112.stdout:380 2023-09-12T16:10:45.771 INFO:teuthology.orchestra.run.smithi112.stdout:380.out 2023-09-12T16:10:45.771 INFO:teuthology.orchestra.run.smithi112.stdout:381 2023-09-12T16:10:45.771 INFO:teuthology.orchestra.run.smithi112.stdout:381.out 2023-09-12T16:10:45.772 INFO:teuthology.orchestra.run.smithi112.stdout:382 2023-09-12T16:10:45.772 INFO:teuthology.orchestra.run.smithi112.stdout:382.out 2023-09-12T16:10:45.772 INFO:teuthology.orchestra.run.smithi112.stdout:383 2023-09-12T16:10:45.772 INFO:teuthology.orchestra.run.smithi112.stdout:383.out 2023-09-12T16:10:45.772 INFO:teuthology.orchestra.run.smithi112.stdout:384 2023-09-12T16:10:45.773 INFO:teuthology.orchestra.run.smithi112.stdout:384.out 2023-09-12T16:10:45.773 INFO:teuthology.orchestra.run.smithi112.stdout:385 2023-09-12T16:10:45.773 INFO:teuthology.orchestra.run.smithi112.stdout:385.out 2023-09-12T16:10:45.773 INFO:teuthology.orchestra.run.smithi112.stdout:386 2023-09-12T16:10:45.773 INFO:teuthology.orchestra.run.smithi112.stdout:386.out 2023-09-12T16:10:45.773 INFO:teuthology.orchestra.run.smithi112.stdout:387 2023-09-12T16:10:45.774 INFO:teuthology.orchestra.run.smithi112.stdout:387.out 2023-09-12T16:10:45.774 INFO:teuthology.orchestra.run.smithi112.stdout:388 2023-09-12T16:10:45.774 INFO:teuthology.orchestra.run.smithi112.stdout:388.out 2023-09-12T16:10:45.774 INFO:teuthology.orchestra.run.smithi112.stdout:389 2023-09-12T16:10:45.774 INFO:teuthology.orchestra.run.smithi112.stdout:389.out 2023-09-12T16:10:45.775 INFO:teuthology.orchestra.run.smithi112.stdout:390 2023-09-12T16:10:45.775 INFO:teuthology.orchestra.run.smithi112.stdout:390.out 2023-09-12T16:10:45.775 INFO:teuthology.orchestra.run.smithi112.stdout:391 2023-09-12T16:10:45.775 INFO:teuthology.orchestra.run.smithi112.stdout:391.out 2023-09-12T16:10:45.775 INFO:teuthology.orchestra.run.smithi112.stdout:392 2023-09-12T16:10:45.776 INFO:teuthology.orchestra.run.smithi112.stdout:392.out 2023-09-12T16:10:45.776 INFO:teuthology.orchestra.run.smithi112.stdout:393 2023-09-12T16:10:45.776 INFO:teuthology.orchestra.run.smithi112.stdout:393.out 2023-09-12T16:10:45.776 INFO:teuthology.orchestra.run.smithi112.stdout:394 2023-09-12T16:10:45.776 INFO:teuthology.orchestra.run.smithi112.stdout:394.out 2023-09-12T16:10:45.777 INFO:teuthology.orchestra.run.smithi112.stdout:395 2023-09-12T16:10:45.777 INFO:teuthology.orchestra.run.smithi112.stdout:395.out 2023-09-12T16:10:45.777 INFO:teuthology.orchestra.run.smithi112.stdout:396 2023-09-12T16:10:45.777 INFO:teuthology.orchestra.run.smithi112.stdout:396.out 2023-09-12T16:10:45.777 INFO:teuthology.orchestra.run.smithi112.stdout:397 2023-09-12T16:10:45.778 INFO:teuthology.orchestra.run.smithi112.stdout:397.out 2023-09-12T16:10:45.778 INFO:teuthology.orchestra.run.smithi112.stdout:398 2023-09-12T16:10:45.778 INFO:teuthology.orchestra.run.smithi112.stdout:398.out 2023-09-12T16:10:45.778 INFO:teuthology.orchestra.run.smithi112.stdout:399 2023-09-12T16:10:45.778 INFO:teuthology.orchestra.run.smithi112.stdout:399.out 2023-09-12T16:10:45.779 INFO:teuthology.orchestra.run.smithi112.stdout:400 2023-09-12T16:10:45.779 INFO:teuthology.orchestra.run.smithi112.stdout:400.out 2023-09-12T16:10:45.779 INFO:teuthology.orchestra.run.smithi112.stdout:401 2023-09-12T16:10:45.779 INFO:teuthology.orchestra.run.smithi112.stdout:401.out 2023-09-12T16:10:45.779 INFO:teuthology.orchestra.run.smithi112.stdout:402 2023-09-12T16:10:45.779 INFO:teuthology.orchestra.run.smithi112.stdout:402.out 2023-09-12T16:10:45.780 INFO:teuthology.orchestra.run.smithi112.stdout:403 2023-09-12T16:10:45.780 INFO:teuthology.orchestra.run.smithi112.stdout:403.out 2023-09-12T16:10:45.780 INFO:teuthology.orchestra.run.smithi112.stdout:404 2023-09-12T16:10:45.780 INFO:teuthology.orchestra.run.smithi112.stdout:404.out 2023-09-12T16:10:45.780 INFO:teuthology.orchestra.run.smithi112.stdout:405 2023-09-12T16:10:45.781 INFO:teuthology.orchestra.run.smithi112.stdout:405.out 2023-09-12T16:10:45.781 INFO:teuthology.orchestra.run.smithi112.stdout:406 2023-09-12T16:10:45.781 INFO:teuthology.orchestra.run.smithi112.stdout:406.out 2023-09-12T16:10:45.781 INFO:teuthology.orchestra.run.smithi112.stdout:407 2023-09-12T16:10:45.781 INFO:teuthology.orchestra.run.smithi112.stdout:407.out 2023-09-12T16:10:45.782 INFO:teuthology.orchestra.run.smithi112.stdout:408 2023-09-12T16:10:45.782 INFO:teuthology.orchestra.run.smithi112.stdout:408.out 2023-09-12T16:10:45.782 INFO:teuthology.orchestra.run.smithi112.stdout:409 2023-09-12T16:10:45.782 INFO:teuthology.orchestra.run.smithi112.stdout:409.out 2023-09-12T16:10:45.782 INFO:teuthology.orchestra.run.smithi112.stdout:410 2023-09-12T16:10:45.782 INFO:teuthology.orchestra.run.smithi112.stdout:410.out 2023-09-12T16:10:45.783 INFO:teuthology.orchestra.run.smithi112.stdout:411 2023-09-12T16:10:45.783 INFO:teuthology.orchestra.run.smithi112.stdout:411.out 2023-09-12T16:10:45.783 INFO:teuthology.orchestra.run.smithi112.stdout:412 2023-09-12T16:10:45.783 INFO:teuthology.orchestra.run.smithi112.stdout:412.out 2023-09-12T16:10:45.783 INFO:teuthology.orchestra.run.smithi112.stdout:413 2023-09-12T16:10:45.784 INFO:teuthology.orchestra.run.smithi112.stdout:413.out 2023-09-12T16:10:45.784 INFO:teuthology.orchestra.run.smithi112.stdout:414 2023-09-12T16:10:45.784 INFO:teuthology.orchestra.run.smithi112.stdout:414.out 2023-09-12T16:10:45.784 INFO:teuthology.orchestra.run.smithi112.stdout:415 2023-09-12T16:10:45.784 INFO:teuthology.orchestra.run.smithi112.stdout:415.out 2023-09-12T16:10:45.785 INFO:teuthology.orchestra.run.smithi112.stdout:416 2023-09-12T16:10:45.785 INFO:teuthology.orchestra.run.smithi112.stdout:416.out 2023-09-12T16:10:45.785 INFO:teuthology.orchestra.run.smithi112.stdout:417 2023-09-12T16:10:45.785 INFO:teuthology.orchestra.run.smithi112.stdout:417.out 2023-09-12T16:10:45.785 INFO:teuthology.orchestra.run.smithi112.stdout:418 2023-09-12T16:10:45.786 INFO:teuthology.orchestra.run.smithi112.stdout:418.out 2023-09-12T16:10:45.786 INFO:teuthology.orchestra.run.smithi112.stdout:419 2023-09-12T16:10:45.786 INFO:teuthology.orchestra.run.smithi112.stdout:419.out 2023-09-12T16:10:45.786 INFO:teuthology.orchestra.run.smithi112.stdout:420 2023-09-12T16:10:45.786 INFO:teuthology.orchestra.run.smithi112.stdout:420.out 2023-09-12T16:10:45.786 INFO:teuthology.orchestra.run.smithi112.stdout:421 2023-09-12T16:10:45.787 INFO:teuthology.orchestra.run.smithi112.stdout:421.out 2023-09-12T16:10:45.787 INFO:teuthology.orchestra.run.smithi112.stdout:422 2023-09-12T16:10:45.787 INFO:teuthology.orchestra.run.smithi112.stdout:422.out 2023-09-12T16:10:45.787 INFO:teuthology.orchestra.run.smithi112.stdout:423 2023-09-12T16:10:45.787 INFO:teuthology.orchestra.run.smithi112.stdout:423.out 2023-09-12T16:10:45.788 INFO:teuthology.orchestra.run.smithi112.stdout:424 2023-09-12T16:10:45.788 INFO:teuthology.orchestra.run.smithi112.stdout:424.out 2023-09-12T16:10:45.788 INFO:teuthology.orchestra.run.smithi112.stdout:425 2023-09-12T16:10:45.788 INFO:teuthology.orchestra.run.smithi112.stdout:425.out 2023-09-12T16:10:45.788 INFO:teuthology.orchestra.run.smithi112.stdout:426 2023-09-12T16:10:45.788 INFO:teuthology.orchestra.run.smithi112.stdout:426.out 2023-09-12T16:10:45.789 INFO:teuthology.orchestra.run.smithi112.stdout:427 2023-09-12T16:10:45.789 INFO:teuthology.orchestra.run.smithi112.stdout:427.out 2023-09-12T16:10:45.789 INFO:teuthology.orchestra.run.smithi112.stdout:428 2023-09-12T16:10:45.789 INFO:teuthology.orchestra.run.smithi112.stdout:428.out 2023-09-12T16:10:45.789 INFO:teuthology.orchestra.run.smithi112.stdout:429 2023-09-12T16:10:45.790 INFO:teuthology.orchestra.run.smithi112.stdout:429.out 2023-09-12T16:10:45.790 INFO:teuthology.orchestra.run.smithi112.stdout:430 2023-09-12T16:10:45.790 INFO:teuthology.orchestra.run.smithi112.stdout:430.out 2023-09-12T16:10:45.790 INFO:teuthology.orchestra.run.smithi112.stdout:431 2023-09-12T16:10:45.790 INFO:teuthology.orchestra.run.smithi112.stdout:431.out 2023-09-12T16:10:45.791 INFO:teuthology.orchestra.run.smithi112.stdout:432 2023-09-12T16:10:45.791 INFO:teuthology.orchestra.run.smithi112.stdout:432.out 2023-09-12T16:10:45.791 INFO:teuthology.orchestra.run.smithi112.stdout:433 2023-09-12T16:10:45.791 INFO:teuthology.orchestra.run.smithi112.stdout:433.out 2023-09-12T16:10:45.791 INFO:teuthology.orchestra.run.smithi112.stdout:434 2023-09-12T16:10:45.792 INFO:teuthology.orchestra.run.smithi112.stdout:434.out 2023-09-12T16:10:45.792 INFO:teuthology.orchestra.run.smithi112.stdout:435 2023-09-12T16:10:45.792 INFO:teuthology.orchestra.run.smithi112.stdout:435.out 2023-09-12T16:10:45.792 INFO:teuthology.orchestra.run.smithi112.stdout:436 2023-09-12T16:10:45.792 INFO:teuthology.orchestra.run.smithi112.stdout:436.out 2023-09-12T16:10:45.792 INFO:teuthology.orchestra.run.smithi112.stdout:437 2023-09-12T16:10:45.793 INFO:teuthology.orchestra.run.smithi112.stdout:437.out 2023-09-12T16:10:45.793 INFO:teuthology.orchestra.run.smithi112.stdout:438 2023-09-12T16:10:45.793 INFO:teuthology.orchestra.run.smithi112.stdout:438.out 2023-09-12T16:10:45.793 INFO:teuthology.orchestra.run.smithi112.stdout:439 2023-09-12T16:10:45.793 INFO:teuthology.orchestra.run.smithi112.stdout:439.out 2023-09-12T16:10:45.794 INFO:teuthology.orchestra.run.smithi112.stdout:440 2023-09-12T16:10:45.794 INFO:teuthology.orchestra.run.smithi112.stdout:440.out 2023-09-12T16:10:45.794 INFO:teuthology.orchestra.run.smithi112.stdout:441 2023-09-12T16:10:45.794 INFO:teuthology.orchestra.run.smithi112.stdout:441.out 2023-09-12T16:10:45.794 INFO:teuthology.orchestra.run.smithi112.stdout:442 2023-09-12T16:10:45.795 INFO:teuthology.orchestra.run.smithi112.stdout:442.out 2023-09-12T16:10:45.795 INFO:teuthology.orchestra.run.smithi112.stdout:443 2023-09-12T16:10:45.795 INFO:teuthology.orchestra.run.smithi112.stdout:443.out 2023-09-12T16:10:45.795 INFO:teuthology.orchestra.run.smithi112.stdout:444 2023-09-12T16:10:45.795 INFO:teuthology.orchestra.run.smithi112.stdout:444.out 2023-09-12T16:10:45.795 INFO:teuthology.orchestra.run.smithi112.stdout:445 2023-09-12T16:10:45.796 INFO:teuthology.orchestra.run.smithi112.stdout:445.out 2023-09-12T16:10:45.796 INFO:teuthology.orchestra.run.smithi112.stdout:446 2023-09-12T16:10:45.796 INFO:teuthology.orchestra.run.smithi112.stdout:446.out 2023-09-12T16:10:45.796 INFO:teuthology.orchestra.run.smithi112.stdout:447 2023-09-12T16:10:45.796 INFO:teuthology.orchestra.run.smithi112.stdout:447.out 2023-09-12T16:10:45.797 INFO:teuthology.orchestra.run.smithi112.stdout:448 2023-09-12T16:10:45.797 INFO:teuthology.orchestra.run.smithi112.stdout:448.out 2023-09-12T16:10:45.797 INFO:teuthology.orchestra.run.smithi112.stdout:449 2023-09-12T16:10:45.797 INFO:teuthology.orchestra.run.smithi112.stdout:449.out 2023-09-12T16:10:45.797 INFO:teuthology.orchestra.run.smithi112.stdout:450 2023-09-12T16:10:45.797 INFO:teuthology.orchestra.run.smithi112.stdout:450.out 2023-09-12T16:10:45.798 INFO:teuthology.orchestra.run.smithi112.stdout:451 2023-09-12T16:10:45.798 INFO:teuthology.orchestra.run.smithi112.stdout:451.out 2023-09-12T16:10:45.798 INFO:teuthology.orchestra.run.smithi112.stdout:452 2023-09-12T16:10:45.798 INFO:teuthology.orchestra.run.smithi112.stdout:452.out 2023-09-12T16:10:45.798 INFO:teuthology.orchestra.run.smithi112.stdout:453 2023-09-12T16:10:45.799 INFO:teuthology.orchestra.run.smithi112.stdout:453.out 2023-09-12T16:10:45.799 INFO:teuthology.orchestra.run.smithi112.stdout:454 2023-09-12T16:10:45.799 INFO:teuthology.orchestra.run.smithi112.stdout:454.out 2023-09-12T16:10:45.799 INFO:teuthology.orchestra.run.smithi112.stdout:455 2023-09-12T16:10:45.799 INFO:teuthology.orchestra.run.smithi112.stdout:455.out 2023-09-12T16:10:45.800 INFO:teuthology.orchestra.run.smithi112.stdout:456 2023-09-12T16:10:45.800 INFO:teuthology.orchestra.run.smithi112.stdout:456.out 2023-09-12T16:10:45.800 INFO:teuthology.orchestra.run.smithi112.stdout:457 2023-09-12T16:10:45.800 INFO:teuthology.orchestra.run.smithi112.stdout:457.out 2023-09-12T16:10:45.800 INFO:teuthology.orchestra.run.smithi112.stdout:458 2023-09-12T16:10:45.801 INFO:teuthology.orchestra.run.smithi112.stdout:458.out 2023-09-12T16:10:45.801 INFO:teuthology.orchestra.run.smithi112.stdout:459 2023-09-12T16:10:45.801 INFO:teuthology.orchestra.run.smithi112.stdout:459.out 2023-09-12T16:10:45.801 INFO:teuthology.orchestra.run.smithi112.stdout:460 2023-09-12T16:10:45.801 INFO:teuthology.orchestra.run.smithi112.stdout:460.out 2023-09-12T16:10:45.802 INFO:teuthology.orchestra.run.smithi112.stdout:461 2023-09-12T16:10:45.802 INFO:teuthology.orchestra.run.smithi112.stdout:461.out 2023-09-12T16:10:45.802 INFO:teuthology.orchestra.run.smithi112.stdout:462 2023-09-12T16:10:45.802 INFO:teuthology.orchestra.run.smithi112.stdout:462.out 2023-09-12T16:10:45.802 INFO:teuthology.orchestra.run.smithi112.stdout:463 2023-09-12T16:10:45.802 INFO:teuthology.orchestra.run.smithi112.stdout:463.out 2023-09-12T16:10:45.803 INFO:teuthology.orchestra.run.smithi112.stdout:464 2023-09-12T16:10:45.803 INFO:teuthology.orchestra.run.smithi112.stdout:464.out 2023-09-12T16:10:45.804 INFO:teuthology.orchestra.run.smithi112.stdout:465 2023-09-12T16:10:45.805 INFO:teuthology.orchestra.run.smithi112.stdout:465.out 2023-09-12T16:10:45.805 INFO:teuthology.orchestra.run.smithi112.stdout:466 2023-09-12T16:10:45.805 INFO:teuthology.orchestra.run.smithi112.stdout:466.out 2023-09-12T16:10:45.805 INFO:teuthology.orchestra.run.smithi112.stdout:467 2023-09-12T16:10:45.805 INFO:teuthology.orchestra.run.smithi112.stdout:467.out 2023-09-12T16:10:45.806 INFO:teuthology.orchestra.run.smithi112.stdout:468 2023-09-12T16:10:45.806 INFO:teuthology.orchestra.run.smithi112.stdout:468.out 2023-09-12T16:10:45.806 INFO:teuthology.orchestra.run.smithi112.stdout:469 2023-09-12T16:10:45.806 INFO:teuthology.orchestra.run.smithi112.stdout:469.out 2023-09-12T16:10:45.806 INFO:teuthology.orchestra.run.smithi112.stdout:470 2023-09-12T16:10:45.807 INFO:teuthology.orchestra.run.smithi112.stdout:470.out 2023-09-12T16:10:45.807 INFO:teuthology.orchestra.run.smithi112.stdout:472 2023-09-12T16:10:45.807 INFO:teuthology.orchestra.run.smithi112.stdout:472.out 2023-09-12T16:10:45.807 INFO:teuthology.orchestra.run.smithi112.stdout:473 2023-09-12T16:10:45.807 INFO:teuthology.orchestra.run.smithi112.stdout:473.out 2023-09-12T16:10:45.807 INFO:teuthology.orchestra.run.smithi112.stdout:474 2023-09-12T16:10:45.808 INFO:teuthology.orchestra.run.smithi112.stdout:474.out 2023-09-12T16:10:45.808 INFO:teuthology.orchestra.run.smithi112.stdout:475 2023-09-12T16:10:45.808 INFO:teuthology.orchestra.run.smithi112.stdout:475.out 2023-09-12T16:10:45.808 INFO:teuthology.orchestra.run.smithi112.stdout:476 2023-09-12T16:10:45.808 INFO:teuthology.orchestra.run.smithi112.stdout:476.out 2023-09-12T16:10:45.809 INFO:teuthology.orchestra.run.smithi112.stdout:477 2023-09-12T16:10:45.809 INFO:teuthology.orchestra.run.smithi112.stdout:477.out 2023-09-12T16:10:45.809 INFO:teuthology.orchestra.run.smithi112.stdout:478 2023-09-12T16:10:45.809 INFO:teuthology.orchestra.run.smithi112.stdout:478.out 2023-09-12T16:10:45.809 INFO:teuthology.orchestra.run.smithi112.stdout:479 2023-09-12T16:10:45.809 INFO:teuthology.orchestra.run.smithi112.stdout:479.out 2023-09-12T16:10:45.810 INFO:teuthology.orchestra.run.smithi112.stdout:480 2023-09-12T16:10:45.810 INFO:teuthology.orchestra.run.smithi112.stdout:480.out 2023-09-12T16:10:45.810 INFO:teuthology.orchestra.run.smithi112.stdout:481 2023-09-12T16:10:45.810 INFO:teuthology.orchestra.run.smithi112.stdout:481.out 2023-09-12T16:10:45.810 INFO:teuthology.orchestra.run.smithi112.stdout:482 2023-09-12T16:10:45.811 INFO:teuthology.orchestra.run.smithi112.stdout:482.out 2023-09-12T16:10:45.811 INFO:teuthology.orchestra.run.smithi112.stdout:483 2023-09-12T16:10:45.811 INFO:teuthology.orchestra.run.smithi112.stdout:483.out 2023-09-12T16:10:45.811 INFO:teuthology.orchestra.run.smithi112.stdout:484 2023-09-12T16:10:45.811 INFO:teuthology.orchestra.run.smithi112.stdout:484.out 2023-09-12T16:10:45.812 INFO:teuthology.orchestra.run.smithi112.stdout:485 2023-09-12T16:10:45.812 INFO:teuthology.orchestra.run.smithi112.stdout:485.out 2023-09-12T16:10:45.812 INFO:teuthology.orchestra.run.smithi112.stdout:486 2023-09-12T16:10:45.812 INFO:teuthology.orchestra.run.smithi112.stdout:486.out 2023-09-12T16:10:45.812 INFO:teuthology.orchestra.run.smithi112.stdout:487 2023-09-12T16:10:45.813 INFO:teuthology.orchestra.run.smithi112.stdout:487.out 2023-09-12T16:10:45.813 INFO:teuthology.orchestra.run.smithi112.stdout:488 2023-09-12T16:10:45.813 INFO:teuthology.orchestra.run.smithi112.stdout:488.out 2023-09-12T16:10:45.813 INFO:teuthology.orchestra.run.smithi112.stdout:489 2023-09-12T16:10:45.813 INFO:teuthology.orchestra.run.smithi112.stdout:489.out 2023-09-12T16:10:45.813 INFO:teuthology.orchestra.run.smithi112.stdout:490 2023-09-12T16:10:45.814 INFO:teuthology.orchestra.run.smithi112.stdout:490.out 2023-09-12T16:10:45.814 INFO:teuthology.orchestra.run.smithi112.stdout:491 2023-09-12T16:10:45.814 INFO:teuthology.orchestra.run.smithi112.stdout:491.out 2023-09-12T16:10:45.814 INFO:teuthology.orchestra.run.smithi112.stdout:492 2023-09-12T16:10:45.814 INFO:teuthology.orchestra.run.smithi112.stdout:492.out 2023-09-12T16:10:45.815 INFO:teuthology.orchestra.run.smithi112.stdout:493 2023-09-12T16:10:45.815 INFO:teuthology.orchestra.run.smithi112.stdout:493.out 2023-09-12T16:10:45.815 INFO:teuthology.orchestra.run.smithi112.stdout:494 2023-09-12T16:10:45.815 INFO:teuthology.orchestra.run.smithi112.stdout:494.out 2023-09-12T16:10:45.815 INFO:teuthology.orchestra.run.smithi112.stdout:495 2023-09-12T16:10:45.816 INFO:teuthology.orchestra.run.smithi112.stdout:495.out 2023-09-12T16:10:45.816 INFO:teuthology.orchestra.run.smithi112.stdout:496 2023-09-12T16:10:45.816 INFO:teuthology.orchestra.run.smithi112.stdout:496.out 2023-09-12T16:10:45.816 INFO:teuthology.orchestra.run.smithi112.stdout:497 2023-09-12T16:10:45.816 INFO:teuthology.orchestra.run.smithi112.stdout:497.out 2023-09-12T16:10:45.817 INFO:teuthology.orchestra.run.smithi112.stdout:498 2023-09-12T16:10:45.817 INFO:teuthology.orchestra.run.smithi112.stdout:498.out 2023-09-12T16:10:45.817 INFO:teuthology.orchestra.run.smithi112.stdout:499 2023-09-12T16:10:45.817 INFO:teuthology.orchestra.run.smithi112.stdout:499.out 2023-09-12T16:10:45.817 INFO:teuthology.orchestra.run.smithi112.stdout:500 2023-09-12T16:10:45.817 INFO:teuthology.orchestra.run.smithi112.stdout:500.out 2023-09-12T16:10:45.818 INFO:teuthology.orchestra.run.smithi112.stdout:501 2023-09-12T16:10:45.818 INFO:teuthology.orchestra.run.smithi112.stdout:501.out 2023-09-12T16:10:45.818 INFO:teuthology.orchestra.run.smithi112.stdout:502 2023-09-12T16:10:45.818 INFO:teuthology.orchestra.run.smithi112.stdout:502.out 2023-09-12T16:10:45.818 INFO:teuthology.orchestra.run.smithi112.stdout:503 2023-09-12T16:10:45.819 INFO:teuthology.orchestra.run.smithi112.stdout:503.out 2023-09-12T16:10:45.819 INFO:teuthology.orchestra.run.smithi112.stdout:504 2023-09-12T16:10:45.819 INFO:teuthology.orchestra.run.smithi112.stdout:504.out 2023-09-12T16:10:45.819 INFO:teuthology.orchestra.run.smithi112.stdout:505 2023-09-12T16:10:45.819 INFO:teuthology.orchestra.run.smithi112.stdout:505.out 2023-09-12T16:10:45.820 INFO:teuthology.orchestra.run.smithi112.stdout:506 2023-09-12T16:10:45.820 INFO:teuthology.orchestra.run.smithi112.stdout:506.out 2023-09-12T16:10:45.820 INFO:teuthology.orchestra.run.smithi112.stdout:507 2023-09-12T16:10:45.820 INFO:teuthology.orchestra.run.smithi112.stdout:507.out 2023-09-12T16:10:45.820 INFO:teuthology.orchestra.run.smithi112.stdout:508 2023-09-12T16:10:45.821 INFO:teuthology.orchestra.run.smithi112.stdout:508.out 2023-09-12T16:10:45.821 INFO:teuthology.orchestra.run.smithi112.stdout:509 2023-09-12T16:10:45.821 INFO:teuthology.orchestra.run.smithi112.stdout:509.out 2023-09-12T16:10:45.821 INFO:teuthology.orchestra.run.smithi112.stdout:510 2023-09-12T16:10:45.821 INFO:teuthology.orchestra.run.smithi112.stdout:510.out 2023-09-12T16:10:45.822 INFO:teuthology.orchestra.run.smithi112.stdout:511 2023-09-12T16:10:45.822 INFO:teuthology.orchestra.run.smithi112.stdout:511.out 2023-09-12T16:10:45.822 INFO:teuthology.orchestra.run.smithi112.stdout:512 2023-09-12T16:10:45.822 INFO:teuthology.orchestra.run.smithi112.stdout:512.out 2023-09-12T16:10:45.822 INFO:teuthology.orchestra.run.smithi112.stdout:513 2023-09-12T16:10:45.823 INFO:teuthology.orchestra.run.smithi112.stdout:513.out 2023-09-12T16:10:45.823 INFO:teuthology.orchestra.run.smithi112.stdout:514 2023-09-12T16:10:45.823 INFO:teuthology.orchestra.run.smithi112.stdout:514.out 2023-09-12T16:10:45.823 INFO:teuthology.orchestra.run.smithi112.stdout:515 2023-09-12T16:10:45.823 INFO:teuthology.orchestra.run.smithi112.stdout:515.out 2023-09-12T16:10:45.823 INFO:teuthology.orchestra.run.smithi112.stdout:516 2023-09-12T16:10:45.824 INFO:teuthology.orchestra.run.smithi112.stdout:516.out 2023-09-12T16:10:45.824 INFO:teuthology.orchestra.run.smithi112.stdout:517 2023-09-12T16:10:45.824 INFO:teuthology.orchestra.run.smithi112.stdout:517.out 2023-09-12T16:10:45.824 INFO:teuthology.orchestra.run.smithi112.stdout:518 2023-09-12T16:10:45.824 INFO:teuthology.orchestra.run.smithi112.stdout:518.out 2023-09-12T16:10:45.825 INFO:teuthology.orchestra.run.smithi112.stdout:519 2023-09-12T16:10:45.825 INFO:teuthology.orchestra.run.smithi112.stdout:519.out 2023-09-12T16:10:45.825 INFO:teuthology.orchestra.run.smithi112.stdout:520 2023-09-12T16:10:45.825 INFO:teuthology.orchestra.run.smithi112.stdout:520.out 2023-09-12T16:10:45.825 INFO:teuthology.orchestra.run.smithi112.stdout:521 2023-09-12T16:10:45.826 INFO:teuthology.orchestra.run.smithi112.stdout:521.out 2023-09-12T16:10:45.826 INFO:teuthology.orchestra.run.smithi112.stdout:522 2023-09-12T16:10:45.826 INFO:teuthology.orchestra.run.smithi112.stdout:522.out 2023-09-12T16:10:45.826 INFO:teuthology.orchestra.run.smithi112.stdout:523 2023-09-12T16:10:45.826 INFO:teuthology.orchestra.run.smithi112.stdout:523.out 2023-09-12T16:10:45.826 INFO:teuthology.orchestra.run.smithi112.stdout:524 2023-09-12T16:10:45.827 INFO:teuthology.orchestra.run.smithi112.stdout:524.out 2023-09-12T16:10:45.827 INFO:teuthology.orchestra.run.smithi112.stdout:525 2023-09-12T16:10:45.827 INFO:teuthology.orchestra.run.smithi112.stdout:525.out 2023-09-12T16:10:45.827 INFO:teuthology.orchestra.run.smithi112.stdout:526 2023-09-12T16:10:45.827 INFO:teuthology.orchestra.run.smithi112.stdout:526.out 2023-09-12T16:10:45.828 INFO:teuthology.orchestra.run.smithi112.stdout:527 2023-09-12T16:10:45.828 INFO:teuthology.orchestra.run.smithi112.stdout:527.out 2023-09-12T16:10:45.828 INFO:teuthology.orchestra.run.smithi112.stdout:528 2023-09-12T16:10:45.828 INFO:teuthology.orchestra.run.smithi112.stdout:528.out 2023-09-12T16:10:45.828 INFO:teuthology.orchestra.run.smithi112.stdout:529 2023-09-12T16:10:45.828 INFO:teuthology.orchestra.run.smithi112.stdout:529.out 2023-09-12T16:10:45.829 INFO:teuthology.orchestra.run.smithi112.stdout:530 2023-09-12T16:10:45.829 INFO:teuthology.orchestra.run.smithi112.stdout:530.out 2023-09-12T16:10:45.829 INFO:teuthology.orchestra.run.smithi112.stdout:531 2023-09-12T16:10:45.829 INFO:teuthology.orchestra.run.smithi112.stdout:531.out 2023-09-12T16:10:45.829 INFO:teuthology.orchestra.run.smithi112.stdout:532 2023-09-12T16:10:45.830 INFO:teuthology.orchestra.run.smithi112.stdout:532.out 2023-09-12T16:10:45.830 INFO:teuthology.orchestra.run.smithi112.stdout:533 2023-09-12T16:10:45.830 INFO:teuthology.orchestra.run.smithi112.stdout:533.out 2023-09-12T16:10:45.830 INFO:teuthology.orchestra.run.smithi112.stdout:534 2023-09-12T16:10:45.830 INFO:teuthology.orchestra.run.smithi112.stdout:534.out 2023-09-12T16:10:45.831 INFO:teuthology.orchestra.run.smithi112.stdout:535 2023-09-12T16:10:45.831 INFO:teuthology.orchestra.run.smithi112.stdout:535.out 2023-09-12T16:10:45.831 INFO:teuthology.orchestra.run.smithi112.stdout:536 2023-09-12T16:10:45.831 INFO:teuthology.orchestra.run.smithi112.stdout:536.out 2023-09-12T16:10:45.831 INFO:teuthology.orchestra.run.smithi112.stdout:537 2023-09-12T16:10:45.832 INFO:teuthology.orchestra.run.smithi112.stdout:537.out 2023-09-12T16:10:45.832 INFO:teuthology.orchestra.run.smithi112.stdout:538 2023-09-12T16:10:45.832 INFO:teuthology.orchestra.run.smithi112.stdout:538.out 2023-09-12T16:10:45.832 INFO:teuthology.orchestra.run.smithi112.stdout:539 2023-09-12T16:10:45.832 INFO:teuthology.orchestra.run.smithi112.stdout:539.out 2023-09-12T16:10:45.832 INFO:teuthology.orchestra.run.smithi112.stdout:540 2023-09-12T16:10:45.833 INFO:teuthology.orchestra.run.smithi112.stdout:540.out 2023-09-12T16:10:45.833 INFO:teuthology.orchestra.run.smithi112.stdout:541 2023-09-12T16:10:45.833 INFO:teuthology.orchestra.run.smithi112.stdout:541.out 2023-09-12T16:10:45.833 INFO:teuthology.orchestra.run.smithi112.stdout:542 2023-09-12T16:10:45.833 INFO:teuthology.orchestra.run.smithi112.stdout:542.out 2023-09-12T16:10:45.834 INFO:teuthology.orchestra.run.smithi112.stdout:543 2023-09-12T16:10:45.834 INFO:teuthology.orchestra.run.smithi112.stdout:543.out 2023-09-12T16:10:45.834 INFO:teuthology.orchestra.run.smithi112.stdout:544 2023-09-12T16:10:45.834 INFO:teuthology.orchestra.run.smithi112.stdout:544.out 2023-09-12T16:10:45.834 INFO:teuthology.orchestra.run.smithi112.stdout:545 2023-09-12T16:10:45.834 INFO:teuthology.orchestra.run.smithi112.stdout:545.out 2023-09-12T16:10:45.835 INFO:teuthology.orchestra.run.smithi112.stdout:546 2023-09-12T16:10:45.835 INFO:teuthology.orchestra.run.smithi112.stdout:546.out 2023-09-12T16:10:45.835 INFO:teuthology.orchestra.run.smithi112.stdout:547 2023-09-12T16:10:45.835 INFO:teuthology.orchestra.run.smithi112.stdout:547.out 2023-09-12T16:10:45.835 INFO:teuthology.orchestra.run.smithi112.stdout:548 2023-09-12T16:10:45.836 INFO:teuthology.orchestra.run.smithi112.stdout:548.out 2023-09-12T16:10:45.836 INFO:teuthology.orchestra.run.smithi112.stdout:549 2023-09-12T16:10:45.836 INFO:teuthology.orchestra.run.smithi112.stdout:549.out 2023-09-12T16:10:45.836 INFO:teuthology.orchestra.run.smithi112.stdout:550 2023-09-12T16:10:45.836 INFO:teuthology.orchestra.run.smithi112.stdout:550.out 2023-09-12T16:10:45.836 INFO:teuthology.orchestra.run.smithi112.stdout:551 2023-09-12T16:10:45.837 INFO:teuthology.orchestra.run.smithi112.stdout:551.out 2023-09-12T16:10:45.837 INFO:teuthology.orchestra.run.smithi112.stdout:552 2023-09-12T16:10:45.837 INFO:teuthology.orchestra.run.smithi112.stdout:552.out 2023-09-12T16:10:45.837 INFO:teuthology.orchestra.run.smithi112.stdout:553 2023-09-12T16:10:45.837 INFO:teuthology.orchestra.run.smithi112.stdout:553.out 2023-09-12T16:10:45.838 INFO:teuthology.orchestra.run.smithi112.stdout:554 2023-09-12T16:10:45.838 INFO:teuthology.orchestra.run.smithi112.stdout:554.out 2023-09-12T16:10:45.838 INFO:teuthology.orchestra.run.smithi112.stdout:555 2023-09-12T16:10:45.838 INFO:teuthology.orchestra.run.smithi112.stdout:555.out 2023-09-12T16:10:45.838 INFO:teuthology.orchestra.run.smithi112.stdout:556 2023-09-12T16:10:45.839 INFO:teuthology.orchestra.run.smithi112.stdout:556.out 2023-09-12T16:10:45.839 INFO:teuthology.orchestra.run.smithi112.stdout:557 2023-09-12T16:10:45.839 INFO:teuthology.orchestra.run.smithi112.stdout:557.out 2023-09-12T16:10:45.839 INFO:teuthology.orchestra.run.smithi112.stdout:558 2023-09-12T16:10:45.839 INFO:teuthology.orchestra.run.smithi112.stdout:558.out 2023-09-12T16:10:45.840 INFO:teuthology.orchestra.run.smithi112.stdout:559 2023-09-12T16:10:45.840 INFO:teuthology.orchestra.run.smithi112.stdout:559.out 2023-09-12T16:10:45.840 INFO:teuthology.orchestra.run.smithi112.stdout:560 2023-09-12T16:10:45.840 INFO:teuthology.orchestra.run.smithi112.stdout:560.out 2023-09-12T16:10:45.840 INFO:teuthology.orchestra.run.smithi112.stdout:561 2023-09-12T16:10:45.840 INFO:teuthology.orchestra.run.smithi112.stdout:561.out 2023-09-12T16:10:45.841 INFO:teuthology.orchestra.run.smithi112.stdout:562 2023-09-12T16:10:45.841 INFO:teuthology.orchestra.run.smithi112.stdout:562.out 2023-09-12T16:10:45.841 INFO:teuthology.orchestra.run.smithi112.stdout:563 2023-09-12T16:10:45.841 INFO:teuthology.orchestra.run.smithi112.stdout:563.out 2023-09-12T16:10:45.841 INFO:teuthology.orchestra.run.smithi112.stdout:564 2023-09-12T16:10:45.842 INFO:teuthology.orchestra.run.smithi112.stdout:564.out 2023-09-12T16:10:45.842 INFO:teuthology.orchestra.run.smithi112.stdout:565 2023-09-12T16:10:45.842 INFO:teuthology.orchestra.run.smithi112.stdout:565.out 2023-09-12T16:10:45.842 INFO:teuthology.orchestra.run.smithi112.stdout:566 2023-09-12T16:10:45.842 INFO:teuthology.orchestra.run.smithi112.stdout:566.out 2023-09-12T16:10:45.843 INFO:teuthology.orchestra.run.smithi112.stdout:567 2023-09-12T16:10:45.843 INFO:teuthology.orchestra.run.smithi112.stdout:567.out 2023-09-12T16:10:45.843 INFO:teuthology.orchestra.run.smithi112.stdout:568 2023-09-12T16:10:45.843 INFO:teuthology.orchestra.run.smithi112.stdout:568.out 2023-09-12T16:10:45.843 INFO:teuthology.orchestra.run.smithi112.stdout:569 2023-09-12T16:10:45.844 INFO:teuthology.orchestra.run.smithi112.stdout:569.out 2023-09-12T16:10:45.844 INFO:teuthology.orchestra.run.smithi112.stdout:570 2023-09-12T16:10:45.844 INFO:teuthology.orchestra.run.smithi112.stdout:570.out 2023-09-12T16:10:45.844 INFO:teuthology.orchestra.run.smithi112.stdout:571 2023-09-12T16:10:45.844 INFO:teuthology.orchestra.run.smithi112.stdout:571.out 2023-09-12T16:10:45.844 INFO:teuthology.orchestra.run.smithi112.stdout:572 2023-09-12T16:10:45.845 INFO:teuthology.orchestra.run.smithi112.stdout:572.out 2023-09-12T16:10:45.845 INFO:teuthology.orchestra.run.smithi112.stdout:573 2023-09-12T16:10:45.845 INFO:teuthology.orchestra.run.smithi112.stdout:573.out 2023-09-12T16:10:45.845 INFO:teuthology.orchestra.run.smithi112.stdout:574 2023-09-12T16:10:45.845 INFO:teuthology.orchestra.run.smithi112.stdout:574.out 2023-09-12T16:10:45.846 INFO:teuthology.orchestra.run.smithi112.stdout:575 2023-09-12T16:10:45.846 INFO:teuthology.orchestra.run.smithi112.stdout:575.out 2023-09-12T16:10:45.846 INFO:teuthology.orchestra.run.smithi112.stdout:576 2023-09-12T16:10:45.846 INFO:teuthology.orchestra.run.smithi112.stdout:576.out 2023-09-12T16:10:45.846 INFO:teuthology.orchestra.run.smithi112.stdout:577 2023-09-12T16:10:45.846 INFO:teuthology.orchestra.run.smithi112.stdout:577.out 2023-09-12T16:10:45.847 INFO:teuthology.orchestra.run.smithi112.stdout:578 2023-09-12T16:10:45.847 INFO:teuthology.orchestra.run.smithi112.stdout:578.out 2023-09-12T16:10:45.847 INFO:teuthology.orchestra.run.smithi112.stdout:579 2023-09-12T16:10:45.847 INFO:teuthology.orchestra.run.smithi112.stdout:579.out 2023-09-12T16:10:45.847 INFO:teuthology.orchestra.run.smithi112.stdout:580 2023-09-12T16:10:45.848 INFO:teuthology.orchestra.run.smithi112.stdout:580.out 2023-09-12T16:10:45.848 INFO:teuthology.orchestra.run.smithi112.stdout:581 2023-09-12T16:10:45.848 INFO:teuthology.orchestra.run.smithi112.stdout:581.out 2023-09-12T16:10:45.848 INFO:teuthology.orchestra.run.smithi112.stdout:582 2023-09-12T16:10:45.848 INFO:teuthology.orchestra.run.smithi112.stdout:582.out 2023-09-12T16:10:45.849 INFO:teuthology.orchestra.run.smithi112.stdout:583 2023-09-12T16:10:45.849 INFO:teuthology.orchestra.run.smithi112.stdout:583.out 2023-09-12T16:10:45.849 INFO:teuthology.orchestra.run.smithi112.stdout:584 2023-09-12T16:10:45.849 INFO:teuthology.orchestra.run.smithi112.stdout:584.out 2023-09-12T16:10:45.849 INFO:teuthology.orchestra.run.smithi112.stdout:585 2023-09-12T16:10:45.849 INFO:teuthology.orchestra.run.smithi112.stdout:585.out 2023-09-12T16:10:45.850 INFO:teuthology.orchestra.run.smithi112.stdout:586 2023-09-12T16:10:45.850 INFO:teuthology.orchestra.run.smithi112.stdout:586.out 2023-09-12T16:10:45.850 INFO:teuthology.orchestra.run.smithi112.stdout:587 2023-09-12T16:10:45.850 INFO:teuthology.orchestra.run.smithi112.stdout:587.out 2023-09-12T16:10:45.850 INFO:teuthology.orchestra.run.smithi112.stdout:588 2023-09-12T16:10:45.851 INFO:teuthology.orchestra.run.smithi112.stdout:588.out 2023-09-12T16:10:45.851 INFO:teuthology.orchestra.run.smithi112.stdout:589 2023-09-12T16:10:45.851 INFO:teuthology.orchestra.run.smithi112.stdout:589.out 2023-09-12T16:10:45.851 INFO:teuthology.orchestra.run.smithi112.stdout:590 2023-09-12T16:10:45.851 INFO:teuthology.orchestra.run.smithi112.stdout:590.out 2023-09-12T16:10:45.852 INFO:teuthology.orchestra.run.smithi112.stdout:591 2023-09-12T16:10:45.852 INFO:teuthology.orchestra.run.smithi112.stdout:591.out 2023-09-12T16:10:45.852 INFO:teuthology.orchestra.run.smithi112.stdout:592 2023-09-12T16:10:45.852 INFO:teuthology.orchestra.run.smithi112.stdout:592.out 2023-09-12T16:10:45.852 INFO:teuthology.orchestra.run.smithi112.stdout:593 2023-09-12T16:10:45.853 INFO:teuthology.orchestra.run.smithi112.stdout:593.out 2023-09-12T16:10:45.853 INFO:teuthology.orchestra.run.smithi112.stdout:594 2023-09-12T16:10:45.853 INFO:teuthology.orchestra.run.smithi112.stdout:594.out 2023-09-12T16:10:45.853 INFO:teuthology.orchestra.run.smithi112.stdout:595 2023-09-12T16:10:45.853 INFO:teuthology.orchestra.run.smithi112.stdout:595.out 2023-09-12T16:10:45.853 INFO:teuthology.orchestra.run.smithi112.stdout:596 2023-09-12T16:10:45.854 INFO:teuthology.orchestra.run.smithi112.stdout:596.out 2023-09-12T16:10:45.854 INFO:teuthology.orchestra.run.smithi112.stdout:597 2023-09-12T16:10:45.854 INFO:teuthology.orchestra.run.smithi112.stdout:597.out 2023-09-12T16:10:45.854 INFO:teuthology.orchestra.run.smithi112.stdout:598 2023-09-12T16:10:45.854 INFO:teuthology.orchestra.run.smithi112.stdout:598.out 2023-09-12T16:10:45.855 INFO:teuthology.orchestra.run.smithi112.stdout:599 2023-09-12T16:10:45.855 INFO:teuthology.orchestra.run.smithi112.stdout:599.out 2023-09-12T16:10:45.855 INFO:teuthology.orchestra.run.smithi112.stdout:600 2023-09-12T16:10:45.855 INFO:teuthology.orchestra.run.smithi112.stdout:600.out 2023-09-12T16:10:45.855 INFO:teuthology.orchestra.run.smithi112.stdout:601 2023-09-12T16:10:45.855 INFO:teuthology.orchestra.run.smithi112.stdout:601.out 2023-09-12T16:10:45.856 INFO:teuthology.orchestra.run.smithi112.stdout:602 2023-09-12T16:10:45.856 INFO:teuthology.orchestra.run.smithi112.stdout:602.out 2023-09-12T16:10:45.856 INFO:teuthology.orchestra.run.smithi112.stdout:603 2023-09-12T16:10:45.856 INFO:teuthology.orchestra.run.smithi112.stdout:603.out 2023-09-12T16:10:45.856 INFO:teuthology.orchestra.run.smithi112.stdout:604 2023-09-12T16:10:45.857 INFO:teuthology.orchestra.run.smithi112.stdout:604.out 2023-09-12T16:10:45.857 INFO:teuthology.orchestra.run.smithi112.stdout:605 2023-09-12T16:10:45.857 INFO:teuthology.orchestra.run.smithi112.stdout:605.out 2023-09-12T16:10:45.857 INFO:teuthology.orchestra.run.smithi112.stdout:606 2023-09-12T16:10:45.857 INFO:teuthology.orchestra.run.smithi112.stdout:606.out 2023-09-12T16:10:45.858 INFO:teuthology.orchestra.run.smithi112.stdout:607 2023-09-12T16:10:45.858 INFO:teuthology.orchestra.run.smithi112.stdout:607.out 2023-09-12T16:10:45.858 INFO:teuthology.orchestra.run.smithi112.stdout:608 2023-09-12T16:10:45.858 INFO:teuthology.orchestra.run.smithi112.stdout:608.out 2023-09-12T16:10:45.858 INFO:teuthology.orchestra.run.smithi112.stdout:609 2023-09-12T16:10:45.859 INFO:teuthology.orchestra.run.smithi112.stdout:609.out 2023-09-12T16:10:45.859 INFO:teuthology.orchestra.run.smithi112.stdout:610 2023-09-12T16:10:45.859 INFO:teuthology.orchestra.run.smithi112.stdout:610.out 2023-09-12T16:10:45.859 INFO:teuthology.orchestra.run.smithi112.stdout:611 2023-09-12T16:10:45.859 INFO:teuthology.orchestra.run.smithi112.stdout:611.out 2023-09-12T16:10:45.860 INFO:teuthology.orchestra.run.smithi112.stdout:612 2023-09-12T16:10:45.860 INFO:teuthology.orchestra.run.smithi112.stdout:612.out 2023-09-12T16:10:45.860 INFO:teuthology.orchestra.run.smithi112.stdout:613 2023-09-12T16:10:45.860 INFO:teuthology.orchestra.run.smithi112.stdout:613.out 2023-09-12T16:10:45.860 INFO:teuthology.orchestra.run.smithi112.stdout:614 2023-09-12T16:10:45.860 INFO:teuthology.orchestra.run.smithi112.stdout:614.out 2023-09-12T16:10:45.861 INFO:teuthology.orchestra.run.smithi112.stdout:615 2023-09-12T16:10:45.861 INFO:teuthology.orchestra.run.smithi112.stdout:615.out 2023-09-12T16:10:45.861 INFO:teuthology.orchestra.run.smithi112.stdout:616 2023-09-12T16:10:45.861 INFO:teuthology.orchestra.run.smithi112.stdout:616.out 2023-09-12T16:10:45.861 INFO:teuthology.orchestra.run.smithi112.stdout:617 2023-09-12T16:10:45.862 INFO:teuthology.orchestra.run.smithi112.stdout:617.out 2023-09-12T16:10:45.862 INFO:teuthology.orchestra.run.smithi112.stdout:618 2023-09-12T16:10:45.862 INFO:teuthology.orchestra.run.smithi112.stdout:618.out 2023-09-12T16:10:45.862 INFO:teuthology.orchestra.run.smithi112.stdout:619 2023-09-12T16:10:45.862 INFO:teuthology.orchestra.run.smithi112.stdout:619.out 2023-09-12T16:10:45.863 INFO:teuthology.orchestra.run.smithi112.stdout:620 2023-09-12T16:10:45.863 INFO:teuthology.orchestra.run.smithi112.stdout:620.out 2023-09-12T16:10:45.863 INFO:teuthology.orchestra.run.smithi112.stdout:621 2023-09-12T16:10:45.863 INFO:teuthology.orchestra.run.smithi112.stdout:621.out 2023-09-12T16:10:45.863 INFO:teuthology.orchestra.run.smithi112.stdout:622 2023-09-12T16:10:45.863 INFO:teuthology.orchestra.run.smithi112.stdout:622.out 2023-09-12T16:10:45.864 INFO:teuthology.orchestra.run.smithi112.stdout:623 2023-09-12T16:10:45.864 INFO:teuthology.orchestra.run.smithi112.stdout:623.out 2023-09-12T16:10:45.864 INFO:teuthology.orchestra.run.smithi112.stdout:624 2023-09-12T16:10:45.864 INFO:teuthology.orchestra.run.smithi112.stdout:624.out 2023-09-12T16:10:45.864 INFO:teuthology.orchestra.run.smithi112.stdout:625 2023-09-12T16:10:45.864 INFO:teuthology.orchestra.run.smithi112.stdout:625.out 2023-09-12T16:10:45.865 INFO:teuthology.orchestra.run.smithi112.stdout:626 2023-09-12T16:10:45.865 INFO:teuthology.orchestra.run.smithi112.stdout:626.out 2023-09-12T16:10:45.865 INFO:teuthology.orchestra.run.smithi112.stdout:627 2023-09-12T16:10:45.865 INFO:teuthology.orchestra.run.smithi112.stdout:627.out 2023-09-12T16:10:45.865 INFO:teuthology.orchestra.run.smithi112.stdout:628 2023-09-12T16:10:45.866 INFO:teuthology.orchestra.run.smithi112.stdout:628.out 2023-09-12T16:10:45.866 INFO:teuthology.orchestra.run.smithi112.stdout:629 2023-09-12T16:10:45.866 INFO:teuthology.orchestra.run.smithi112.stdout:629.out 2023-09-12T16:10:45.866 INFO:teuthology.orchestra.run.smithi112.stdout:630 2023-09-12T16:10:45.866 INFO:teuthology.orchestra.run.smithi112.stdout:630.out 2023-09-12T16:10:45.867 INFO:teuthology.orchestra.run.smithi112.stdout:631 2023-09-12T16:10:45.867 INFO:teuthology.orchestra.run.smithi112.stdout:631.out 2023-09-12T16:10:45.867 INFO:teuthology.orchestra.run.smithi112.stdout:632 2023-09-12T16:10:45.867 INFO:teuthology.orchestra.run.smithi112.stdout:632.out 2023-09-12T16:10:45.867 INFO:teuthology.orchestra.run.smithi112.stdout:633 2023-09-12T16:10:45.868 INFO:teuthology.orchestra.run.smithi112.stdout:633.out 2023-09-12T16:10:45.868 INFO:teuthology.orchestra.run.smithi112.stdout:634 2023-09-12T16:10:45.868 INFO:teuthology.orchestra.run.smithi112.stdout:634.out 2023-09-12T16:10:45.868 INFO:teuthology.orchestra.run.smithi112.stdout:635 2023-09-12T16:10:45.868 INFO:teuthology.orchestra.run.smithi112.stdout:635.out 2023-09-12T16:10:45.869 INFO:teuthology.orchestra.run.smithi112.stdout:636 2023-09-12T16:10:45.869 INFO:teuthology.orchestra.run.smithi112.stdout:636.out 2023-09-12T16:10:45.869 INFO:teuthology.orchestra.run.smithi112.stdout:637 2023-09-12T16:10:45.869 INFO:teuthology.orchestra.run.smithi112.stdout:637.out 2023-09-12T16:10:45.869 INFO:teuthology.orchestra.run.smithi112.stdout:638 2023-09-12T16:10:45.869 INFO:teuthology.orchestra.run.smithi112.stdout:638.out 2023-09-12T16:10:45.870 INFO:teuthology.orchestra.run.smithi112.stdout:639 2023-09-12T16:10:45.870 INFO:teuthology.orchestra.run.smithi112.stdout:639.out 2023-09-12T16:10:45.870 INFO:teuthology.orchestra.run.smithi112.stdout:640 2023-09-12T16:10:45.870 INFO:teuthology.orchestra.run.smithi112.stdout:640.out 2023-09-12T16:10:45.870 INFO:teuthology.orchestra.run.smithi112.stdout:641 2023-09-12T16:10:45.871 INFO:teuthology.orchestra.run.smithi112.stdout:641.out 2023-09-12T16:10:45.871 INFO:teuthology.orchestra.run.smithi112.stdout:642 2023-09-12T16:10:45.871 INFO:teuthology.orchestra.run.smithi112.stdout:642.out 2023-09-12T16:10:45.871 INFO:teuthology.orchestra.run.smithi112.stdout:643 2023-09-12T16:10:45.871 INFO:teuthology.orchestra.run.smithi112.stdout:643.out 2023-09-12T16:10:45.871 INFO:teuthology.orchestra.run.smithi112.stdout:644 2023-09-12T16:10:45.872 INFO:teuthology.orchestra.run.smithi112.stdout:644.out 2023-09-12T16:10:45.872 INFO:teuthology.orchestra.run.smithi112.stdout:645 2023-09-12T16:10:45.872 INFO:teuthology.orchestra.run.smithi112.stdout:645.out 2023-09-12T16:10:45.872 INFO:teuthology.orchestra.run.smithi112.stdout:646 2023-09-12T16:10:45.872 INFO:teuthology.orchestra.run.smithi112.stdout:646.out 2023-09-12T16:10:45.873 INFO:teuthology.orchestra.run.smithi112.stdout:647 2023-09-12T16:10:45.873 INFO:teuthology.orchestra.run.smithi112.stdout:647.out 2023-09-12T16:10:45.873 INFO:teuthology.orchestra.run.smithi112.stdout:648 2023-09-12T16:10:45.873 INFO:teuthology.orchestra.run.smithi112.stdout:648.out 2023-09-12T16:10:45.873 INFO:teuthology.orchestra.run.smithi112.stdout:649 2023-09-12T16:10:45.873 INFO:teuthology.orchestra.run.smithi112.stdout:649.out 2023-09-12T16:10:45.874 INFO:teuthology.orchestra.run.smithi112.stdout:650 2023-09-12T16:10:45.874 INFO:teuthology.orchestra.run.smithi112.stdout:650.out 2023-09-12T16:10:45.874 INFO:teuthology.orchestra.run.smithi112.stdout:651 2023-09-12T16:10:45.874 INFO:teuthology.orchestra.run.smithi112.stdout:651.out 2023-09-12T16:10:45.874 INFO:teuthology.orchestra.run.smithi112.stdout:652 2023-09-12T16:10:45.874 INFO:teuthology.orchestra.run.smithi112.stdout:652.out 2023-09-12T16:10:45.875 INFO:teuthology.orchestra.run.smithi112.stdout:653 2023-09-12T16:10:45.875 INFO:teuthology.orchestra.run.smithi112.stdout:653.out 2023-09-12T16:10:45.875 INFO:teuthology.orchestra.run.smithi112.stdout:654 2023-09-12T16:10:45.875 INFO:teuthology.orchestra.run.smithi112.stdout:654.out 2023-09-12T16:10:45.875 INFO:teuthology.orchestra.run.smithi112.stdout:655 2023-09-12T16:10:45.875 INFO:teuthology.orchestra.run.smithi112.stdout:655.out 2023-09-12T16:10:45.876 INFO:teuthology.orchestra.run.smithi112.stdout:656 2023-09-12T16:10:45.876 INFO:teuthology.orchestra.run.smithi112.stdout:656.out 2023-09-12T16:10:45.876 INFO:teuthology.orchestra.run.smithi112.stdout:657 2023-09-12T16:10:45.876 INFO:teuthology.orchestra.run.smithi112.stdout:657.out 2023-09-12T16:10:45.876 INFO:teuthology.orchestra.run.smithi112.stdout:658 2023-09-12T16:10:45.877 INFO:teuthology.orchestra.run.smithi112.stdout:658.out 2023-09-12T16:10:45.877 INFO:teuthology.orchestra.run.smithi112.stdout:659 2023-09-12T16:10:45.877 INFO:teuthology.orchestra.run.smithi112.stdout:659.out 2023-09-12T16:10:45.877 INFO:teuthology.orchestra.run.smithi112.stdout:660 2023-09-12T16:10:45.877 INFO:teuthology.orchestra.run.smithi112.stdout:660.out 2023-09-12T16:10:45.877 INFO:teuthology.orchestra.run.smithi112.stdout:661 2023-09-12T16:10:45.878 INFO:teuthology.orchestra.run.smithi112.stdout:661.out 2023-09-12T16:10:45.878 INFO:teuthology.orchestra.run.smithi112.stdout:662 2023-09-12T16:10:45.878 INFO:teuthology.orchestra.run.smithi112.stdout:662.out 2023-09-12T16:10:45.878 INFO:teuthology.orchestra.run.smithi112.stdout:663 2023-09-12T16:10:45.878 INFO:teuthology.orchestra.run.smithi112.stdout:663.out 2023-09-12T16:10:45.879 INFO:teuthology.orchestra.run.smithi112.stdout:664 2023-09-12T16:10:45.879 INFO:teuthology.orchestra.run.smithi112.stdout:664.out 2023-09-12T16:10:45.879 INFO:teuthology.orchestra.run.smithi112.stdout:665 2023-09-12T16:10:45.879 INFO:teuthology.orchestra.run.smithi112.stdout:665.out 2023-09-12T16:10:45.879 INFO:teuthology.orchestra.run.smithi112.stdout:666 2023-09-12T16:10:45.880 INFO:teuthology.orchestra.run.smithi112.stdout:666.out 2023-09-12T16:10:45.880 INFO:teuthology.orchestra.run.smithi112.stdout:667 2023-09-12T16:10:45.880 INFO:teuthology.orchestra.run.smithi112.stdout:667.out 2023-09-12T16:10:45.880 INFO:teuthology.orchestra.run.smithi112.stdout:668 2023-09-12T16:10:45.880 INFO:teuthology.orchestra.run.smithi112.stdout:668.out 2023-09-12T16:10:45.880 INFO:teuthology.orchestra.run.smithi112.stdout:669 2023-09-12T16:10:45.881 INFO:teuthology.orchestra.run.smithi112.stdout:669.out 2023-09-12T16:10:45.881 INFO:teuthology.orchestra.run.smithi112.stdout:670 2023-09-12T16:10:45.881 INFO:teuthology.orchestra.run.smithi112.stdout:670.out 2023-09-12T16:10:45.881 INFO:teuthology.orchestra.run.smithi112.stdout:671 2023-09-12T16:10:45.881 INFO:teuthology.orchestra.run.smithi112.stdout:671.out 2023-09-12T16:10:45.882 INFO:teuthology.orchestra.run.smithi112.stdout:672 2023-09-12T16:10:45.882 INFO:teuthology.orchestra.run.smithi112.stdout:672.out 2023-09-12T16:10:45.882 INFO:teuthology.orchestra.run.smithi112.stdout:673 2023-09-12T16:10:45.882 INFO:teuthology.orchestra.run.smithi112.stdout:673.out 2023-09-12T16:10:45.882 INFO:teuthology.orchestra.run.smithi112.stdout:674 2023-09-12T16:10:45.883 INFO:teuthology.orchestra.run.smithi112.stdout:674.out 2023-09-12T16:10:45.883 INFO:teuthology.orchestra.run.smithi112.stdout:675 2023-09-12T16:10:45.883 INFO:teuthology.orchestra.run.smithi112.stdout:675.out 2023-09-12T16:10:45.883 INFO:teuthology.orchestra.run.smithi112.stdout:676 2023-09-12T16:10:45.883 INFO:teuthology.orchestra.run.smithi112.stdout:676.out 2023-09-12T16:10:45.883 INFO:teuthology.orchestra.run.smithi112.stdout:677 2023-09-12T16:10:45.884 INFO:teuthology.orchestra.run.smithi112.stdout:677.out 2023-09-12T16:10:45.884 INFO:teuthology.orchestra.run.smithi112.stdout:678 2023-09-12T16:10:45.884 INFO:teuthology.orchestra.run.smithi112.stdout:678.out 2023-09-12T16:10:45.884 INFO:teuthology.orchestra.run.smithi112.stdout:679 2023-09-12T16:10:45.884 INFO:teuthology.orchestra.run.smithi112.stdout:679.out 2023-09-12T16:10:45.885 INFO:teuthology.orchestra.run.smithi112.stdout:680 2023-09-12T16:10:45.885 INFO:teuthology.orchestra.run.smithi112.stdout:680.out 2023-09-12T16:10:45.885 INFO:teuthology.orchestra.run.smithi112.stdout:681 2023-09-12T16:10:45.885 INFO:teuthology.orchestra.run.smithi112.stdout:681.out 2023-09-12T16:10:45.885 INFO:teuthology.orchestra.run.smithi112.stdout:682 2023-09-12T16:10:45.885 INFO:teuthology.orchestra.run.smithi112.stdout:682.out 2023-09-12T16:10:45.886 INFO:teuthology.orchestra.run.smithi112.stdout:683 2023-09-12T16:10:45.886 INFO:teuthology.orchestra.run.smithi112.stdout:683.out 2023-09-12T16:10:45.886 INFO:teuthology.orchestra.run.smithi112.stdout:684 2023-09-12T16:10:45.886 INFO:teuthology.orchestra.run.smithi112.stdout:684.out 2023-09-12T16:10:45.886 INFO:teuthology.orchestra.run.smithi112.stdout:685 2023-09-12T16:10:45.887 INFO:teuthology.orchestra.run.smithi112.stdout:685.out 2023-09-12T16:10:45.887 INFO:teuthology.orchestra.run.smithi112.stdout:686 2023-09-12T16:10:45.887 INFO:teuthology.orchestra.run.smithi112.stdout:686.out 2023-09-12T16:10:45.887 INFO:teuthology.orchestra.run.smithi112.stdout:687 2023-09-12T16:10:45.887 INFO:teuthology.orchestra.run.smithi112.stdout:687.out 2023-09-12T16:10:45.888 INFO:teuthology.orchestra.run.smithi112.stdout:688 2023-09-12T16:10:45.888 INFO:teuthology.orchestra.run.smithi112.stdout:688.out 2023-09-12T16:10:45.888 INFO:teuthology.orchestra.run.smithi112.stdout:689 2023-09-12T16:10:45.888 INFO:teuthology.orchestra.run.smithi112.stdout:689.out 2023-09-12T16:10:45.888 INFO:teuthology.orchestra.run.smithi112.stdout:690 2023-09-12T16:10:45.888 INFO:teuthology.orchestra.run.smithi112.stdout:690.out 2023-09-12T16:10:45.889 INFO:teuthology.orchestra.run.smithi112.stdout:691 2023-09-12T16:10:45.889 INFO:teuthology.orchestra.run.smithi112.stdout:691.out 2023-09-12T16:10:45.889 INFO:teuthology.orchestra.run.smithi112.stdout:692 2023-09-12T16:10:45.889 INFO:teuthology.orchestra.run.smithi112.stdout:692.out 2023-09-12T16:10:45.889 INFO:teuthology.orchestra.run.smithi112.stdout:693 2023-09-12T16:10:45.890 INFO:teuthology.orchestra.run.smithi112.stdout:693.out 2023-09-12T16:10:45.890 INFO:teuthology.orchestra.run.smithi112.stdout:694 2023-09-12T16:10:45.890 INFO:teuthology.orchestra.run.smithi112.stdout:694.out 2023-09-12T16:10:45.890 INFO:teuthology.orchestra.run.smithi112.stdout:695 2023-09-12T16:10:45.890 INFO:teuthology.orchestra.run.smithi112.stdout:695.out 2023-09-12T16:10:45.891 INFO:teuthology.orchestra.run.smithi112.stdout:696 2023-09-12T16:10:45.891 INFO:teuthology.orchestra.run.smithi112.stdout:696.out 2023-09-12T16:10:45.891 INFO:teuthology.orchestra.run.smithi112.stdout:697 2023-09-12T16:10:45.891 INFO:teuthology.orchestra.run.smithi112.stdout:697.out 2023-09-12T16:10:45.891 INFO:teuthology.orchestra.run.smithi112.stdout:698 2023-09-12T16:10:45.891 INFO:teuthology.orchestra.run.smithi112.stdout:698.out 2023-09-12T16:10:45.892 INFO:teuthology.orchestra.run.smithi112.stdout:699 2023-09-12T16:10:45.892 INFO:teuthology.orchestra.run.smithi112.stdout:699.out 2023-09-12T16:10:45.892 INFO:teuthology.orchestra.run.smithi112.stdout:700 2023-09-12T16:10:45.892 INFO:teuthology.orchestra.run.smithi112.stdout:700.out 2023-09-12T16:10:45.892 INFO:teuthology.orchestra.run.smithi112.stdout:701 2023-09-12T16:10:45.893 INFO:teuthology.orchestra.run.smithi112.stdout:701.out 2023-09-12T16:10:45.893 INFO:teuthology.orchestra.run.smithi112.stdout:702 2023-09-12T16:10:45.893 INFO:teuthology.orchestra.run.smithi112.stdout:702.out 2023-09-12T16:10:45.893 INFO:teuthology.orchestra.run.smithi112.stdout:703 2023-09-12T16:10:45.893 INFO:teuthology.orchestra.run.smithi112.stdout:703.out 2023-09-12T16:10:45.893 INFO:teuthology.orchestra.run.smithi112.stdout:704 2023-09-12T16:10:45.894 INFO:teuthology.orchestra.run.smithi112.stdout:704.out 2023-09-12T16:10:45.894 INFO:teuthology.orchestra.run.smithi112.stdout:705 2023-09-12T16:10:45.894 INFO:teuthology.orchestra.run.smithi112.stdout:705.out 2023-09-12T16:10:45.894 INFO:teuthology.orchestra.run.smithi112.stdout:706 2023-09-12T16:10:45.894 INFO:teuthology.orchestra.run.smithi112.stdout:706.out 2023-09-12T16:10:45.895 INFO:teuthology.orchestra.run.smithi112.stdout:707 2023-09-12T16:10:45.895 INFO:teuthology.orchestra.run.smithi112.stdout:707.out 2023-09-12T16:10:45.895 INFO:teuthology.orchestra.run.smithi112.stdout:708 2023-09-12T16:10:45.895 INFO:teuthology.orchestra.run.smithi112.stdout:708.out 2023-09-12T16:10:45.895 INFO:teuthology.orchestra.run.smithi112.stdout:709 2023-09-12T16:10:45.895 INFO:teuthology.orchestra.run.smithi112.stdout:709.out 2023-09-12T16:10:45.896 INFO:teuthology.orchestra.run.smithi112.stdout:710 2023-09-12T16:10:45.896 INFO:teuthology.orchestra.run.smithi112.stdout:710.out 2023-09-12T16:10:45.896 INFO:teuthology.orchestra.run.smithi112.stdout:711 2023-09-12T16:10:45.896 INFO:teuthology.orchestra.run.smithi112.stdout:711.out 2023-09-12T16:10:45.896 INFO:teuthology.orchestra.run.smithi112.stdout:712 2023-09-12T16:10:45.896 INFO:teuthology.orchestra.run.smithi112.stdout:712.out 2023-09-12T16:10:45.897 INFO:teuthology.orchestra.run.smithi112.stdout:713 2023-09-12T16:10:45.897 INFO:teuthology.orchestra.run.smithi112.stdout:713.out 2023-09-12T16:10:45.897 INFO:teuthology.orchestra.run.smithi112.stdout:714 2023-09-12T16:10:45.897 INFO:teuthology.orchestra.run.smithi112.stdout:714.out 2023-09-12T16:10:45.897 INFO:teuthology.orchestra.run.smithi112.stdout:715 2023-09-12T16:10:45.898 INFO:teuthology.orchestra.run.smithi112.stdout:715.out 2023-09-12T16:10:45.898 INFO:teuthology.orchestra.run.smithi112.stdout:716 2023-09-12T16:10:45.898 INFO:teuthology.orchestra.run.smithi112.stdout:716.out 2023-09-12T16:10:45.898 INFO:teuthology.orchestra.run.smithi112.stdout:717 2023-09-12T16:10:45.898 INFO:teuthology.orchestra.run.smithi112.stdout:717.out 2023-09-12T16:10:45.898 INFO:teuthology.orchestra.run.smithi112.stdout:718 2023-09-12T16:10:45.899 INFO:teuthology.orchestra.run.smithi112.stdout:718.out 2023-09-12T16:10:45.899 INFO:teuthology.orchestra.run.smithi112.stdout:719 2023-09-12T16:10:45.899 INFO:teuthology.orchestra.run.smithi112.stdout:719.out 2023-09-12T16:10:45.899 INFO:teuthology.orchestra.run.smithi112.stdout:720 2023-09-12T16:10:45.899 INFO:teuthology.orchestra.run.smithi112.stdout:720.out 2023-09-12T16:10:45.900 INFO:teuthology.orchestra.run.smithi112.stdout:721 2023-09-12T16:10:45.900 INFO:teuthology.orchestra.run.smithi112.stdout:721.out 2023-09-12T16:10:45.900 INFO:teuthology.orchestra.run.smithi112.stdout:722 2023-09-12T16:10:45.900 INFO:teuthology.orchestra.run.smithi112.stdout:722.out 2023-09-12T16:10:45.900 INFO:teuthology.orchestra.run.smithi112.stdout:723 2023-09-12T16:10:45.901 INFO:teuthology.orchestra.run.smithi112.stdout:723.out 2023-09-12T16:10:45.901 INFO:teuthology.orchestra.run.smithi112.stdout:724 2023-09-12T16:10:45.901 INFO:teuthology.orchestra.run.smithi112.stdout:724.out 2023-09-12T16:10:45.901 INFO:teuthology.orchestra.run.smithi112.stdout:725 2023-09-12T16:10:45.901 INFO:teuthology.orchestra.run.smithi112.stdout:725.out 2023-09-12T16:10:45.901 INFO:teuthology.orchestra.run.smithi112.stdout:726 2023-09-12T16:10:45.902 INFO:teuthology.orchestra.run.smithi112.stdout:726.out 2023-09-12T16:10:45.902 INFO:teuthology.orchestra.run.smithi112.stdout:727 2023-09-12T16:10:45.902 INFO:teuthology.orchestra.run.smithi112.stdout:727.out 2023-09-12T16:10:45.902 INFO:teuthology.orchestra.run.smithi112.stdout:728 2023-09-12T16:10:45.902 INFO:teuthology.orchestra.run.smithi112.stdout:728.out 2023-09-12T16:10:45.903 INFO:teuthology.orchestra.run.smithi112.stdout:729 2023-09-12T16:10:45.903 INFO:teuthology.orchestra.run.smithi112.stdout:729.out 2023-09-12T16:10:45.903 INFO:teuthology.orchestra.run.smithi112.stdout:730 2023-09-12T16:10:45.903 INFO:teuthology.orchestra.run.smithi112.stdout:730.out 2023-09-12T16:10:45.903 INFO:teuthology.orchestra.run.smithi112.stdout:731 2023-09-12T16:10:45.903 INFO:teuthology.orchestra.run.smithi112.stdout:731.out 2023-09-12T16:10:45.904 INFO:teuthology.orchestra.run.smithi112.stdout:group.list 2023-09-12T16:10:45.904 INFO:teuthology.orchestra.run.smithi112.stdout:Makefile 2023-09-12T16:10:45.905 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-09-12T16:10:46.658 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:10:46.671 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:10:46.672 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:10:46.674 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:10:46.675 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:10:54.875 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:10:54.881 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:10:55.973 INFO:teuthology.orchestra.run.smithi112.stdout:generic/001 9s 2023-09-12T16:10:55.985 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/001 2023-09-12T16:10:55.986 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:10:55.991 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:10:56.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:10:56.213 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-09-12T16:10:56.742 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:10:56.755 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:10:56.756 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:10:56.759 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:10:56.759 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:10:57.572 INFO:teuthology.orchestra.run.smithi112.stdout:generic/002 1s 2023-09-12T16:10:57.585 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/002 2023-09-12T16:10:57.585 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:10:57.591 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:10:57.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:10:57.668 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-09-12T16:10:58.121 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:10:58.133 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:10:58.134 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:10:58.137 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:10:58.137 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:10:58.644 INFO:teuthology.orchestra.run.smithi112.stdout:generic/003 [not run] atime not maintained by ceph 2023-09-12T16:10:58.654 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/003 2023-09-12T16:10:58.655 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/003 2023-09-12T16:10:58.655 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:10:58.662 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:10:58.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:10:58.700 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-09-12T16:10:59.150 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:10:59.163 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:10:59.164 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:10:59.167 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:10:59.167 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:10:59.669 INFO:teuthology.orchestra.run.smithi112.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-09-12T16:10:59.678 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/004 2023-09-12T16:10:59.679 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/004 2023-09-12T16:10:59.679 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:10:59.684 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:10:59.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:10:59.720 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-09-12T16:11:00.158 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:11:00.171 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:11:00.172 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:11:00.175 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:11:00.175 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:11:00.900 INFO:teuthology.orchestra.run.smithi112.stdout:generic/005 0s 2023-09-12T16:11:00.913 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/005 2023-09-12T16:11:00.913 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:11:00.919 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:11:01.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:11:01.024 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-09-12T16:11:01.482 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:11:01.495 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:11:01.496 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:11:01.498 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:11:01.499 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:11:25.015 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:11:25.021 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:11:36.177 INFO:teuthology.orchestra.run.smithi112.stdout:generic/006 35s 2023-09-12T16:11:39.513 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/006 2023-09-12T16:11:39.513 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:11:39.520 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:11:39.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:11:39.590 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-09-12T16:11:40.053 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:11:40.066 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:11:40.067 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:11:40.069 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:11:40.070 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:11:55.176 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:11:55.182 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:12:25.456 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:12:25.462 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:12:29.065 INFO:teuthology.orchestra.run.smithi112.stdout:generic/007 49s 2023-09-12T16:12:29.077 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/007 2023-09-12T16:12:29.078 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:12:29.083 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:12:29.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:12:29.173 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-09-12T16:12:29.658 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:12:29.682 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:12:29.684 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:12:29.691 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:12:29.692 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:12:30.334 INFO:teuthology.orchestra.run.smithi112.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-12T16:12:30.344 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/008 2023-09-12T16:12:30.344 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/008 2023-09-12T16:12:30.344 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:12:30.350 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:12:30.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:12:30.403 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-09-12T16:12:31.093 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:12:31.105 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:12:31.106 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:12:31.109 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:12:31.109 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:12:31.701 INFO:teuthology.orchestra.run.smithi112.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-12T16:12:31.711 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/009 2023-09-12T16:12:31.711 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/009 2023-09-12T16:12:31.711 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:12:31.717 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:12:31.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:12:31.759 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-09-12T16:12:32.204 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:12:32.216 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:12:32.217 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:12:32.220 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:12:32.220 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:12:32.698 INFO:teuthology.orchestra.run.smithi112.stdout:generic/010 [not run] /tmp/tmp.X1XCSigEoUxfstests-dev/src/dbtest not built 2023-09-12T16:12:32.708 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/010 2023-09-12T16:12:32.708 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/010 2023-09-12T16:12:32.708 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:12:32.714 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:12:32.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:12:32.747 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-09-12T16:12:33.189 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:12:33.202 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:12:33.203 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:12:33.206 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:12:33.206 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:12:55.575 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:12:55.581 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:13:02.463 INFO:teuthology.orchestra.run.smithi112.stdout:generic/011 29s 2023-09-12T16:13:02.476 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/011 2023-09-12T16:13:02.476 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:13:02.482 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:13:02.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:13:02.640 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-09-12T16:13:03.164 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:13:03.176 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:13:03.177 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:13:03.180 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:13:03.180 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:13:03.818 INFO:teuthology.orchestra.run.smithi112.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T16:13:03.828 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/012 2023-09-12T16:13:03.828 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/012 2023-09-12T16:13:03.828 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:13:03.833 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:13:03.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:13:03.917 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-09-12T16:13:04.375 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:13:04.387 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:13:04.388 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:13:04.391 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:13:04.391 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:13:25.889 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:13:25.907 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:13:56.816 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:13:56.822 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:14:21.811 INFO:teuthology.orchestra.run.smithi112.stdout:generic/013 76s 2023-09-12T16:14:21.832 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/013 2023-09-12T16:14:21.833 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:14:21.841 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:14:21.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:14:21.899 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-09-12T16:14:22.758 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:14:22.778 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:14:22.779 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:14:22.782 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:14:22.782 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:14:27.018 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:14:27.026 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:14:58.711 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:14:58.717 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:15:31.076 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:15:31.084 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:16:01.248 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:16:01.260 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:16:32.536 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:16:32.542 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:17:03.807 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:17:03.813 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:17:36.438 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:17:36.448 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:18:07.144 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:18:07.152 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:18:37.916 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:18:37.921 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:19:00.021 INFO:teuthology.orchestra.run.smithi112.stdout:generic/014 277s 2023-09-12T16:19:01.279 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/014 2023-09-12T16:19:01.279 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:19:01.290 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:01.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:19:01.346 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-09-12T16:19:02.043 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:19:02.062 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:19:02.063 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:19:02.068 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:19:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:02.772 INFO:teuthology.orchestra.run.smithi112.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-12T16:19:02.785 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/015 2023-09-12T16:19:02.786 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/015 2023-09-12T16:19:02.786 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:19:02.793 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:02.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:19:02.848 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-09-12T16:19:03.457 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:19:03.469 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:19:03.470 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:19:03.473 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:19:03.473 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:04.464 INFO:teuthology.orchestra.run.smithi112.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T16:19:04.479 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/016 2023-09-12T16:19:04.479 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/016 2023-09-12T16:19:04.479 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:19:04.489 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:04.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:19:04.622 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-09-12T16:19:05.393 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:19:05.414 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:19:05.416 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:19:05.421 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:19:05.421 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:06.182 INFO:teuthology.orchestra.run.smithi112.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-12T16:19:06.195 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/017 2023-09-12T16:19:06.196 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/017 2023-09-12T16:19:06.196 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:19:06.208 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:06.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:19:06.262 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-09-12T16:19:06.921 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:19:06.939 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:19:06.940 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:19:06.946 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:19:06.946 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:07.841 INFO:teuthology.orchestra.run.smithi112.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-09-12T16:19:07.875 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/018 2023-09-12T16:19:07.876 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/018 2023-09-12T16:19:07.876 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:19:07.883 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:07.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:19:07.941 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-09-12T16:19:08.205 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:19:08.211 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:19:08.668 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:19:08.683 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:19:08.684 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:19:08.688 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:19:08.688 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:09.388 INFO:teuthology.orchestra.run.smithi112.stdout:generic/019 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T16:19:09.403 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/019 2023-09-12T16:19:09.403 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/019 2023-09-12T16:19:09.403 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:19:09.412 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:09.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:19:09.457 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-09-12T16:19:10.135 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:19:10.155 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:19:10.157 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:19:10.161 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:19:10.161 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:18.132 INFO:teuthology.orchestra.run.smithi112.stdout:generic/020 8s 2023-09-12T16:19:18.151 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/020 2023-09-12T16:19:18.151 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:19:18.160 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:18.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:19:18.278 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-09-12T16:19:19.104 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:19:19.124 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:19:19.126 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:19:19.130 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:19:19.131 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:20.056 INFO:teuthology.orchestra.run.smithi112.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T16:19:20.068 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/021 2023-09-12T16:19:20.069 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/021 2023-09-12T16:19:20.069 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:19:20.076 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:20.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:19:20.244 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-09-12T16:19:21.013 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:19:21.030 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:19:21.032 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:19:21.035 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:19:21.036 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:22.008 INFO:teuthology.orchestra.run.smithi112.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T16:19:22.025 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/022 2023-09-12T16:19:22.026 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/022 2023-09-12T16:19:22.026 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:19:22.033 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:22.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:19:22.164 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-09-12T16:19:22.949 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:19:22.968 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:19:22.970 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:19:22.973 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:19:22.973 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:25.480 INFO:teuthology.orchestra.run.smithi112.stdout:generic/023 2s 2023-09-12T16:19:25.502 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/023 2023-09-12T16:19:25.502 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:19:25.511 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:25.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:19:25.701 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-09-12T16:19:26.521 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:19:26.541 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:19:26.542 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:19:26.545 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:19:26.545 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:27.273 INFO:teuthology.orchestra.run.smithi112.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-09-12T16:19:27.289 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/024 2023-09-12T16:19:27.289 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/024 2023-09-12T16:19:27.289 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:19:27.301 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:27.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:19:27.425 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-09-12T16:19:28.213 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:19:28.232 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:19:28.234 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:19:28.238 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:19:28.238 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:28.972 INFO:teuthology.orchestra.run.smithi112.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-09-12T16:19:28.987 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/025 2023-09-12T16:19:28.987 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/025 2023-09-12T16:19:28.987 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:19:28.996 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:29.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:19:29.111 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-09-12T16:19:29.916 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:19:29.938 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:19:29.941 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:19:29.945 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:19:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:30.736 INFO:teuthology.orchestra.run.smithi112.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-09-12T16:19:30.749 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/026 2023-09-12T16:19:30.749 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/026 2023-09-12T16:19:30.749 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:19:30.757 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:30.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:19:30.827 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-09-12T16:19:31.481 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:19:31.824 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:19:31.824 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:19:31.824 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:19:31.824 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:32.216 INFO:teuthology.orchestra.run.smithi112.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-12T16:19:32.231 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/027 2023-09-12T16:19:32.231 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/027 2023-09-12T16:19:32.231 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:19:32.242 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:32.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:19:32.298 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-09-12T16:19:32.989 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:19:33.010 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:19:33.011 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:19:33.015 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:19:33.015 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:38.649 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:19:38.659 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:19:38.786 INFO:teuthology.orchestra.run.smithi112.stdout:generic/028 5s 2023-09-12T16:19:38.807 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/028 2023-09-12T16:19:38.807 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:19:38.815 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:38.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:19:38.876 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-09-12T16:19:39.593 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:19:39.609 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:19:39.611 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:19:39.613 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:19:39.614 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:42.752 INFO:teuthology.orchestra.run.smithi112.stdout:generic/029 3s 2023-09-12T16:19:42.772 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/029 2023-09-12T16:19:42.772 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:19:42.782 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:42.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:19:42.812 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-09-12T16:19:43.456 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:19:43.476 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:19:43.477 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:19:43.481 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:19:43.481 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:46.060 INFO:teuthology.orchestra.run.smithi112.stdout:generic/030 3s 2023-09-12T16:19:46.084 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/030 2023-09-12T16:19:46.084 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:19:46.093 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:46.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:19:46.130 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-09-12T16:19:46.799 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:19:46.817 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:19:46.819 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:19:46.821 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:19:46.822 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:47.724 INFO:teuthology.orchestra.run.smithi112.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-09-12T16:19:47.740 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/031 2023-09-12T16:19:47.740 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/031 2023-09-12T16:19:47.741 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:19:47.751 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:47.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:19:47.825 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-09-12T16:19:48.514 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:19:48.541 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:19:48.541 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:19:48.543 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:19:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:49.323 INFO:teuthology.orchestra.run.smithi112.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T16:19:49.335 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/032 2023-09-12T16:19:49.336 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/032 2023-09-12T16:19:49.336 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:19:49.348 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:49.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:19:49.401 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-09-12T16:19:50.089 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:19:50.108 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:19:50.109 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:19:50.112 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:19:50.112 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:51.023 INFO:teuthology.orchestra.run.smithi112.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-12T16:19:51.038 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/033 2023-09-12T16:19:51.038 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/033 2023-09-12T16:19:51.042 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:19:51.046 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:51.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:19:51.106 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-09-12T16:19:51.792 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:19:51.814 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:19:51.815 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:19:51.819 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:19:51.819 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:52.574 INFO:teuthology.orchestra.run.smithi112.stdout:generic/034 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T16:19:52.597 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/034 2023-09-12T16:19:52.598 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/034 2023-09-12T16:19:52.598 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:19:52.605 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:52.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:19:52.652 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-09-12T16:19:53.332 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:19:53.350 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:19:53.351 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:19:53.358 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:19:53.358 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:54.225 INFO:teuthology.orchestra.run.smithi112.stdout:generic/035 1s 2023-09-12T16:19:54.246 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/035 2023-09-12T16:19:54.247 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:19:54.257 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:19:54.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:19:54.383 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-09-12T16:19:55.165 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:19:55.193 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:19:55.194 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:19:55.197 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:19:55.197 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:06.107 INFO:teuthology.orchestra.run.smithi112.stdout:generic/036 11s 2023-09-12T16:20:06.128 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/036 2023-09-12T16:20:06.128 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:06.138 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:06.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:06.275 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-09-12T16:20:07.051 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:07.071 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:07.073 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:07.076 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:07.077 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:08.809 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:20:08.819 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:20:15.177 INFO:teuthology.orchestra.run.smithi112.stdout:generic/037 8s 2023-09-12T16:20:15.190 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/037 2023-09-12T16:20:15.191 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:15.196 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:15.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:15.218 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-09-12T16:20:15.667 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:15.680 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:15.681 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:15.683 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:15.683 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:16.187 INFO:teuthology.orchestra.run.smithi112.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T16:20:16.197 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/038 2023-09-12T16:20:16.198 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/038 2023-09-12T16:20:16.198 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:16.204 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:16.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:16.251 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-09-12T16:20:16.701 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:16.713 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:16.715 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:16.717 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:16.717 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:17.247 INFO:teuthology.orchestra.run.smithi112.stdout:generic/039 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T16:20:17.257 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/039 2023-09-12T16:20:17.257 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/039 2023-09-12T16:20:17.257 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:17.263 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:17.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:17.308 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-09-12T16:20:17.758 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:17.771 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:17.772 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:17.774 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:17.774 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:18.308 INFO:teuthology.orchestra.run.smithi112.stdout:generic/040 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T16:20:18.318 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/040 2023-09-12T16:20:18.319 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/040 2023-09-12T16:20:18.319 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:18.325 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:18.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:18.370 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-09-12T16:20:18.819 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:18.831 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:18.833 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:18.835 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:18.835 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:19.380 INFO:teuthology.orchestra.run.smithi112.stdout:generic/041 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T16:20:19.389 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/041 2023-09-12T16:20:19.390 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/041 2023-09-12T16:20:19.390 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:19.396 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:19.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:19.445 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-09-12T16:20:19.893 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:19.906 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:19.907 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:19.909 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:19.909 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:20.539 INFO:teuthology.orchestra.run.smithi112.stdout:generic/042 [not run] ceph does not support shutdown 2023-09-12T16:20:20.567 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/042 2023-09-12T16:20:20.567 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/042 2023-09-12T16:20:20.568 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:20.573 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:20.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:20.611 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-09-12T16:20:21.057 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:21.070 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:21.071 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:21.074 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:21.074 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:21.714 INFO:teuthology.orchestra.run.smithi112.stdout:generic/043 [not run] ceph does not support shutdown 2023-09-12T16:20:21.749 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/043 2023-09-12T16:20:21.750 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/043 2023-09-12T16:20:21.750 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:21.755 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:21.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:21.798 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-09-12T16:20:22.252 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:22.264 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:22.265 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:22.268 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:22.268 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:22.906 INFO:teuthology.orchestra.run.smithi112.stdout:generic/044 [not run] ceph does not support shutdown 2023-09-12T16:20:22.933 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/044 2023-09-12T16:20:22.934 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/044 2023-09-12T16:20:22.934 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:22.939 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:22.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:22.987 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-09-12T16:20:23.447 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:23.460 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:23.461 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:23.463 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:23.464 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:24.099 INFO:teuthology.orchestra.run.smithi112.stdout:generic/045 [not run] ceph does not support shutdown 2023-09-12T16:20:24.126 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/045 2023-09-12T16:20:24.126 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/045 2023-09-12T16:20:24.127 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:24.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:24.172 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-09-12T16:20:24.624 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:24.636 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:24.638 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:24.640 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:24.640 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:25.275 INFO:teuthology.orchestra.run.smithi112.stdout:generic/046 [not run] ceph does not support shutdown 2023-09-12T16:20:25.303 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/046 2023-09-12T16:20:25.304 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/046 2023-09-12T16:20:25.304 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:25.309 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:25.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:25.354 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-09-12T16:20:25.803 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:25.815 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:25.816 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:25.819 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:25.819 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:26.457 INFO:teuthology.orchestra.run.smithi112.stdout:generic/047 [not run] ceph does not support shutdown 2023-09-12T16:20:26.488 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/047 2023-09-12T16:20:26.489 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/047 2023-09-12T16:20:26.489 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:26.494 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:26.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:26.536 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-09-12T16:20:26.988 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:27.001 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:27.002 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:27.005 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:27.005 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:27.640 INFO:teuthology.orchestra.run.smithi112.stdout:generic/048 [not run] ceph does not support shutdown 2023-09-12T16:20:27.663 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/048 2023-09-12T16:20:27.663 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/048 2023-09-12T16:20:27.664 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:27.669 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:27.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:27.705 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-09-12T16:20:28.151 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:28.164 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:28.165 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:28.168 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:28.168 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:28.800 INFO:teuthology.orchestra.run.smithi112.stdout:generic/049 [not run] ceph does not support shutdown 2023-09-12T16:20:28.830 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/049 2023-09-12T16:20:28.830 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/049 2023-09-12T16:20:28.831 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:28.836 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:28.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:28.878 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-09-12T16:20:29.324 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:29.337 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:29.338 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:29.341 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:29.341 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:29.984 INFO:teuthology.orchestra.run.smithi112.stdout:generic/050 [not run] ceph does not support shutdown 2023-09-12T16:20:30.011 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/050 2023-09-12T16:20:30.011 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/050 2023-09-12T16:20:30.012 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:30.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:30.055 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-09-12T16:20:30.503 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:30.516 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:30.517 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:30.519 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:30.520 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:31.185 INFO:teuthology.orchestra.run.smithi112.stdout:generic/051 [not run] ceph does not support shutdown 2023-09-12T16:20:31.195 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/051 2023-09-12T16:20:31.196 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/051 2023-09-12T16:20:31.196 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:31.202 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:31.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:31.240 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-09-12T16:20:31.690 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:31.702 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:31.703 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:31.706 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:31.706 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:32.345 INFO:teuthology.orchestra.run.smithi112.stdout:generic/052 [not run] ceph does not support shutdown 2023-09-12T16:20:32.371 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/052 2023-09-12T16:20:32.372 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/052 2023-09-12T16:20:32.372 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:32.377 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:32.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:32.419 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-09-12T16:20:32.867 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:32.880 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:32.881 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:32.884 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:34.060 INFO:teuthology.orchestra.run.smithi112.stdout:generic/053 1s 2023-09-12T16:20:34.086 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/053 2023-09-12T16:20:34.087 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:34.099 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:34.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:34.144 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-09-12T16:20:34.603 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:34.616 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:34.617 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:34.619 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:34.620 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:35.288 INFO:teuthology.orchestra.run.smithi112.stdout:generic/054 [not run] ceph does not support shutdown 2023-09-12T16:20:35.312 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/054 2023-09-12T16:20:35.312 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/054 2023-09-12T16:20:35.312 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:35.318 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:35.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:35.355 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-09-12T16:20:35.808 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:35.820 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:35.821 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:35.824 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:35.824 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:36.478 INFO:teuthology.orchestra.run.smithi112.stdout:generic/055 [not run] ceph does not support shutdown 2023-09-12T16:20:36.505 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/055 2023-09-12T16:20:36.505 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/055 2023-09-12T16:20:36.506 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:36.511 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:36.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:36.548 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-09-12T16:20:36.997 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:37.010 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:37.011 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:37.013 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:37.014 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:37.543 INFO:teuthology.orchestra.run.smithi112.stdout:generic/056 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T16:20:37.553 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/056 2023-09-12T16:20:37.554 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/056 2023-09-12T16:20:37.554 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:37.560 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:37.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:37.600 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-09-12T16:20:38.048 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:38.061 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:38.062 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:38.064 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:38.065 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:38.594 INFO:teuthology.orchestra.run.smithi112.stdout:generic/057 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T16:20:38.604 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/057 2023-09-12T16:20:38.605 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/057 2023-09-12T16:20:38.605 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:38.610 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:38.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:38.655 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-09-12T16:20:39.102 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:39.115 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:39.116 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:39.119 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:39.119 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:39.493 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:20:39.498 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:20:39.784 INFO:teuthology.orchestra.run.smithi112.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T16:20:39.793 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/058 2023-09-12T16:20:39.794 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/058 2023-09-12T16:20:39.794 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:39.799 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:39.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:39.924 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-09-12T16:20:40.530 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:40.543 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:40.544 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:40.547 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:40.547 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:41.064 INFO:teuthology.orchestra.run.smithi112.stdout:generic/059 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T16:20:41.074 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/059 2023-09-12T16:20:41.074 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/059 2023-09-12T16:20:41.074 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:41.080 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:41.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:41.120 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-09-12T16:20:41.574 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:41.587 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:41.588 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:41.590 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:41.591 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:42.234 INFO:teuthology.orchestra.run.smithi112.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T16:20:42.244 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/060 2023-09-12T16:20:42.244 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/060 2023-09-12T16:20:42.244 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:42.250 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:42.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:42.413 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-09-12T16:20:42.973 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:42.986 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:42.987 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:42.989 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:42.990 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:43.637 INFO:teuthology.orchestra.run.smithi112.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T16:20:43.647 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/061 2023-09-12T16:20:43.647 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/061 2023-09-12T16:20:43.648 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:43.653 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:43.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:43.763 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-09-12T16:20:44.384 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:44.396 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:44.398 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:44.400 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:46.979 INFO:teuthology.orchestra.run.smithi112.stdout:generic/062 2s 2023-09-12T16:20:47.050 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/062 2023-09-12T16:20:47.050 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:47.063 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:47.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:47.110 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-09-12T16:20:47.605 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:47.618 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:47.619 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:47.621 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:47.622 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:48.304 INFO:teuthology.orchestra.run.smithi112.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T16:20:48.314 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/063 2023-09-12T16:20:48.315 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/063 2023-09-12T16:20:48.315 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:48.320 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:48.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:48.462 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-09-12T16:20:49.058 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:49.070 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:49.072 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:49.074 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:49.075 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:49.578 INFO:teuthology.orchestra.run.smithi112.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-12T16:20:49.588 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/064 2023-09-12T16:20:49.588 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/064 2023-09-12T16:20:49.588 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:49.595 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:49.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:49.633 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-09-12T16:20:50.083 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:50.096 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:50.097 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:50.099 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:50.099 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:50.624 INFO:teuthology.orchestra.run.smithi112.stdout:generic/065 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T16:20:50.635 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/065 2023-09-12T16:20:50.635 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/065 2023-09-12T16:20:50.636 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:50.640 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:50.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:50.679 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-09-12T16:20:51.130 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:51.142 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:51.144 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:51.146 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:51.661 INFO:teuthology.orchestra.run.smithi112.stdout:generic/066 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T16:20:51.670 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/066 2023-09-12T16:20:51.671 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/066 2023-09-12T16:20:51.671 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:51.677 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:51.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:51.714 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-09-12T16:20:52.164 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:52.177 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:52.178 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:52.180 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:52.181 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:52.746 INFO:teuthology.orchestra.run.smithi112.stdout:generic/067 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T16:20:52.756 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/067 2023-09-12T16:20:52.757 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/067 2023-09-12T16:20:52.757 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:52.763 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:52.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:52.804 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-09-12T16:20:53.254 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:53.267 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:53.268 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:53.271 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:53.271 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:53.787 INFO:teuthology.orchestra.run.smithi112.stdout:generic/068 [not run] ceph does not support freezing 2023-09-12T16:20:53.797 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/068 2023-09-12T16:20:53.798 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/068 2023-09-12T16:20:53.798 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:20:53.804 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:20:53.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:20:53.837 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-09-12T16:20:54.285 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:20:54.298 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:20:54.299 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:20:54.301 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:20:54.302 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:21:09.596 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:21:09.602 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:21:13.814 INFO:teuthology.orchestra.run.smithi112.stdout:generic/069 19s 2023-09-12T16:21:13.859 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/069 2023-09-12T16:21:13.859 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:21:13.871 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:21:13.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:21:13.932 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-09-12T16:21:14.383 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:21:14.395 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:21:14.397 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:21:14.399 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:21:14.399 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:21:38.705 INFO:teuthology.orchestra.run.smithi112.stdout:generic/070 24s 2023-09-12T16:21:38.719 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/070 2023-09-12T16:21:38.719 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:21:38.724 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:21:38.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:21:38.977 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-09-12T16:21:39.834 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:21:39.840 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:21:39.971 INFO:tasks.ceph.mds.a.smithi112.stderr:2023-09-12T16:21:39.969+0000 7fc85dff9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 222215) UID: 0 2023-09-12T16:21:39.971 INFO:tasks.ceph.mds.c.smithi112.stderr:2023-09-12T16:21:39.970+0000 7f35a2bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 222215) UID: 0 2023-09-12T16:21:40.003 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:21:40.030 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:21:40.031 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:21:40.034 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:21:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:21:40.832 INFO:teuthology.orchestra.run.smithi112.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-12T16:21:40.849 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/071 2023-09-12T16:21:40.849 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/071 2023-09-12T16:21:40.850 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:21:40.859 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:21:40.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:21:40.920 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-09-12T16:21:41.684 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:21:41.701 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:21:41.703 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:21:41.706 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:21:41.706 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:21:42.704 INFO:teuthology.orchestra.run.smithi112.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-09-12T16:21:42.721 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/072 2023-09-12T16:21:42.721 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/072 2023-09-12T16:21:42.721 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:21:42.730 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:21:42.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:21:42.802 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-09-12T16:21:43.526 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:21:43.544 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:21:43.546 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:21:43.551 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:21:43.551 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:21:44.382 INFO:teuthology.orchestra.run.smithi112.stdout:generic/073 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T16:21:44.401 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/073 2023-09-12T16:21:44.401 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/073 2023-09-12T16:21:44.401 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:21:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:21:44.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:21:44.471 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-09-12T16:21:45.236 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:21:45.261 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:21:45.266 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:21:45.268 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:21:45.268 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:22:35.096 INFO:teuthology.orchestra.run.smithi112.stdout:generic/074 50s 2023-09-12T16:22:35.148 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/074 2023-09-12T16:22:35.148 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:22:35.157 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:22:35.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:22:35.641 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-09-12T16:22:36.649 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:22:36.670 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:22:36.672 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:22:36.675 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:22:36.675 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:11.803 INFO:teuthology.orchestra.run.smithi112.stdout:generic/075 35s 2023-09-12T16:23:11.838 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/075 2023-09-12T16:23:11.839 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:23:11.850 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:11.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:23:11.988 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-09-12T16:23:12.878 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:23:12.902 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:23:12.905 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:23:12.912 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:23:12.912 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:13.698 INFO:teuthology.orchestra.run.smithi112.stdout:generic/076 [not run] require 172.21.15.112:6789:/scratch to be local device 2023-09-12T16:23:13.716 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/076 2023-09-12T16:23:13.717 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/076 2023-09-12T16:23:13.717 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:23:13.727 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:13.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:23:13.789 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-09-12T16:23:14.828 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:23:14.851 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:23:14.852 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:23:14.859 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:23:14.861 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:19.310 INFO:teuthology.orchestra.run.smithi112.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-12T16:23:19.325 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/077 2023-09-12T16:23:19.325 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/077 2023-09-12T16:23:19.325 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:23:19.335 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:19.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:23:19.527 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-09-12T16:23:20.515 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:23:20.532 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:23:20.533 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:23:20.537 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:23:20.537 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:21.451 INFO:teuthology.orchestra.run.smithi112.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-09-12T16:23:21.466 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/078 2023-09-12T16:23:21.466 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/078 2023-09-12T16:23:21.466 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:23:21.476 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:21.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:23:21.616 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-09-12T16:23:22.518 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:23:22.546 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:23:22.547 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:23:22.552 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:23:22.552 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:23.388 INFO:teuthology.orchestra.run.smithi112.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-09-12T16:23:23.404 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/079 2023-09-12T16:23:23.405 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/079 2023-09-12T16:23:23.405 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:23:23.413 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:23.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:23:23.483 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-09-12T16:23:24.276 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:23:24.297 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:23:24.298 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:23:24.306 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:23:24.307 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:27.275 INFO:teuthology.orchestra.run.smithi112.stdout:generic/080 3s 2023-09-12T16:23:27.315 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/080 2023-09-12T16:23:27.316 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:23:27.326 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:27.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:23:27.380 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-09-12T16:23:28.130 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:23:28.148 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:23:28.151 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:23:28.158 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:23:28.159 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:28.898 INFO:teuthology.orchestra.run.smithi112.stdout:generic/081 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T16:23:28.915 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/081 2023-09-12T16:23:28.916 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/081 2023-09-12T16:23:28.916 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:23:28.928 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:28.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:23:28.978 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-09-12T16:23:29.729 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:23:29.749 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:23:29.753 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:23:29.759 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:23:29.759 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:30.536 INFO:teuthology.orchestra.run.smithi112.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T16:23:30.555 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/082 2023-09-12T16:23:30.555 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/082 2023-09-12T16:23:30.555 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:23:30.565 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:30.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:23:30.621 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-09-12T16:23:31.808 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:23:31.827 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:23:31.828 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:23:31.833 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:23:31.833 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:32.629 INFO:teuthology.orchestra.run.smithi112.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-12T16:23:32.641 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/083 2023-09-12T16:23:32.642 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/083 2023-09-12T16:23:32.642 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:23:32.654 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:32.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:23:32.715 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-09-12T16:23:33.498 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:23:33.519 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:23:33.523 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:23:33.526 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:23:33.526 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:39.899 INFO:teuthology.orchestra.run.smithi112.stdout:generic/084 6s 2023-09-12T16:23:39.945 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/084 2023-09-12T16:23:39.946 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:23:39.965 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:40.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:23:40.033 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-09-12T16:23:40.852 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:23:40.870 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:23:40.871 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:23:40.877 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:23:40.877 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:41.763 INFO:teuthology.orchestra.run.smithi112.stdout:generic/085 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T16:23:41.775 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/085 2023-09-12T16:23:41.776 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/085 2023-09-12T16:23:41.776 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:23:41.784 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:41.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:23:41.846 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-09-12T16:23:42.622 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:23:42.640 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:23:42.641 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:23:42.649 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:23:42.649 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:43.476 INFO:teuthology.orchestra.run.smithi112.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T16:23:43.491 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/086 2023-09-12T16:23:43.491 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/086 2023-09-12T16:23:43.491 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:23:43.499 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:43.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:23:43.564 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-09-12T16:23:44.318 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:23:44.338 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:23:44.340 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:23:44.348 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:23:44.349 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:46.456 INFO:teuthology.orchestra.run.smithi112.stdout:generic/087 2s 2023-09-12T16:23:46.477 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/087 2023-09-12T16:23:46.478 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:23:46.486 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:46.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:23:46.625 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-09-12T16:23:47.641 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:23:47.662 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:23:47.666 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:23:47.669 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:23:47.669 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:48.575 INFO:teuthology.orchestra.run.smithi112.stdout:generic/088 1s 2023-09-12T16:23:48.594 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/088 2023-09-12T16:23:48.594 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:23:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:23:48.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:23:48.747 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-09-12T16:23:49.701 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:23:49.718 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:23:49.720 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:23:49.723 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:23:49.723 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:24:53.001 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:24:53.008 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:25:23.930 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:25:23.938 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:25:54.060 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:25:54.066 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:26:24.345 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:26:24.355 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:26:54.543 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:26:54.548 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:27:24.684 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:27:24.692 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:27:54.807 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:27:54.813 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:27:54.923 INFO:tasks.ceph.mds.a.smithi112.stderr:2023-09-12T16:27:54.923+0000 7fc85dff9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 233421) UID: 0 2023-09-12T16:27:54.923 INFO:tasks.ceph.mds.c.smithi112.stderr:2023-09-12T16:27:54.923+0000 7f35a2bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 233421) UID: 0 2023-09-12T16:31:10.067 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:31:10.072 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:31:47.948 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:31:47.954 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:31:48.122 INFO:tasks.ceph.mds.a.smithi112.stderr:2023-09-12T16:31:48.122+0000 7fc85dff9700 -1 received signal: Hangup from (PID: 235523) UID: 0 2023-09-12T16:31:48.123 INFO:tasks.ceph.mds.c.smithi112.stderr:2023-09-12T16:31:48.122+0000 7f35a2bf9700 -1 received signal: Hangup from (PID: 235523) UID: 0 2023-09-12T16:32:03.786 INFO:teuthology.orchestra.run.smithi112.stdout:generic/089 492s 2023-09-12T16:32:05.421 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/089 2023-09-12T16:32:05.421 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:32:05.428 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:32:05.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:32:05.586 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-09-12T16:32:06.238 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:32:06.250 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:32:06.251 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:32:06.254 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:32:06.254 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:32:06.848 INFO:teuthology.orchestra.run.smithi112.stdout:generic/090 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T16:32:06.858 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/090 2023-09-12T16:32:06.858 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/090 2023-09-12T16:32:06.858 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:32:06.864 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:32:06.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:32:06.910 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-09-12T16:32:07.357 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:32:07.369 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:32:07.370 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:32:07.373 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:32:07.373 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:34:04.280 INFO:teuthology.orchestra.run.smithi112.stdout:generic/091 117s 2023-09-12T16:34:04.294 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/091 2023-09-12T16:34:04.294 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:34:04.301 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:34:04.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:34:04.443 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-09-12T16:34:05.072 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:34:05.085 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:34:05.086 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:34:05.089 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:34:05.089 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:34:05.591 INFO:teuthology.orchestra.run.smithi112.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T16:34:05.601 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/092 2023-09-12T16:34:05.602 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/092 2023-09-12T16:34:05.602 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:34:05.608 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:34:05.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:34:05.645 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-09-12T16:34:06.097 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:34:06.109 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:34:06.110 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:34:06.113 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:34:06.113 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:34:07.082 INFO:teuthology.orchestra.run.smithi112.stdout:generic/093 1s 2023-09-12T16:34:07.095 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/093 2023-09-12T16:34:07.096 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:34:07.101 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:34:07.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:34:07.245 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-09-12T16:34:07.858 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:34:07.870 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:34:07.871 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:34:07.874 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:34:07.874 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:34:08.421 INFO:teuthology.orchestra.run.smithi112.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-12T16:34:08.431 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/094 2023-09-12T16:34:08.432 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/094 2023-09-12T16:34:08.432 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:34:08.437 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:34:08.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:34:08.574 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-09-12T16:34:09.202 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:34:09.215 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:34:09.216 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:34:09.219 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:34:09.219 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:34:25.752 INFO:teuthology.orchestra.run.smithi112.stdout:generic/095 16s 2023-09-12T16:34:27.166 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/095 2023-09-12T16:34:27.166 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:34:27.172 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:34:27.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:34:27.196 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-09-12T16:34:27.643 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:34:27.656 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:34:27.657 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:34:27.659 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:34:27.660 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:34:28.337 INFO:teuthology.orchestra.run.smithi112.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-12T16:34:28.348 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/096 2023-09-12T16:34:28.348 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/096 2023-09-12T16:34:28.348 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:34:28.353 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:34:28.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:34:28.403 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-09-12T16:34:28.859 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:34:28.872 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:34:28.873 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:34:28.875 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:34:28.876 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:34:29.904 INFO:teuthology.orchestra.run.smithi112.stdout:generic/097 0s 2023-09-12T16:34:29.917 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/097 2023-09-12T16:34:29.918 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:34:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:34:29.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:34:29.963 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-09-12T16:34:30.344 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:34:30.348 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:34:30.413 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:34:30.425 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:34:30.426 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:34:30.429 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:34:30.429 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:34:32.054 INFO:teuthology.orchestra.run.smithi112.stdout:generic/098 2s 2023-09-12T16:34:32.066 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/098 2023-09-12T16:34:32.067 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:34:32.072 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:34:32.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:34:32.094 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-09-12T16:34:32.540 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:34:32.553 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:34:32.554 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:34:32.556 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:34:32.557 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:34:33.941 INFO:teuthology.orchestra.run.smithi112.stdout:generic/099 1s 2023-09-12T16:34:33.954 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/099 2023-09-12T16:34:33.955 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:34:33.960 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:34:34.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:34:34.112 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-09-12T16:34:34.727 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:34:34.739 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:34:34.740 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:34:34.743 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:34:34.743 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:34:57.837 INFO:teuthology.orchestra.run.smithi112.stdout:generic/100 23s 2023-09-12T16:34:57.850 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/100 2023-09-12T16:34:57.850 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:34:57.856 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:35:00.490 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:35:00.497 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:35:00.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:35:00.739 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-09-12T16:35:01.245 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:35:01.258 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:35:01.259 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:35:01.262 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:35:01.262 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:35:01.786 INFO:teuthology.orchestra.run.smithi112.stdout:generic/101 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T16:35:01.796 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/101 2023-09-12T16:35:01.796 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/101 2023-09-12T16:35:01.796 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:35:01.802 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:35:01.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:35:01.836 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-09-12T16:35:02.282 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:35:02.295 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:35:02.295 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:35:02.298 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:35:02.298 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:35:02.777 INFO:teuthology.orchestra.run.smithi112.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-12T16:35:02.788 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/102 2023-09-12T16:35:02.788 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/102 2023-09-12T16:35:02.788 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:35:02.795 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:35:02.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:35:02.836 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-09-12T16:35:03.448 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:35:03.461 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:35:03.462 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:35:03.464 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:35:03.464 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:35:03.976 INFO:teuthology.orchestra.run.smithi112.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T16:35:03.985 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/103 2023-09-12T16:35:03.986 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/103 2023-09-12T16:35:03.986 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:35:03.991 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:35:04.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:35:04.132 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-09-12T16:35:04.792 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:35:04.804 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:35:04.805 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:35:04.808 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:35:04.808 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:35:05.343 INFO:teuthology.orchestra.run.smithi112.stdout:generic/104 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T16:35:05.353 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/104 2023-09-12T16:35:05.353 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/104 2023-09-12T16:35:05.353 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:35:05.359 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:35:05.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:35:05.405 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-09-12T16:35:05.882 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:35:05.894 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:35:05.895 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:35:05.898 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:35:05.898 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:35:06.874 INFO:teuthology.orchestra.run.smithi112.stdout:generic/105 0s 2023-09-12T16:35:06.946 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/105 2023-09-12T16:35:06.946 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:35:06.969 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:35:07.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:35:07.029 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-09-12T16:35:07.499 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:35:07.512 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:35:07.513 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:35:07.516 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:35:07.516 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:35:08.055 INFO:teuthology.orchestra.run.smithi112.stdout:generic/106 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T16:35:08.065 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/106 2023-09-12T16:35:08.065 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/106 2023-09-12T16:35:08.066 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:35:08.071 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:35:08.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:35:08.112 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-09-12T16:35:08.561 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:35:08.574 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:35:08.574 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:35:08.577 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:35:08.577 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:35:09.112 INFO:teuthology.orchestra.run.smithi112.stdout:generic/107 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T16:35:09.121 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/107 2023-09-12T16:35:09.122 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/107 2023-09-12T16:35:09.122 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:35:09.128 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:35:09.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:35:09.171 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-09-12T16:35:09.619 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:35:09.631 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:35:09.632 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:35:09.635 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:35:09.635 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:35:10.325 INFO:teuthology.orchestra.run.smithi112.stdout:generic/108 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T16:35:10.335 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/108 2023-09-12T16:35:10.336 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/108 2023-09-12T16:35:10.336 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:35:10.341 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:35:10.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:35:10.379 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-09-12T16:35:10.834 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:35:10.847 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:35:10.848 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:35:10.850 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:35:10.851 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:35:30.681 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:35:30.688 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:35:48.494 INFO:teuthology.orchestra.run.smithi112.stdout:generic/109 37s 2023-09-12T16:35:48.507 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/109 2023-09-12T16:35:48.508 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:35:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:35:48.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:35:48.536 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-09-12T16:35:49.365 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:35:49.377 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:35:49.378 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:35:49.383 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:35:49.383 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:36:00.819 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:36:00.825 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:36:09.033 INFO:teuthology.orchestra.run.smithi112.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T16:36:09.064 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/110 2023-09-12T16:36:09.064 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/110 2023-09-12T16:36:09.064 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:36:09.077 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:36:09.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:36:09.262 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-09-12T16:36:09.937 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:36:09.949 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:36:09.950 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:36:09.953 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:36:09.953 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:36:10.515 INFO:teuthology.orchestra.run.smithi112.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T16:36:10.525 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/111 2023-09-12T16:36:10.525 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/111 2023-09-12T16:36:10.525 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:36:10.531 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:36:10.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:36:10.706 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-09-12T16:36:11.405 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:36:11.416 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:36:11.417 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:36:11.420 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:36:11.420 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:36:29.990 INFO:teuthology.orchestra.run.smithi112.stdout:generic/112 18s 2023-09-12T16:36:30.003 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/112 2023-09-12T16:36:30.003 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:36:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:36:30.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:36:30.137 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-09-12T16:36:30.806 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:36:30.818 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:36:30.819 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:36:30.822 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:36:30.822 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:36:31.073 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:36:31.079 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:36:48.781 INFO:teuthology.orchestra.run.smithi112.stdout:generic/113 17s 2023-09-12T16:36:48.794 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/113 2023-09-12T16:36:48.794 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:36:48.800 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:36:48.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:36:48.913 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-09-12T16:36:49.528 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:36:49.540 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:36:49.541 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:36:49.544 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:36:49.544 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:36:50.165 INFO:teuthology.orchestra.run.smithi112.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-09-12T16:36:50.175 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/114 2023-09-12T16:36:50.176 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/114 2023-09-12T16:36:50.176 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:36:50.182 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:36:50.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:36:50.230 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-09-12T16:36:50.673 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:36:50.686 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:36:50.686 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:36:50.689 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:36:50.689 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:36:51.234 INFO:teuthology.orchestra.run.smithi112.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T16:36:51.244 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/115 2023-09-12T16:36:51.244 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/115 2023-09-12T16:36:51.244 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:36:51.250 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:36:51.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:36:51.397 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-09-12T16:36:52.031 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:36:52.043 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:36:52.044 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:36:52.047 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:36:52.047 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:36:52.589 INFO:teuthology.orchestra.run.smithi112.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T16:36:52.598 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/116 2023-09-12T16:36:52.599 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/116 2023-09-12T16:36:52.599 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:36:52.605 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:36:52.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:36:52.738 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-09-12T16:36:53.404 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:36:53.417 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:36:53.418 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:36:53.421 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:36:53.421 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:37:01.271 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:37:01.277 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:37:10.440 INFO:teuthology.orchestra.run.smithi112.stdout:generic/117 17s 2023-09-12T16:37:10.457 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/117 2023-09-12T16:37:10.457 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:37:10.463 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:37:10.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:37:10.485 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-09-12T16:37:10.943 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:37:10.956 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:37:10.957 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:37:10.959 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:37:10.960 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:37:11.930 INFO:teuthology.orchestra.run.smithi112.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T16:37:11.955 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/118 2023-09-12T16:37:11.955 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/118 2023-09-12T16:37:11.955 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:37:11.967 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:37:12.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:37:12.106 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-09-12T16:37:12.751 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:37:12.764 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:37:12.765 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:37:12.768 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:37:12.768 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:37:13.313 INFO:teuthology.orchestra.run.smithi112.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T16:37:13.324 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/119 2023-09-12T16:37:13.324 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/119 2023-09-12T16:37:13.324 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:37:13.329 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:37:13.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:37:13.482 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-09-12T16:37:14.115 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:37:14.127 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:37:14.128 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:37:14.131 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:37:14.131 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:37:14.623 INFO:teuthology.orchestra.run.smithi112.stdout:generic/120 [not run] atime not maintained by ceph 2023-09-12T16:37:14.633 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/120 2023-09-12T16:37:14.633 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/120 2023-09-12T16:37:14.633 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:37:14.639 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:37:14.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:37:14.676 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-09-12T16:37:15.123 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:37:15.135 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:37:15.136 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:37:15.139 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:37:15.139 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:37:15.682 INFO:teuthology.orchestra.run.smithi112.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-12T16:37:15.692 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/121 2023-09-12T16:37:15.692 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/121 2023-09-12T16:37:15.692 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:37:15.698 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:37:15.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:37:15.812 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-09-12T16:37:16.479 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:37:16.491 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:37:16.492 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:37:16.495 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:37:16.495 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:37:17.053 INFO:teuthology.orchestra.run.smithi112.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-12T16:37:17.063 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/122 2023-09-12T16:37:17.063 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/122 2023-09-12T16:37:17.063 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:37:17.069 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:37:17.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:37:17.228 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-09-12T16:37:17.873 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:37:17.885 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:37:17.886 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:37:17.889 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:37:17.889 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:37:18.800 INFO:teuthology.orchestra.run.smithi112.stdout:generic/123 0s 2023-09-12T16:37:18.813 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/123 2023-09-12T16:37:18.814 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:37:18.819 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:37:18.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:37:18.922 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-09-12T16:37:19.615 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:37:19.628 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:37:19.629 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:37:19.631 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:37:19.632 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:37:23.482 INFO:teuthology.orchestra.run.smithi112.stdout:generic/124 4s 2023-09-12T16:37:23.524 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/124 2023-09-12T16:37:23.525 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:37:23.545 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:37:23.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:37:23.925 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-09-12T16:37:24.680 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:37:24.692 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:37:24.694 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:37:24.696 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:37:24.696 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:37:31.558 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:37:31.563 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:38:01.969 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:38:01.975 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:38:26.453 INFO:teuthology.orchestra.run.smithi112.stdout:generic/125 62s 2023-09-12T16:38:26.467 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/125 2023-09-12T16:38:26.467 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:38:26.473 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:38:26.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:38:26.613 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-09-12T16:38:27.255 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:38:27.268 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:38:27.269 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:38:27.271 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:38:27.272 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:38:28.058 INFO:teuthology.orchestra.run.smithi112.stdout:generic/126 1s 2023-09-12T16:38:28.070 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/126 2023-09-12T16:38:28.071 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:38:28.076 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:38:28.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:38:28.240 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-09-12T16:38:28.871 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:38:28.884 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:38:28.885 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:38:28.887 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:38:28.888 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:38:32.093 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:38:32.099 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:39:02.406 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:39:02.411 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:39:32.578 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:39:32.584 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:40:02.716 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:40:02.721 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:40:32.855 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:40:32.861 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:41:03.026 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:41:03.032 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:41:33.139 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:41:33.144 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:42:03.263 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:42:03.269 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:42:33.377 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:42:33.384 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:43:03.484 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:43:03.490 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:43:33.691 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:43:33.696 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:44:03.865 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:44:03.871 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:44:33.980 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:44:33.986 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:45:05.075 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:45:05.081 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:45:35.188 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:45:35.193 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:46:05.351 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:46:05.356 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:46:35.481 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:46:35.486 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:47:05.588 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:47:05.593 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:47:35.811 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:47:35.815 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:48:05.917 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:48:05.922 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:48:36.034 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:48:36.039 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:48:37.094 INFO:teuthology.orchestra.run.smithi112.stdout:generic/127 608s 2023-09-12T16:48:37.107 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/127 2023-09-12T16:48:37.107 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:48:37.113 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:48:37.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:48:37.248 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-09-12T16:48:37.890 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:48:37.903 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:48:37.904 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:48:37.907 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:48:37.907 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:48:39.305 INFO:teuthology.orchestra.run.smithi112.stdout:generic/128 1s 2023-09-12T16:48:39.318 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/128 2023-09-12T16:48:39.318 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T16:48:39.324 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:48:39.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T16:48:39.345 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-09-12T16:48:39.795 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T16:48:39.808 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T16:48:39.809 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T16:48:39.812 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T16:48:39.812 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T16:49:06.156 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:49:06.163 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:49:36.338 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:49:36.354 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:50:06.553 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:50:06.560 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:50:36.735 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:50:36.742 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:51:06.935 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:51:06.948 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:51:37.148 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:51:37.155 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:51:37.692 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T16:51:37.689+0000 7f49c5bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 275073) UID: 0 2023-09-12T16:51:37.693 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T16:51:37.691+0000 7f195aff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 275073) UID: 0 2023-09-12T16:51:37.837 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T16:51:37.689+0000 7fed0e9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 275073) UID: 0 2023-09-12T16:51:37.837 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T16:51:37.689+0000 7fb9131f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 275073) UID: 0 2023-09-12T16:55:25.141 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:55:25.149 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:55:26.875 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T16:55:26.850+0000 7f05c55f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127315) UID: 0 2023-09-12T16:55:26.878 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T16:55:26.855+0000 7f2623ff9700 -1 received signal: Hangup from (PID: 127315) UID: 0 2023-09-12T16:55:26.880 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T16:55:26.858+0000 7f858dbf9700 -1 received signal: Hangup from (PID: 127315) UID: 0 2023-09-12T16:55:26.885 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T16:55:26.854+0000 7fd0eedf9700 -1 received signal: Hangup from (PID: 127315) UID: 0 2023-09-12T16:59:37.731 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:59:37.738 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T16:59:37.831 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T16:59:37.830+0000 7f49c5bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 275194) UID: 0 2023-09-12T16:59:37.831 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T16:59:37.830+0000 7f195aff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 275194) UID: 0 2023-09-12T16:59:37.832 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T16:59:37.830+0000 7fed0e9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 275194) UID: 0 2023-09-12T16:59:37.832 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T16:59:37.830+0000 7fb9131f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 275194) UID: 0 2023-09-12T16:59:38.508 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T16:59:38.500+0000 7f858dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127377) UID: 0 2023-09-12T16:59:38.518 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T16:59:38.507+0000 7fd0eedf9700 -1 Fail to open '/proc/127377/cmdline' error = (2) No such file or directory 2023-09-12T16:59:38.518 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T16:59:38.507+0000 7fd0eedf9700 -1 received signal: Hangup from (PID: 127377) UID: 0 2023-09-12T16:59:38.518 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T16:59:38.500+0000 7f2623ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127377) UID: 0 2023-09-12T16:59:38.525 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T16:59:38.507+0000 7f05c55f9700 -1 Fail to open '/proc/127377/cmdline' error = (2) No such file or directory 2023-09-12T16:59:38.526 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T16:59:38.507+0000 7f05c55f9700 -1 received signal: Hangup from (PID: 127377) UID: 0 2023-09-12T17:07:26.335 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:07:26.353 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:07:26.706 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T17:07:26.705+0000 7f49c5bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 275304) UID: 0 2023-09-12T17:07:26.707 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T17:07:26.705+0000 7f195aff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 275304) UID: 0 2023-09-12T17:07:26.708 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T17:07:26.706+0000 7fb9131f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 275304) UID: 0 2023-09-12T17:07:26.708 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T17:07:26.706+0000 7fed0e9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 275304) UID: 0 2023-09-12T17:10:01.940 INFO:teuthology.orchestra.run.smithi112.stdout:generic/129 1281s 2023-09-12T17:10:02.015 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/129 2023-09-12T17:10:02.015 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:10:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:10:02.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:10:02.084 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-09-12T17:10:03.539 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:10:03.553 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:10:03.554 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:10:03.556 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:10:03.556 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:10:18.322 INFO:teuthology.orchestra.run.smithi112.stdout:generic/130 15s 2023-09-12T17:10:18.374 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/130 2023-09-12T17:10:18.374 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:10:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:10:18.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:10:18.463 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-09-12T17:10:18.983 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:10:18.996 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:10:18.997 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:10:18.999 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:10:19.000 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:10:21.201 INFO:teuthology.orchestra.run.smithi112.stdout:generic/131 2s 2023-09-12T17:10:21.220 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/131 2023-09-12T17:10:21.220 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:10:21.230 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:10:21.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:10:21.439 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-09-12T17:10:22.373 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:10:22.401 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:10:22.403 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:10:22.408 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:10:22.409 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:10:37.436 INFO:teuthology.orchestra.run.smithi112.stdout:generic/132 15s 2023-09-12T17:10:37.449 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/132 2023-09-12T17:10:37.450 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:10:37.455 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:10:37.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:10:37.477 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-09-12T17:10:37.944 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:10:37.956 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:10:37.958 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:10:37.960 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:10:37.961 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:13:59.469 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:13:59.474 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:13:59.587 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T17:13:59.586+0000 7f05c55f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128003) UID: 0 2023-09-12T17:13:59.588 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T17:13:59.586+0000 7fd0eedf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128003) UID: 0 2023-09-12T17:13:59.588 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T17:13:59.586+0000 7f2623ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128003) UID: 0 2023-09-12T17:13:59.589 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T17:13:59.587+0000 7f858dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128003) UID: 0 2023-09-12T17:15:43.946 INFO:teuthology.orchestra.run.smithi112.stdout:generic/133 305s 2023-09-12T17:15:43.958 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/133 2023-09-12T17:15:43.959 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:15:43.964 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:15:44.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:15:44.112 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-09-12T17:15:44.881 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:15:44.900 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:15:44.902 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:15:44.908 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:15:44.908 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:15:45.501 INFO:teuthology.orchestra.run.smithi112.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:15:45.511 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/134 2023-09-12T17:15:45.511 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/134 2023-09-12T17:15:45.511 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:15:45.517 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:15:45.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:15:45.652 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-09-12T17:15:46.339 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:15:46.351 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:15:46.352 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:15:46.355 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:15:46.355 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:15:47.736 INFO:teuthology.orchestra.run.smithi112.stdout:generic/135 1s 2023-09-12T17:15:47.749 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/135 2023-09-12T17:15:47.749 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:15:47.755 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:15:47.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:15:47.776 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-09-12T17:15:48.232 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:15:48.245 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:15:48.246 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:15:48.249 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:15:48.249 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:15:48.823 INFO:teuthology.orchestra.run.smithi112.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-12T17:15:48.833 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/136 2023-09-12T17:15:48.833 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/136 2023-09-12T17:15:48.833 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:15:48.839 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:15:48.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:15:48.975 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-09-12T17:15:49.646 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:15:49.659 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:15:49.660 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:15:49.662 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:15:49.662 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:15:50.230 INFO:teuthology.orchestra.run.smithi112.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:15:50.240 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/137 2023-09-12T17:15:50.240 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/137 2023-09-12T17:15:50.241 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:15:50.246 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:15:50.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:15:50.400 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-09-12T17:15:51.072 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:15:51.084 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:15:51.086 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:15:51.088 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:15:51.088 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:15:51.657 INFO:teuthology.orchestra.run.smithi112.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:15:51.667 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/138 2023-09-12T17:15:51.668 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/138 2023-09-12T17:15:51.668 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:15:51.673 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:15:51.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:15:51.854 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-09-12T17:15:52.468 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:15:52.481 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:15:52.482 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:15:52.485 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:15:52.485 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:15:53.045 INFO:teuthology.orchestra.run.smithi112.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:15:53.055 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/139 2023-09-12T17:15:53.056 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/139 2023-09-12T17:15:53.056 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:15:53.061 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:15:53.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:15:53.197 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-09-12T17:15:53.875 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:15:53.888 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:15:53.889 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:15:53.892 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:15:53.892 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:15:54.448 INFO:teuthology.orchestra.run.smithi112.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:15:54.458 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/140 2023-09-12T17:15:54.458 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/140 2023-09-12T17:15:54.458 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:15:54.464 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:15:54.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:15:54.600 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-09-12T17:15:55.271 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:15:55.284 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:15:55.285 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:15:55.288 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:15:55.288 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:15:56.078 INFO:teuthology.orchestra.run.smithi112.stdout:generic/141 1s 2023-09-12T17:15:56.090 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/141 2023-09-12T17:15:56.091 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:15:56.096 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:15:56.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:15:56.118 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-09-12T17:15:56.564 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:15:56.577 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:15:56.578 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:15:56.581 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:15:56.581 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:15:57.145 INFO:teuthology.orchestra.run.smithi112.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:15:57.155 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/142 2023-09-12T17:15:57.156 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/142 2023-09-12T17:15:57.156 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:15:57.162 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:15:57.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:15:57.279 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-09-12T17:15:57.960 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:15:57.973 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:15:57.974 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:15:57.977 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:15:57.977 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:15:58.532 INFO:teuthology.orchestra.run.smithi112.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:15:58.542 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/143 2023-09-12T17:15:58.542 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/143 2023-09-12T17:15:58.543 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:15:58.548 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:15:58.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:15:58.667 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-09-12T17:15:59.362 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:15:59.375 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:15:59.376 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:15:59.378 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:15:59.379 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:15:59.956 INFO:teuthology.orchestra.run.smithi112.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:15:59.966 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/144 2023-09-12T17:15:59.966 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/144 2023-09-12T17:15:59.966 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:15:59.972 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:00.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:00.124 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-09-12T17:16:00.781 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:00.794 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:00.795 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:00.797 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:00.798 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:01.364 INFO:teuthology.orchestra.run.smithi112.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:16:01.374 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/145 2023-09-12T17:16:01.375 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/145 2023-09-12T17:16:01.375 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:01.381 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:01.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:01.587 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-09-12T17:16:02.206 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:02.218 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:02.219 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:02.222 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:02.222 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:02.786 INFO:teuthology.orchestra.run.smithi112.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:16:02.797 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/146 2023-09-12T17:16:02.797 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/146 2023-09-12T17:16:02.798 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:02.802 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:03.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:03.015 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-09-12T17:16:03.633 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:03.646 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:03.647 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:03.650 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:03.650 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:04.212 INFO:teuthology.orchestra.run.smithi112.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:16:04.222 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/147 2023-09-12T17:16:04.223 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/147 2023-09-12T17:16:04.223 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:04.228 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:04.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:04.369 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-09-12T17:16:05.043 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:05.058 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:05.058 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:05.059 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:05.059 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:05.618 INFO:teuthology.orchestra.run.smithi112.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:16:05.628 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/148 2023-09-12T17:16:05.628 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/148 2023-09-12T17:16:05.629 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:05.634 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:05.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:05.789 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-09-12T17:16:06.461 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:06.474 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:06.475 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:06.478 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:06.478 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:07.046 INFO:teuthology.orchestra.run.smithi112.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:16:07.056 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/149 2023-09-12T17:16:07.056 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/149 2023-09-12T17:16:07.056 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:07.062 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:07.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:07.239 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-09-12T17:16:07.888 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:07.901 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:07.902 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:07.905 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:07.905 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:08.468 INFO:teuthology.orchestra.run.smithi112.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:16:08.478 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/150 2023-09-12T17:16:08.478 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/150 2023-09-12T17:16:08.479 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:08.485 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:08.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:08.624 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-09-12T17:16:09.303 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:09.315 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:09.316 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:09.319 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:09.319 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:09.891 INFO:teuthology.orchestra.run.smithi112.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:16:09.901 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/151 2023-09-12T17:16:09.901 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/151 2023-09-12T17:16:09.901 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:09.907 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:10.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:10.061 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-09-12T17:16:10.712 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:10.724 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:10.725 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:10.728 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:10.728 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:11.287 INFO:teuthology.orchestra.run.smithi112.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:16:11.297 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/152 2023-09-12T17:16:11.297 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/152 2023-09-12T17:16:11.298 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:11.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:11.490 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-09-12T17:16:12.116 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:12.129 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:12.130 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:12.133 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:12.133 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:12.697 INFO:teuthology.orchestra.run.smithi112.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:16:12.707 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/153 2023-09-12T17:16:12.708 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/153 2023-09-12T17:16:12.708 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:12.713 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:12.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:12.894 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-09-12T17:16:13.510 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:13.523 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:13.524 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:13.526 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:13.527 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:14.099 INFO:teuthology.orchestra.run.smithi112.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:16:14.109 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/154 2023-09-12T17:16:14.109 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/154 2023-09-12T17:16:14.109 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:14.115 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:14.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:14.306 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-09-12T17:16:14.933 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:14.946 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:14.947 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:14.949 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:14.950 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:15.513 INFO:teuthology.orchestra.run.smithi112.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:16:15.524 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/155 2023-09-12T17:16:15.524 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/155 2023-09-12T17:16:15.524 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:15.529 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:15.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:15.672 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-09-12T17:16:16.352 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:16.365 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:16.366 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:16.368 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:16.369 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:16.938 INFO:teuthology.orchestra.run.smithi112.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:16:16.948 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/156 2023-09-12T17:16:16.948 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/156 2023-09-12T17:16:16.948 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:16.954 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:17.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:17.100 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-09-12T17:16:17.780 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:17.792 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:17.793 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:17.796 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:17.796 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:18.358 INFO:teuthology.orchestra.run.smithi112.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:16:18.368 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/157 2023-09-12T17:16:18.368 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/157 2023-09-12T17:16:18.368 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:18.374 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:18.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:18.550 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-09-12T17:16:19.209 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:19.221 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:19.223 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:19.225 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:19.225 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:19.799 INFO:teuthology.orchestra.run.smithi112.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-12T17:16:19.809 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/158 2023-09-12T17:16:19.809 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/158 2023-09-12T17:16:19.809 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:19.815 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:19.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:19.988 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-09-12T17:16:20.638 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:20.650 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:20.652 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:20.654 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:20.654 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:21.214 INFO:teuthology.orchestra.run.smithi112.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-09-12T17:16:21.224 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/159 2023-09-12T17:16:21.225 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/159 2023-09-12T17:16:21.225 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:21.231 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:21.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:21.285 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-09-12T17:16:21.746 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:21.759 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:21.760 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:21.762 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:21.763 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:22.309 INFO:teuthology.orchestra.run.smithi112.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-09-12T17:16:22.319 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/160 2023-09-12T17:16:22.319 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/160 2023-09-12T17:16:22.319 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:22.325 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:22.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:22.379 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-09-12T17:16:22.834 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:22.846 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:22.848 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:22.850 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:22.850 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:23.744 INFO:teuthology.orchestra.run.smithi112.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:16:23.790 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/161 2023-09-12T17:16:23.790 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/161 2023-09-12T17:16:23.791 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:23.794 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:23.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:23.976 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-09-12T17:16:24.439 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:24.451 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:24.453 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:24.455 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:24.455 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:25.189 INFO:teuthology.orchestra.run.smithi112.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-09-12T17:16:25.311 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/162 2023-09-12T17:16:25.311 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/162 2023-09-12T17:16:25.312 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:25.323 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:25.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:25.605 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-09-12T17:16:26.075 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:26.087 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:26.088 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:26.091 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:26.091 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:26.829 INFO:teuthology.orchestra.run.smithi112.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-09-12T17:16:26.977 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/163 2023-09-12T17:16:26.977 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/163 2023-09-12T17:16:26.977 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:26.987 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:27.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:27.279 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-09-12T17:16:27.730 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:27.742 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:27.745 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:27.746 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:27.747 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:28.671 INFO:teuthology.orchestra.run.smithi112.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:16:28.713 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/164 2023-09-12T17:16:28.713 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/164 2023-09-12T17:16:28.714 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:28.722 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:28.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:28.957 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-09-12T17:16:29.408 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:29.420 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:29.421 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:29.424 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:29.424 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:30.401 INFO:teuthology.orchestra.run.smithi112.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:16:30.424 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/165 2023-09-12T17:16:30.424 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/165 2023-09-12T17:16:30.424 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:30.439 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:30.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:30.635 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-09-12T17:16:31.089 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:31.102 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:31.103 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:31.105 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:31.106 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:32.024 INFO:teuthology.orchestra.run.smithi112.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:16:32.080 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/166 2023-09-12T17:16:32.080 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/166 2023-09-12T17:16:32.080 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:32.114 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:32.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:32.348 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-09-12T17:16:32.802 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:32.815 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:32.816 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:32.818 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:32.818 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:33.659 INFO:teuthology.orchestra.run.smithi112.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:16:33.699 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/167 2023-09-12T17:16:33.699 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/167 2023-09-12T17:16:33.699 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:33.707 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:33.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:33.961 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-09-12T17:16:34.408 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:34.420 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:34.421 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:34.424 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:34.424 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:35.328 INFO:teuthology.orchestra.run.smithi112.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:16:35.345 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/168 2023-09-12T17:16:35.349 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/168 2023-09-12T17:16:35.349 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:35.370 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:35.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:35.595 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-09-12T17:16:36.054 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:36.066 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:36.068 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:36.070 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:36.071 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:37.101 INFO:teuthology.orchestra.run.smithi112.stdout:generic/169 1s 2023-09-12T17:16:37.114 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/169 2023-09-12T17:16:37.114 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:37.120 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:37.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:37.141 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-09-12T17:16:37.593 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:37.605 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:37.606 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:37.609 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:37.609 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:38.513 INFO:teuthology.orchestra.run.smithi112.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:16:38.571 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/170 2023-09-12T17:16:38.571 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/170 2023-09-12T17:16:38.571 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:38.579 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:38.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:38.769 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-09-12T17:16:39.226 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:39.239 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:39.240 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:39.242 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:39.243 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:40.176 INFO:teuthology.orchestra.run.smithi112.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:16:40.204 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/171 2023-09-12T17:16:40.204 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/171 2023-09-12T17:16:40.205 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:40.220 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:40.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:40.408 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-09-12T17:16:40.866 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:40.879 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:40.880 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:40.882 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:40.883 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:41.747 INFO:teuthology.orchestra.run.smithi112.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:16:41.796 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/172 2023-09-12T17:16:41.796 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/172 2023-09-12T17:16:41.796 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:41.823 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:42.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:42.041 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-09-12T17:16:42.494 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:42.507 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:42.508 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:42.511 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:42.511 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:43.392 INFO:teuthology.orchestra.run.smithi112.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:16:43.438 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/173 2023-09-12T17:16:43.438 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/173 2023-09-12T17:16:43.439 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:43.447 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:43.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:43.682 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-09-12T17:16:44.135 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:44.148 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:44.149 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:44.152 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:44.152 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:45.032 INFO:teuthology.orchestra.run.smithi112.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:16:45.065 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/174 2023-09-12T17:16:45.065 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/174 2023-09-12T17:16:45.066 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:45.076 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:45.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:45.318 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-09-12T17:16:45.781 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:45.793 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:45.795 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:45.797 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:45.797 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:46.699 INFO:teuthology.orchestra.run.smithi112.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:16:46.730 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/175 2023-09-12T17:16:46.731 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/175 2023-09-12T17:16:46.731 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:46.746 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:46.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:46.938 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-09-12T17:16:47.398 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:47.411 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:47.412 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:47.414 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:47.415 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:48.309 INFO:teuthology.orchestra.run.smithi112.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:16:48.374 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/176 2023-09-12T17:16:48.374 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/176 2023-09-12T17:16:48.374 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:48.375 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:48.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:48.549 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-09-12T17:16:49.000 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:49.013 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:49.013 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:49.016 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:49.016 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:49.793 INFO:teuthology.orchestra.run.smithi112.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-12T17:16:49.803 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/177 2023-09-12T17:16:49.803 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/177 2023-09-12T17:16:49.803 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:49.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:49.939 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-09-12T17:16:50.611 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:50.623 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:50.625 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:50.627 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:50.628 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:51.189 INFO:teuthology.orchestra.run.smithi112.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:16:51.199 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/178 2023-09-12T17:16:51.199 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/178 2023-09-12T17:16:51.199 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:51.205 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:51.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:51.397 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-09-12T17:16:52.027 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:52.040 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:52.041 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:52.044 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:52.044 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:52.614 INFO:teuthology.orchestra.run.smithi112.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:16:52.624 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/179 2023-09-12T17:16:52.624 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/179 2023-09-12T17:16:52.624 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:52.630 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:52.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:52.799 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-09-12T17:16:53.467 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:53.480 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:53.481 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:53.484 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:53.484 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:54.046 INFO:teuthology.orchestra.run.smithi112.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:16:54.057 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/180 2023-09-12T17:16:54.058 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/180 2023-09-12T17:16:54.058 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:54.062 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:54.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:54.246 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-09-12T17:16:54.867 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:54.880 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:54.881 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:54.883 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:54.884 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:55.442 INFO:teuthology.orchestra.run.smithi112.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:16:55.452 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/181 2023-09-12T17:16:55.452 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/181 2023-09-12T17:16:55.453 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:55.458 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:55.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:55.597 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-09-12T17:16:56.267 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:56.280 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:56.281 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:56.283 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:56.283 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:56.854 INFO:teuthology.orchestra.run.smithi112.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-12T17:16:56.864 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/182 2023-09-12T17:16:56.864 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/182 2023-09-12T17:16:56.864 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:57.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:57.072 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-09-12T17:16:57.703 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:57.715 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:57.716 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:57.719 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:57.719 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:58.595 INFO:teuthology.orchestra.run.smithi112.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:16:58.645 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/183 2023-09-12T17:16:58.646 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/183 2023-09-12T17:16:58.646 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:58.664 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:58.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:58.853 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-09-12T17:16:59.308 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:16:59.321 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:16:59.322 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:16:59.325 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:16:59.325 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:59.903 INFO:teuthology.orchestra.run.smithi112.stdout:generic/184 0s 2023-09-12T17:16:59.915 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/184 2023-09-12T17:16:59.916 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:16:59.922 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:16:59.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:16:59.969 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-09-12T17:17:00.423 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:00.435 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:00.436 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:00.439 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:00.439 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:01.354 INFO:teuthology.orchestra.run.smithi112.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:17:01.404 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/185 2023-09-12T17:17:01.404 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/185 2023-09-12T17:17:01.405 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:01.409 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:01.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:01.601 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-09-12T17:17:02.049 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:02.062 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:02.063 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:02.065 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:02.577 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:17:02.583 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:17:02.943 INFO:teuthology.orchestra.run.smithi112.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:17:02.978 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/186 2023-09-12T17:17:02.978 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/186 2023-09-12T17:17:02.978 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:02.991 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:03.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:03.213 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-09-12T17:17:03.666 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:03.679 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:03.680 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:03.683 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:03.683 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:04.565 INFO:teuthology.orchestra.run.smithi112.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:17:04.607 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/187 2023-09-12T17:17:04.607 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/187 2023-09-12T17:17:04.608 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:04.618 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:04.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:04.836 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-09-12T17:17:05.291 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:05.304 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:05.305 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:05.308 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:05.308 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:06.178 INFO:teuthology.orchestra.run.smithi112.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:17:06.225 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/188 2023-09-12T17:17:06.226 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/188 2023-09-12T17:17:06.226 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:06.249 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:06.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:06.451 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-09-12T17:17:06.905 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:06.918 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:06.919 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:06.921 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:06.922 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:07.802 INFO:teuthology.orchestra.run.smithi112.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:17:07.843 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/189 2023-09-12T17:17:07.843 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/189 2023-09-12T17:17:07.843 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:07.867 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:08.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:08.103 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-09-12T17:17:08.557 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:08.570 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:08.571 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:08.574 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:08.574 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:09.454 INFO:teuthology.orchestra.run.smithi112.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:17:09.491 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/190 2023-09-12T17:17:09.491 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/190 2023-09-12T17:17:09.492 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:09.510 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:09.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:09.744 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-09-12T17:17:10.193 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:10.206 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:10.207 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:10.209 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:10.210 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:11.093 INFO:teuthology.orchestra.run.smithi112.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:17:11.141 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/191 2023-09-12T17:17:11.141 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/191 2023-09-12T17:17:11.141 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:11.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:11.335 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-09-12T17:17:11.787 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:11.799 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:11.800 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:11.803 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:11.803 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:12.323 INFO:teuthology.orchestra.run.smithi112.stdout:generic/192 [not run] atime not maintained by ceph 2023-09-12T17:17:12.333 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/192 2023-09-12T17:17:12.333 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/192 2023-09-12T17:17:12.334 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:12.340 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:12.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:12.381 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-09-12T17:17:12.834 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:12.847 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:12.848 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:12.851 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:12.851 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:14.709 INFO:teuthology.orchestra.run.smithi112.stdout:generic/193 1s 2023-09-12T17:17:14.722 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/193 2023-09-12T17:17:14.722 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:14.728 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:14.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:14.904 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-09-12T17:17:15.554 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:15.567 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:15.568 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:15.570 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:16.512 INFO:teuthology.orchestra.run.smithi112.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:17:16.556 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/194 2023-09-12T17:17:16.556 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/194 2023-09-12T17:17:16.556 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:16.574 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:16.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:16.715 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-09-12T17:17:17.175 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:17.188 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:17.189 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:17.192 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:17.192 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:18.103 INFO:teuthology.orchestra.run.smithi112.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:17:18.146 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/195 2023-09-12T17:17:18.147 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/195 2023-09-12T17:17:18.147 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:18.189 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:18.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:18.376 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-09-12T17:17:18.832 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:18.845 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:18.846 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:18.849 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:18.849 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:19.724 INFO:teuthology.orchestra.run.smithi112.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:17:19.789 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/196 2023-09-12T17:17:19.790 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/196 2023-09-12T17:17:19.790 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:19.823 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:20.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:20.003 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-09-12T17:17:20.460 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:20.472 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:20.473 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:20.476 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:20.476 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:21.389 INFO:teuthology.orchestra.run.smithi112.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:17:21.428 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/197 2023-09-12T17:17:21.428 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/197 2023-09-12T17:17:21.428 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:21.437 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:21.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:21.643 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-09-12T17:17:22.095 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:22.107 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:22.108 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:22.111 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:22.111 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:23.362 INFO:teuthology.orchestra.run.smithi112.stdout:generic/198 1s 2023-09-12T17:17:23.374 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/198 2023-09-12T17:17:23.375 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:23.380 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:23.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:23.549 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-09-12T17:17:24.284 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:24.296 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:24.298 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:24.300 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:24.300 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:25.166 INFO:teuthology.orchestra.run.smithi112.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:17:25.207 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/199 2023-09-12T17:17:25.207 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/199 2023-09-12T17:17:25.207 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:25.252 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:25.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:25.454 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-09-12T17:17:25.909 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:25.922 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:25.923 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:25.925 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:25.926 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:26.796 INFO:teuthology.orchestra.run.smithi112.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:17:26.828 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/200 2023-09-12T17:17:26.828 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/200 2023-09-12T17:17:26.828 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:26.847 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:27.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:27.075 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-09-12T17:17:27.532 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:27.544 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:27.545 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:27.548 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:27.548 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:28.418 INFO:teuthology.orchestra.run.smithi112.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:17:28.463 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/201 2023-09-12T17:17:28.463 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/201 2023-09-12T17:17:28.464 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:28.473 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:28.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:28.694 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-09-12T17:17:29.150 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:29.162 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:29.163 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:29.166 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:29.166 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:29.977 INFO:teuthology.orchestra.run.smithi112.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:17:30.026 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/202 2023-09-12T17:17:30.026 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/202 2023-09-12T17:17:30.026 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:30.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:30.297 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-09-12T17:17:30.746 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:30.759 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:30.760 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:30.762 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:30.762 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:31.634 INFO:teuthology.orchestra.run.smithi112.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:17:31.689 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/203 2023-09-12T17:17:31.689 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/203 2023-09-12T17:17:31.690 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:31.727 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:31.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:31.895 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-09-12T17:17:32.344 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:32.357 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:32.358 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:32.360 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:32.361 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:32.748 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:17:32.753 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:17:33.192 INFO:teuthology.orchestra.run.smithi112.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-12T17:17:33.202 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/204 2023-09-12T17:17:33.202 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/204 2023-09-12T17:17:33.203 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:33.208 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:33.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:33.247 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-09-12T17:17:33.694 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:33.707 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:33.708 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:33.710 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:33.711 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:34.536 INFO:teuthology.orchestra.run.smithi112.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:17:34.580 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/205 2023-09-12T17:17:34.580 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/205 2023-09-12T17:17:34.580 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:34.608 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:34.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:34.795 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-09-12T17:17:35.247 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:35.261 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:35.262 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:35.264 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:35.264 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:36.110 INFO:teuthology.orchestra.run.smithi112.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:17:36.140 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/206 2023-09-12T17:17:36.141 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/206 2023-09-12T17:17:36.141 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:36.155 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:36.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:36.368 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-09-12T17:17:36.815 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:36.828 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:36.829 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:36.832 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:36.832 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:46.031 INFO:teuthology.orchestra.run.smithi112.stdout:generic/207 9s 2023-09-12T17:17:46.043 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/207 2023-09-12T17:17:46.044 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:17:46.050 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:17:46.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:17:46.170 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-09-12T17:17:46.852 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:17:46.865 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:17:46.866 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:17:46.868 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:17:46.868 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:18:02.879 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:18:02.889 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:18:33.034 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:18:33.041 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:19:03.332 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:19:03.338 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:19:34.520 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:19:34.526 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:20:05.525 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:20:05.532 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:20:35.670 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:20:35.675 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:21:05.941 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:21:05.946 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:21:07.532 INFO:teuthology.orchestra.run.smithi112.stdout:generic/208 200s 2023-09-12T17:21:07.545 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/208 2023-09-12T17:21:07.545 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:21:07.551 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:07.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:21:07.682 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-09-12T17:21:08.373 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:21:08.385 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:21:08.387 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:21:08.389 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:21:08.389 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:36.114 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:21:36.119 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:21:41.254 INFO:teuthology.orchestra.run.smithi112.stdout:generic/209 33s 2023-09-12T17:21:41.369 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/209 2023-09-12T17:21:41.369 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:21:41.375 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:41.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:21:41.531 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-09-12T17:21:42.196 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:21:42.208 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:21:42.209 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:21:42.212 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:21:42.212 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:42.818 INFO:teuthology.orchestra.run.smithi112.stdout:generic/210 0s 2023-09-12T17:21:42.831 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/210 2023-09-12T17:21:42.832 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:21:42.837 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:42.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:21:42.977 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-09-12T17:21:43.633 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:21:43.645 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:21:43.646 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:21:43.649 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:21:43.649 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:44.891 INFO:teuthology.orchestra.run.smithi112.stdout:generic/211 1s 2023-09-12T17:21:44.904 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/211 2023-09-12T17:21:44.904 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:21:44.910 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:44.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:21:44.954 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-09-12T17:21:45.402 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:21:45.414 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:21:45.415 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:21:45.418 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:21:45.418 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:46.036 INFO:teuthology.orchestra.run.smithi112.stdout:generic/212 1s 2023-09-12T17:21:46.049 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/212 2023-09-12T17:21:46.049 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:21:46.055 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:46.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:21:46.098 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-09-12T17:21:46.549 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:21:46.562 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:21:46.563 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:21:46.566 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:21:46.566 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:47.084 INFO:teuthology.orchestra.run.smithi112.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T17:21:47.093 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/213 2023-09-12T17:21:47.094 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/213 2023-09-12T17:21:47.094 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:21:47.099 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:47.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:21:47.140 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-09-12T17:21:47.603 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:21:47.615 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:21:47.616 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:21:47.618 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:21:47.619 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:48.152 INFO:teuthology.orchestra.run.smithi112.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T17:21:48.162 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/214 2023-09-12T17:21:48.162 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/214 2023-09-12T17:21:48.162 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:21:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:48.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:21:48.208 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-09-12T17:21:48.662 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:21:48.674 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:21:48.675 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:21:48.678 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:21:48.678 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:51.290 INFO:teuthology.orchestra.run.smithi112.stdout:generic/215 3s 2023-09-12T17:21:51.334 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/215 2023-09-12T17:21:51.334 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:21:51.340 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:51.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:21:51.407 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-09-12T17:21:51.856 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:21:51.868 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:21:51.869 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:21:51.872 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:21:51.872 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:52.700 INFO:teuthology.orchestra.run.smithi112.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:21:52.760 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/216 2023-09-12T17:21:52.760 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/216 2023-09-12T17:21:52.760 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:21:52.792 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:52.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:21:52.956 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-09-12T17:21:53.414 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:21:53.427 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:21:53.428 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:21:53.430 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:21:53.430 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:54.311 INFO:teuthology.orchestra.run.smithi112.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:21:54.346 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/217 2023-09-12T17:21:54.347 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/217 2023-09-12T17:21:54.347 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:21:54.359 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:54.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:21:54.536 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-09-12T17:21:54.986 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:21:54.999 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:21:55.000 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:21:55.003 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:21:55.003 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:55.847 INFO:teuthology.orchestra.run.smithi112.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:21:55.873 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/218 2023-09-12T17:21:55.873 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/218 2023-09-12T17:21:55.873 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:21:55.901 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:56.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:21:56.116 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-09-12T17:21:56.571 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:21:56.583 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:21:56.584 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:21:56.587 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:21:56.587 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:57.074 INFO:teuthology.orchestra.run.smithi112.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T17:21:57.085 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/219 2023-09-12T17:21:57.085 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/219 2023-09-12T17:21:57.085 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:21:57.091 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:57.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:21:57.135 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-09-12T17:21:57.584 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:21:57.597 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:21:57.598 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:21:57.601 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:21:57.601 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:58.414 INFO:teuthology.orchestra.run.smithi112.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:21:58.466 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/220 2023-09-12T17:21:58.466 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/220 2023-09-12T17:21:58.467 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:21:58.494 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:21:58.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:21:58.696 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-09-12T17:21:59.151 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:21:59.163 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:21:59.164 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:21:59.166 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:21:59.167 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:00.705 INFO:teuthology.orchestra.run.smithi112.stdout:generic/221 1s 2023-09-12T17:22:00.719 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/221 2023-09-12T17:22:00.719 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:22:00.726 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:00.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:22:00.773 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-09-12T17:22:01.224 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:22:01.236 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:22:01.237 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:22:01.240 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:22:01.240 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:02.036 INFO:teuthology.orchestra.run.smithi112.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:22:02.074 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/222 2023-09-12T17:22:02.074 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/222 2023-09-12T17:22:02.074 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:22:02.089 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:02.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:22:02.323 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-09-12T17:22:02.778 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:22:02.790 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:22:02.792 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:22:02.794 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:22:02.794 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:03.305 INFO:teuthology.orchestra.run.smithi112.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T17:22:03.313 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/223 2023-09-12T17:22:03.314 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/223 2023-09-12T17:22:03.314 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:22:03.319 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:03.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:22:03.361 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-09-12T17:22:03.809 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:22:03.821 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:22:03.822 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:22:03.825 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:22:03.825 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:04.322 INFO:teuthology.orchestra.run.smithi112.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-12T17:22:04.332 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/224 2023-09-12T17:22:04.332 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/224 2023-09-12T17:22:04.332 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:22:04.338 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:04.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:22:04.372 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-09-12T17:22:04.821 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:22:04.833 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:22:04.834 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:22:04.837 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:22:04.837 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:05.402 INFO:teuthology.orchestra.run.smithi112.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-12T17:22:05.412 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/225 2023-09-12T17:22:05.412 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/225 2023-09-12T17:22:05.412 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:22:05.418 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:05.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:22:05.536 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-09-12T17:22:06.211 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:22:06.223 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:22:06.224 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:22:06.226 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:22:06.227 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:22:06.227 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:06.230 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:22:06.768 INFO:teuthology.orchestra.run.smithi112.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-12T17:22:06.778 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/226 2023-09-12T17:22:06.778 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/226 2023-09-12T17:22:06.779 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:22:06.784 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:06.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:22:06.828 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-09-12T17:22:07.273 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:22:07.286 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:22:07.287 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:22:07.290 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:22:07.290 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:08.116 INFO:teuthology.orchestra.run.smithi112.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:22:08.165 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/227 2023-09-12T17:22:08.166 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/227 2023-09-12T17:22:08.166 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:22:08.186 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:08.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:22:08.390 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-09-12T17:22:08.845 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:22:08.856 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:22:08.857 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:22:08.860 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:22:08.860 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:09.407 INFO:teuthology.orchestra.run.smithi112.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T17:22:09.417 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/228 2023-09-12T17:22:09.417 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/228 2023-09-12T17:22:09.417 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:22:09.423 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:09.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:22:09.464 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-09-12T17:22:09.913 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:22:09.925 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:22:09.926 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:22:09.929 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:22:09.929 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:10.782 INFO:teuthology.orchestra.run.smithi112.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:22:10.825 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/229 2023-09-12T17:22:10.825 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/229 2023-09-12T17:22:10.826 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:22:10.833 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:11.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:22:11.006 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-09-12T17:22:11.458 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:22:11.470 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:22:11.471 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:22:11.474 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:22:11.474 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:11.965 INFO:teuthology.orchestra.run.smithi112.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T17:22:11.975 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/230 2023-09-12T17:22:11.975 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/230 2023-09-12T17:22:11.975 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:22:11.982 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:12.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:22:12.021 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-09-12T17:22:12.469 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:22:12.482 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:22:12.483 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:22:12.485 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:22:12.486 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:12.974 INFO:teuthology.orchestra.run.smithi112.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T17:22:12.983 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/231 2023-09-12T17:22:12.983 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/231 2023-09-12T17:22:12.983 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:22:12.989 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:13.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:22:13.031 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-09-12T17:22:13.485 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:22:13.497 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:22:13.499 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:22:13.501 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:22:13.501 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:13.995 INFO:teuthology.orchestra.run.smithi112.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T17:22:14.005 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/232 2023-09-12T17:22:14.006 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/232 2023-09-12T17:22:14.006 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:22:14.011 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:14.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:22:14.054 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-09-12T17:22:14.509 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:22:14.521 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:22:14.522 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:22:14.525 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:22:14.525 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:15.012 INFO:teuthology.orchestra.run.smithi112.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T17:22:15.022 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/233 2023-09-12T17:22:15.022 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/233 2023-09-12T17:22:15.022 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:22:15.028 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:15.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:22:15.063 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-09-12T17:22:15.509 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:22:15.521 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:22:15.522 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:22:15.525 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:22:15.525 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:16.012 INFO:teuthology.orchestra.run.smithi112.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T17:22:16.022 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/234 2023-09-12T17:22:16.022 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/234 2023-09-12T17:22:16.022 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:22:16.028 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:16.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:22:16.069 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-09-12T17:22:16.518 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:22:16.530 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:22:16.531 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:22:16.534 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:22:16.534 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:17.027 INFO:teuthology.orchestra.run.smithi112.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T17:22:17.036 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/235 2023-09-12T17:22:17.037 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/235 2023-09-12T17:22:17.037 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:22:17.042 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:17.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:22:17.085 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-09-12T17:22:17.528 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:22:17.541 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:22:17.542 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:22:17.544 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:22:17.545 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:19.126 INFO:teuthology.orchestra.run.smithi112.stdout:generic/236 2s 2023-09-12T17:22:19.140 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/236 2023-09-12T17:22:19.140 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:22:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:19.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:22:19.271 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-09-12T17:22:19.947 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:22:19.959 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:22:19.961 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:22:19.963 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:22:19.963 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:20.588 INFO:teuthology.orchestra.run.smithi112.stdout:generic/237 0s 2023-09-12T17:22:20.601 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/237 2023-09-12T17:22:20.601 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:22:20.606 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:20.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:22:20.751 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-09-12T17:22:21.399 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:22:21.412 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:22:21.413 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:22:21.415 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:22:21.416 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:22.270 INFO:teuthology.orchestra.run.smithi112.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:22:22.329 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/238 2023-09-12T17:22:22.329 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/238 2023-09-12T17:22:22.329 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:22:22.337 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:22.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:22:22.501 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-09-12T17:22:22.966 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:22:22.978 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:22:22.979 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:22:22.982 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:22:22.983 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:22:36.606 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:22:36.619 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:23:06.870 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:23:06.884 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:23:37.107 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:23:37.127 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:24:07.408 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:24:07.414 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:24:19.472 INFO:teuthology.orchestra.run.smithi112.stdout:generic/239 116s 2023-09-12T17:24:19.485 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/239 2023-09-12T17:24:19.485 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:24:19.491 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:24:19.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:24:19.643 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-09-12T17:24:20.276 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:24:20.289 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:24:20.290 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:24:20.292 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:24:20.292 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:24:21.310 INFO:teuthology.orchestra.run.smithi112.stdout:generic/240 1s 2023-09-12T17:24:21.322 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/240 2023-09-12T17:24:21.322 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:24:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:24:21.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:24:21.509 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-09-12T17:24:22.148 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:24:22.160 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:24:22.161 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:24:22.164 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:24:22.164 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:24:37.692 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:24:37.698 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:24:37.792 INFO:tasks.ceph.mds.c.smithi112.stderr:2023-09-12T17:24:37.791+0000 7f35a2bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 333087) UID: 0 2023-09-12T17:24:37.793 INFO:tasks.ceph.mds.a.smithi112.stderr:2023-09-12T17:24:37.791+0000 7fc85dff9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 333087) UID: 0 2023-09-12T17:25:36.037 INFO:teuthology.orchestra.run.smithi112.stdout:generic/241 74s 2023-09-12T17:25:36.050 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/241 2023-09-12T17:25:36.051 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:25:36.057 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:25:36.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:25:36.839 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-09-12T17:25:38.021 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:25:38.034 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:25:38.035 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:25:38.038 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:25:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:25:38.952 INFO:teuthology.orchestra.run.smithi112.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:25:39.007 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/242 2023-09-12T17:25:39.007 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/242 2023-09-12T17:25:39.007 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:25:39.011 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:25:39.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:25:39.245 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-09-12T17:25:39.715 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:25:39.727 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:25:39.729 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:25:39.731 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:25:39.731 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:25:40.978 INFO:teuthology.orchestra.run.smithi112.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:25:41.005 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/243 2023-09-12T17:25:41.006 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/243 2023-09-12T17:25:41.006 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:25:41.024 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:25:41.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:25:41.230 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-09-12T17:25:41.700 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:25:41.712 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:25:41.713 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:25:41.715 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:25:41.716 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:25:42.258 INFO:teuthology.orchestra.run.smithi112.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T17:25:42.268 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/244 2023-09-12T17:25:42.268 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/244 2023-09-12T17:25:42.268 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:25:42.274 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:25:42.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:25:42.312 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-09-12T17:25:42.765 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:25:42.777 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:25:42.778 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:25:42.781 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:25:42.781 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:25:43.403 INFO:teuthology.orchestra.run.smithi112.stdout:generic/245 1s 2023-09-12T17:25:45.586 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/245 2023-09-12T17:25:45.587 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:25:45.593 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:25:45.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:25:45.752 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-09-12T17:25:46.445 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:25:46.458 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:25:46.459 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:25:46.461 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:25:46.462 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:25:47.038 INFO:teuthology.orchestra.run.smithi112.stdout:generic/246 1s 2023-09-12T17:25:47.051 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/246 2023-09-12T17:25:47.051 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:25:47.057 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:25:47.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:25:47.193 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-09-12T17:25:47.919 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:25:47.932 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:25:47.933 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:25:47.936 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:25:47.936 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:25:57.150 INFO:teuthology.orchestra.run.smithi112.stdout:generic/247 9s 2023-09-12T17:25:57.168 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/247 2023-09-12T17:25:57.168 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:25:57.175 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:25:57.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:25:57.199 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-09-12T17:25:57.695 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:25:57.710 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:25:57.711 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:25:57.712 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:25:57.712 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:25:58.292 INFO:teuthology.orchestra.run.smithi112.stdout:generic/248 1s 2023-09-12T17:25:58.305 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/248 2023-09-12T17:25:58.306 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:25:58.311 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:25:58.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:25:58.373 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-09-12T17:25:58.843 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:25:58.856 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:25:58.857 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:25:58.859 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:25:58.860 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:25:59.772 INFO:teuthology.orchestra.run.smithi112.stdout:generic/249 0s 2023-09-12T17:25:59.785 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/249 2023-09-12T17:25:59.785 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:25:59.791 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:25:59.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:25:59.927 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-09-12T17:26:00.675 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:26:00.688 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:26:00.689 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:26:00.692 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:26:00.692 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:01.333 INFO:teuthology.orchestra.run.smithi112.stdout:generic/250 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T17:26:01.343 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/250 2023-09-12T17:26:01.344 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/250 2023-09-12T17:26:01.344 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:26:01.350 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:01.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:26:01.393 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-09-12T17:26:01.857 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:26:01.869 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:26:01.871 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:26:01.873 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:26:01.873 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:02.641 INFO:teuthology.orchestra.run.smithi112.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:26:02.676 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/251 2023-09-12T17:26:02.676 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/251 2023-09-12T17:26:02.676 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:26:02.682 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:02.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:26:02.723 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-09-12T17:26:03.188 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:26:03.202 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:26:03.203 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:26:03.205 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:26:03.205 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:03.790 INFO:teuthology.orchestra.run.smithi112.stdout:generic/252 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T17:26:03.800 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/252 2023-09-12T17:26:03.801 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/252 2023-09-12T17:26:03.801 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:26:03.807 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:03.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:26:03.849 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-09-12T17:26:04.306 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:26:04.318 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:26:04.319 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:26:04.322 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:26:04.322 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:05.194 INFO:teuthology.orchestra.run.smithi112.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:26:05.223 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/253 2023-09-12T17:26:05.223 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/253 2023-09-12T17:26:05.224 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:26:05.232 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:05.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:26:05.531 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-09-12T17:26:05.997 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:26:06.011 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:26:06.012 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:26:06.015 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:26:06.015 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:06.933 INFO:teuthology.orchestra.run.smithi112.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:26:06.959 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/254 2023-09-12T17:26:06.959 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/254 2023-09-12T17:26:06.959 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:26:06.975 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:07.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:26:07.240 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-09-12T17:26:07.704 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:26:07.717 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:26:07.718 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:26:07.720 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:26:07.721 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:08.560 INFO:teuthology.orchestra.run.smithi112.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T17:26:08.570 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/255 2023-09-12T17:26:08.570 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/255 2023-09-12T17:26:08.571 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:26:08.576 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:08.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:26:08.702 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-09-12T17:26:09.430 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:26:09.443 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:26:09.444 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:26:09.446 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:26:09.447 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:10.979 INFO:teuthology.orchestra.run.smithi112.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-12T17:26:10.990 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/256 2023-09-12T17:26:10.990 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/256 2023-09-12T17:26:10.990 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:26:10.996 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:11.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:26:11.052 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-09-12T17:26:11.511 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:26:11.523 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:26:11.524 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:26:11.527 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:26:11.527 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:12.768 INFO:teuthology.orchestra.run.smithi112.stdout:generic/257 1s 2023-09-12T17:26:12.780 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/257 2023-09-12T17:26:12.781 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:26:12.786 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:13.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:26:13.018 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-09-12T17:26:13.633 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:26:13.646 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:26:13.647 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:26:13.650 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:26:13.650 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:14.276 INFO:teuthology.orchestra.run.smithi112.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-09-12T17:26:14.286 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/258 2023-09-12T17:26:14.287 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/258 2023-09-12T17:26:14.287 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:26:14.292 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:14.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:26:14.364 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-09-12T17:26:14.827 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:26:14.839 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:26:14.840 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:26:14.843 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:26:14.843 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:15.849 INFO:teuthology.orchestra.run.smithi112.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:26:15.899 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/259 2023-09-12T17:26:15.899 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/259 2023-09-12T17:26:15.899 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:26:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:16.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:26:16.130 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-09-12T17:26:16.589 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:26:16.602 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:26:16.603 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:26:16.605 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:26:16.606 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:17.319 INFO:teuthology.orchestra.run.smithi112.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:26:17.353 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/260 2023-09-12T17:26:17.353 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/260 2023-09-12T17:26:17.353 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:26:17.359 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:17.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:26:17.400 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-09-12T17:26:17.856 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:26:17.868 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:26:17.869 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:26:17.872 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:26:17.872 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:18.784 INFO:teuthology.orchestra.run.smithi112.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:26:18.829 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/261 2023-09-12T17:26:18.830 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/261 2023-09-12T17:26:18.830 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:26:18.903 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:19.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:26:19.055 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-09-12T17:26:19.523 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:26:19.536 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:26:19.537 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:26:19.539 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:26:19.540 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:20.439 INFO:teuthology.orchestra.run.smithi112.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:26:20.474 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/262 2023-09-12T17:26:20.474 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/262 2023-09-12T17:26:20.474 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:26:20.487 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:26:20.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:26:20.745 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-09-12T17:26:21.219 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:26:21.231 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:26:21.233 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:26:21.235 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:26:21.236 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:04.018 INFO:teuthology.orchestra.run.smithi112.stdout:generic/263 42s 2023-09-12T17:27:04.068 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/263 2023-09-12T17:27:04.068 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:04.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:04.212 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-09-12T17:27:05.231 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:05.244 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:05.245 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:05.247 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:05.247 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:06.194 INFO:teuthology.orchestra.run.smithi112.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:06.241 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/264 2023-09-12T17:27:06.241 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/264 2023-09-12T17:27:06.242 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:06.267 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:06.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:06.436 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-09-12T17:27:06.907 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:06.919 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:06.920 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:06.923 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:06.923 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:08.181 INFO:teuthology.orchestra.run.smithi112.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:08.202 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/265 2023-09-12T17:27:08.203 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/265 2023-09-12T17:27:08.203 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:08.211 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:08.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:08.353 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-09-12T17:27:08.998 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:09.010 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:09.011 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:09.014 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:09.014 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:11.604 INFO:teuthology.orchestra.run.smithi112.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:11.614 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/266 2023-09-12T17:27:11.615 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/266 2023-09-12T17:27:11.615 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:11.621 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:11.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:11.664 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-09-12T17:27:12.111 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:12.123 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:12.124 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:12.127 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:12.127 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:13.230 INFO:teuthology.orchestra.run.smithi112.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:13.251 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/267 2023-09-12T17:27:13.252 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/267 2023-09-12T17:27:13.252 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:13.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:13.339 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-09-12T17:27:13.806 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:13.819 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:13.820 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:13.823 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:13.823 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:14.790 INFO:teuthology.orchestra.run.smithi112.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:14.825 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/268 2023-09-12T17:27:14.826 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/268 2023-09-12T17:27:14.826 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:14.837 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:14.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:14.968 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-09-12T17:27:15.440 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:15.453 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:15.454 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:15.456 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:15.456 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:15.963 INFO:teuthology.orchestra.run.smithi112.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-12T17:27:15.974 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/269 2023-09-12T17:27:15.974 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/269 2023-09-12T17:27:15.974 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:15.980 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:16.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:16.025 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-09-12T17:27:16.487 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:16.499 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:16.501 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:16.503 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:16.504 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:16.996 INFO:teuthology.orchestra.run.smithi112.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T17:27:17.006 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/270 2023-09-12T17:27:17.007 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/270 2023-09-12T17:27:17.007 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:17.012 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:17.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:17.051 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-09-12T17:27:17.504 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:17.517 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:17.518 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:17.520 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:17.521 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:18.541 INFO:teuthology.orchestra.run.smithi112.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:18.560 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/271 2023-09-12T17:27:18.560 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/271 2023-09-12T17:27:18.560 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:18.575 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:18.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:18.676 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-09-12T17:27:19.142 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:19.155 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:19.156 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:19.158 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:19.159 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:20.125 INFO:teuthology.orchestra.run.smithi112.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:20.141 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/272 2023-09-12T17:27:20.146 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/272 2023-09-12T17:27:20.146 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:20.156 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:20.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:20.295 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-09-12T17:27:20.755 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:20.768 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:20.769 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:20.772 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:20.772 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:21.281 INFO:teuthology.orchestra.run.smithi112.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-12T17:27:21.291 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/273 2023-09-12T17:27:21.291 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/273 2023-09-12T17:27:21.292 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:21.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:21.343 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-09-12T17:27:21.795 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:21.808 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:21.809 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:21.812 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:21.812 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:22.326 INFO:teuthology.orchestra.run.smithi112.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-12T17:27:22.336 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/274 2023-09-12T17:27:22.336 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/274 2023-09-12T17:27:22.337 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:22.342 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:22.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:22.387 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-09-12T17:27:22.843 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:22.856 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:22.857 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:22.859 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:22.860 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:23.390 INFO:teuthology.orchestra.run.smithi112.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-12T17:27:23.400 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/275 2023-09-12T17:27:23.400 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/275 2023-09-12T17:27:23.401 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:23.406 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:23.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:23.450 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-09-12T17:27:23.901 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:23.914 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:23.915 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:23.917 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:23.918 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:24.931 INFO:teuthology.orchestra.run.smithi112.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:24.965 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/276 2023-09-12T17:27:24.965 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/276 2023-09-12T17:27:24.965 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:24.977 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:25.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:25.081 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-09-12T17:27:25.537 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:25.550 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:25.551 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:25.553 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:25.554 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:26.110 INFO:teuthology.orchestra.run.smithi112.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-09-12T17:27:26.120 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/277 2023-09-12T17:27:26.121 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/277 2023-09-12T17:27:26.121 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:26.127 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:26.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:26.182 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-09-12T17:27:26.644 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:26.657 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:26.658 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:26.660 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:26.661 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:27.681 INFO:teuthology.orchestra.run.smithi112.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:27.727 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/278 2023-09-12T17:27:27.727 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/278 2023-09-12T17:27:27.727 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:27.748 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:27.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:27.841 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-09-12T17:27:28.442 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:28.454 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:28.456 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:28.458 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:28.458 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:29.445 INFO:teuthology.orchestra.run.smithi112.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:29.500 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/279 2023-09-12T17:27:29.501 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/279 2023-09-12T17:27:29.501 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:29.512 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:29.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:29.596 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-09-12T17:27:30.108 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:30.121 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:30.122 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:30.125 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:30.125 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:30.686 INFO:teuthology.orchestra.run.smithi112.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T17:27:30.697 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/280 2023-09-12T17:27:30.697 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/280 2023-09-12T17:27:30.697 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:30.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:30.751 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-09-12T17:27:31.274 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:31.287 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:31.288 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:31.290 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:32.202 INFO:teuthology.orchestra.run.smithi112.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:32.237 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/281 2023-09-12T17:27:32.237 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/281 2023-09-12T17:27:32.237 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:32.245 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:32.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:32.461 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-09-12T17:27:32.924 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:32.936 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:32.938 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:32.940 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:32.940 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:33.877 INFO:teuthology.orchestra.run.smithi112.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:33.914 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/282 2023-09-12T17:27:33.914 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/282 2023-09-12T17:27:33.914 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:33.925 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:34.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:34.038 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-09-12T17:27:34.503 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:34.516 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:34.517 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:34.520 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:34.520 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:35.458 INFO:teuthology.orchestra.run.smithi112.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:35.481 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/283 2023-09-12T17:27:35.481 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/283 2023-09-12T17:27:35.481 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:35.500 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:35.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:35.618 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-09-12T17:27:36.069 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:36.081 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:36.082 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:36.085 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:36.085 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:36.979 INFO:teuthology.orchestra.run.smithi112.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:37.012 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/284 2023-09-12T17:27:37.013 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/284 2023-09-12T17:27:37.013 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:37.018 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:37.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:37.200 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-09-12T17:27:37.656 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:37.668 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:37.669 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:37.672 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:37.672 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:39.601 INFO:teuthology.orchestra.run.smithi112.stdout:generic/285 2s 2023-09-12T17:27:39.614 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/285 2023-09-12T17:27:39.614 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:39.620 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:40.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:40.154 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-09-12T17:27:40.804 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:40.817 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:40.819 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:40.821 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:40.821 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:41.504 INFO:teuthology.orchestra.run.smithi112.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T17:27:41.518 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/286 2023-09-12T17:27:41.518 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/286 2023-09-12T17:27:41.518 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:41.527 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:41.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:41.585 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-09-12T17:27:42.233 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:42.250 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:42.252 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:42.256 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:42.256 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:43.381 INFO:teuthology.orchestra.run.smithi112.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:43.399 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/287 2023-09-12T17:27:43.407 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/287 2023-09-12T17:27:43.407 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:43.419 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:43.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:43.626 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-09-12T17:27:44.276 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:44.294 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:44.295 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:44.299 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:44.299 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:45.230 INFO:teuthology.orchestra.run.smithi112.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:45.270 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/288 2023-09-12T17:27:45.271 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/288 2023-09-12T17:27:45.271 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:45.283 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:45.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:45.333 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-09-12T17:27:45.912 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:45.925 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:45.926 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:45.929 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:45.929 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:46.800 INFO:teuthology.orchestra.run.smithi112.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:46.822 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/289 2023-09-12T17:27:46.822 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/289 2023-09-12T17:27:46.822 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:46.839 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:47.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:47.010 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-09-12T17:27:47.478 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:47.490 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:47.491 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:47.494 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:47.494 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:48.363 INFO:teuthology.orchestra.run.smithi112.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:48.406 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/290 2023-09-12T17:27:48.406 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/290 2023-09-12T17:27:48.406 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:48.417 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:48.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:48.544 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-09-12T17:27:49.014 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:49.026 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:49.027 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:49.030 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:49.030 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:49.888 INFO:teuthology.orchestra.run.smithi112.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:49.936 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/291 2023-09-12T17:27:49.936 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/291 2023-09-12T17:27:49.937 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:49.945 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:50.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:50.103 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-09-12T17:27:50.577 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:50.589 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:50.591 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:50.593 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:50.593 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:51.450 INFO:teuthology.orchestra.run.smithi112.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:51.476 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/292 2023-09-12T17:27:51.479 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/292 2023-09-12T17:27:51.479 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:51.498 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:51.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:51.673 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-09-12T17:27:52.133 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:52.146 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:52.147 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:52.149 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:52.150 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:53.019 INFO:teuthology.orchestra.run.smithi112.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:53.064 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/293 2023-09-12T17:27:53.065 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/293 2023-09-12T17:27:53.065 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:53.073 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:53.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:53.241 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-09-12T17:27:53.704 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:53.717 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:53.718 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:53.720 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:53.721 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:54.798 INFO:teuthology.orchestra.run.smithi112.stdout:generic/294 1s 2023-09-12T17:27:54.837 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/294 2023-09-12T17:27:54.837 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:54.849 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:54.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:54.895 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-09-12T17:27:55.378 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:55.390 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:55.391 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:55.394 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:55.394 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:56.294 INFO:teuthology.orchestra.run.smithi112.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:56.315 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/295 2023-09-12T17:27:56.316 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/295 2023-09-12T17:27:56.316 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:56.334 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:56.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:56.480 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-09-12T17:27:56.947 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:56.959 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:56.961 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:56.963 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:56.963 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:57.804 INFO:teuthology.orchestra.run.smithi112.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:57.843 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/296 2023-09-12T17:27:57.843 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/296 2023-09-12T17:27:57.843 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:57.853 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:58.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:58.055 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-09-12T17:27:58.516 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:27:58.529 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:27:58.530 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:27:58.533 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:27:58.533 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:59.456 INFO:teuthology.orchestra.run.smithi112.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:27:59.495 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/297 2023-09-12T17:27:59.495 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/297 2023-09-12T17:27:59.496 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:27:59.502 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:27:59.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:27:59.618 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-09-12T17:28:00.075 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:28:00.087 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:28:00.088 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:28:00.091 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:28:00.092 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:01.009 INFO:teuthology.orchestra.run.smithi112.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:28:01.046 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/298 2023-09-12T17:28:01.046 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/298 2023-09-12T17:28:01.046 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:28:01.054 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:01.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:28:01.209 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-09-12T17:28:01.668 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:28:01.681 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:28:01.682 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:28:01.685 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:28:01.685 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:02.100 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:28:02.106 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:28:02.277 INFO:teuthology.orchestra.run.smithi112.stdout:generic/299 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T17:28:02.287 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/299 2023-09-12T17:28:02.287 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/299 2023-09-12T17:28:02.287 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:28:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:02.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:28:02.343 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-09-12T17:28:02.792 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:28:02.804 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:28:02.805 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:28:02.808 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:28:02.808 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:03.389 INFO:teuthology.orchestra.run.smithi112.stdout:generic/300 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T17:28:03.399 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/300 2023-09-12T17:28:03.399 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/300 2023-09-12T17:28:03.400 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:28:03.405 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:03.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:28:03.451 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-09-12T17:28:03.906 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:28:03.919 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:28:03.920 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:28:03.922 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:28:03.923 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:04.795 INFO:teuthology.orchestra.run.smithi112.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:28:04.848 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/301 2023-09-12T17:28:04.848 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/301 2023-09-12T17:28:04.848 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:28:04.872 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:05.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:28:05.026 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-09-12T17:28:05.482 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:28:05.494 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:28:05.496 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:28:05.498 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:28:05.498 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:06.395 INFO:teuthology.orchestra.run.smithi112.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:28:06.454 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/302 2023-09-12T17:28:06.455 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/302 2023-09-12T17:28:06.455 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:28:06.477 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:06.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:28:06.635 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-09-12T17:28:07.086 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:28:07.099 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:28:07.100 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:28:07.103 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:28:07.103 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:07.677 INFO:teuthology.orchestra.run.smithi112.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:28:07.687 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/303 2023-09-12T17:28:07.687 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/303 2023-09-12T17:28:07.688 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:28:07.694 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:07.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:28:07.862 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-09-12T17:28:08.480 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:28:08.493 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:28:08.494 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:28:08.497 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:28:08.497 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:09.066 INFO:teuthology.orchestra.run.smithi112.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-12T17:28:09.076 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/304 2023-09-12T17:28:09.076 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/304 2023-09-12T17:28:09.076 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:28:09.082 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:09.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:28:09.209 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-09-12T17:28:09.845 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:28:09.858 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:28:09.859 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:28:09.862 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:28:09.862 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:10.740 INFO:teuthology.orchestra.run.smithi112.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:28:10.769 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/305 2023-09-12T17:28:10.769 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/305 2023-09-12T17:28:10.770 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:28:10.779 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:10.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:28:10.946 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-09-12T17:28:11.410 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:28:11.422 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:28:11.423 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:28:11.426 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:28:11.426 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:12.518 INFO:teuthology.orchestra.run.smithi112.stdout:generic/306 1s 2023-09-12T17:28:12.555 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/306 2023-09-12T17:28:12.555 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:28:12.574 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:12.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:28:12.870 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-09-12T17:28:13.497 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:28:13.510 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:28:13.511 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:28:13.514 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:28:13.514 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:15.543 INFO:teuthology.orchestra.run.smithi112.stdout:generic/307 2s 2023-09-12T17:28:15.556 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/307 2023-09-12T17:28:15.556 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:28:15.562 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:15.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:28:15.584 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-09-12T17:28:16.035 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:28:16.048 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:28:16.049 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:28:16.052 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:28:16.053 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:16.617 INFO:teuthology.orchestra.run.smithi112.stdout:generic/308 0s 2023-09-12T17:28:16.629 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/308 2023-09-12T17:28:16.630 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:28:16.635 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:16.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:28:16.678 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-09-12T17:28:17.131 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:28:17.144 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:28:17.145 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:28:17.147 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:28:17.148 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:18.747 INFO:teuthology.orchestra.run.smithi112.stdout:generic/309 1s 2023-09-12T17:28:18.761 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/309 2023-09-12T17:28:18.761 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:28:18.767 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:18.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:28:18.924 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-09-12T17:28:19.533 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:28:19.545 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:28:19.547 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:28:19.549 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:28:19.549 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:28:32.214 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:28:32.219 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:29:02.319 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:29:02.325 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:29:32.441 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:29:32.447 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:29:37.278 INFO:teuthology.orchestra.run.smithi112.stdout:generic/310 78s 2023-09-12T17:29:37.320 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/310 2023-09-12T17:29:37.320 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:29:37.337 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:37.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:29:37.677 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-09-12T17:29:38.264 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:29:38.277 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:29:38.278 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:29:38.281 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:29:38.281 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:38.842 INFO:teuthology.orchestra.run.smithi112.stdout:generic/311 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T17:29:38.852 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/311 2023-09-12T17:29:38.853 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/311 2023-09-12T17:29:38.853 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:29:38.858 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:38.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:29:38.909 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-09-12T17:29:39.365 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:29:39.378 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:29:39.379 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:29:39.382 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:29:39.382 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:39.890 INFO:teuthology.orchestra.run.smithi112.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T17:29:39.900 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/312 2023-09-12T17:29:39.901 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/312 2023-09-12T17:29:39.901 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:29:39.907 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:39.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:29:39.954 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-09-12T17:29:40.408 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:29:40.421 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:29:40.422 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:29:40.425 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:29:40.425 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:45.002 INFO:teuthology.orchestra.run.smithi112.stdout:generic/313 4s 2023-09-12T17:29:45.016 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/313 2023-09-12T17:29:45.016 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:29:45.023 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:45.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:29:45.080 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-09-12T17:29:45.541 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:29:45.553 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:29:45.555 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:29:45.557 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:29:45.557 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:46.513 INFO:teuthology.orchestra.run.smithi112.stdout:generic/314 1s 2023-09-12T17:29:46.526 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/314 2023-09-12T17:29:46.527 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:29:46.532 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:46.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:29:46.579 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-09-12T17:29:47.037 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:29:47.049 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:29:47.051 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:29:47.053 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:29:47.053 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:47.584 INFO:teuthology.orchestra.run.smithi112.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-12T17:29:47.594 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/315 2023-09-12T17:29:47.595 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/315 2023-09-12T17:29:47.595 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:29:47.600 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:47.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:29:47.651 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-09-12T17:29:48.105 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:29:48.117 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:29:48.118 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:29:48.121 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:29:48.121 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:48.841 INFO:teuthology.orchestra.run.smithi112.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-12T17:29:48.851 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/316 2023-09-12T17:29:48.852 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/316 2023-09-12T17:29:48.852 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:29:48.858 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:49.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:29:49.035 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-09-12T17:29:49.669 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:29:49.683 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:29:49.684 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:29:49.686 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:29:49.686 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:54.300 INFO:teuthology.orchestra.run.smithi112.stdout:generic/317 5s 2023-09-12T17:29:54.313 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/317 2023-09-12T17:29:54.313 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:29:54.319 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:54.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:29:54.340 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-09-12T17:29:54.801 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:29:54.814 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:29:54.815 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:29:54.818 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:29:54.818 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:55.969 INFO:teuthology.orchestra.run.smithi112.stdout:generic/318 0s 2023-09-12T17:29:55.982 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/318 2023-09-12T17:29:55.982 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:29:55.988 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:56.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:29:56.009 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-09-12T17:29:56.458 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:29:56.470 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:29:56.471 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:29:56.474 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:29:56.474 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:57.310 INFO:teuthology.orchestra.run.smithi112.stdout:generic/319 1s 2023-09-12T17:29:57.323 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/319 2023-09-12T17:29:57.323 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:29:57.328 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:57.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:29:57.350 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-09-12T17:29:57.805 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:29:57.818 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:29:57.819 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:29:57.821 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:29:57.822 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:58.337 INFO:teuthology.orchestra.run.smithi112.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-12T17:29:58.347 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/320 2023-09-12T17:29:58.347 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/320 2023-09-12T17:29:58.347 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:29:58.353 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:58.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:29:58.401 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-09-12T17:29:58.860 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:29:58.873 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:29:58.874 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:29:58.877 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:29:58.877 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:59.405 INFO:teuthology.orchestra.run.smithi112.stdout:generic/321 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T17:29:59.415 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/321 2023-09-12T17:29:59.415 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/321 2023-09-12T17:29:59.415 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:29:59.421 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:29:59.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:29:59.458 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-09-12T17:29:59.916 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:29:59.929 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:29:59.930 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:29:59.932 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:29:59.933 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:30:00.461 INFO:teuthology.orchestra.run.smithi112.stdout:generic/322 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T17:30:00.470 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/322 2023-09-12T17:30:00.471 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/322 2023-09-12T17:30:00.471 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:30:00.477 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:30:00.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:30:00.516 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-09-12T17:30:00.971 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:30:00.984 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:30:00.985 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:30:00.987 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:30:00.988 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:30:02.596 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:30:02.601 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:30:02.701 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T17:30:02.701+0000 7fd0eedf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129413) UID: 0 2023-09-12T17:30:02.702 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T17:30:02.701+0000 7f05c55f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129413) UID: 0 2023-09-12T17:30:02.703 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T17:30:02.701+0000 7f2623ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129413) UID: 0 2023-09-12T17:30:02.703 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T17:30:02.701+0000 7f858dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129413) UID: 0 2023-09-12T17:32:02.134 INFO:teuthology.orchestra.run.smithi112.stdout:generic/323 121s 2023-09-12T17:32:02.147 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/323 2023-09-12T17:32:02.147 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:32:02.153 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:02.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:32:02.295 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-09-12T17:32:02.926 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:32:02.939 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:32:02.940 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:32:02.942 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:32:02.943 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:03.442 INFO:teuthology.orchestra.run.smithi112.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-09-12T17:32:03.452 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/324 2023-09-12T17:32:03.453 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/324 2023-09-12T17:32:03.453 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:32:03.459 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:03.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:32:03.499 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-09-12T17:32:03.956 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:32:03.968 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:32:03.969 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:32:03.972 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:32:03.972 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:04.488 INFO:teuthology.orchestra.run.smithi112.stdout:generic/325 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T17:32:04.498 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/325 2023-09-12T17:32:04.498 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/325 2023-09-12T17:32:04.498 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:32:04.504 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:04.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:32:04.545 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-09-12T17:32:04.993 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:32:05.005 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:32:05.006 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:32:05.009 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:32:05.009 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:05.897 INFO:teuthology.orchestra.run.smithi112.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:32:05.938 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/326 2023-09-12T17:32:05.939 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/326 2023-09-12T17:32:05.939 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:32:05.947 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:06.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:32:06.235 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-09-12T17:32:06.689 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:32:06.702 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:32:06.703 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:32:06.705 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:32:06.706 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:07.609 INFO:teuthology.orchestra.run.smithi112.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:32:07.633 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/327 2023-09-12T17:32:07.634 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/327 2023-09-12T17:32:07.634 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:32:07.645 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:07.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:32:07.831 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-09-12T17:32:08.292 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:32:08.305 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:32:08.306 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:32:08.309 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:32:08.309 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:09.167 INFO:teuthology.orchestra.run.smithi112.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:32:09.205 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/328 2023-09-12T17:32:09.205 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/328 2023-09-12T17:32:09.205 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:32:09.213 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:09.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:32:09.532 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-09-12T17:32:09.990 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:32:10.003 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:32:10.004 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:32:10.007 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:32:10.007 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:11.001 INFO:teuthology.orchestra.run.smithi112.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:32:11.041 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/329 2023-09-12T17:32:11.042 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/329 2023-09-12T17:32:11.042 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:32:11.053 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:11.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:32:11.254 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-09-12T17:32:11.708 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:32:11.720 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:32:11.721 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:32:11.724 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:32:11.724 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:12.646 INFO:teuthology.orchestra.run.smithi112.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:32:12.708 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/330 2023-09-12T17:32:12.708 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/330 2023-09-12T17:32:12.708 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:32:12.730 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:12.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:32:12.935 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-09-12T17:32:13.394 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:32:13.406 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:32:13.407 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:32:13.410 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:32:13.410 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:14.393 INFO:teuthology.orchestra.run.smithi112.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:32:14.412 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/331 2023-09-12T17:32:14.412 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/331 2023-09-12T17:32:14.413 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:32:14.426 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:14.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:32:14.518 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-09-12T17:32:14.987 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:32:15.000 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:32:15.001 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:32:15.003 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:32:15.004 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:15.892 INFO:teuthology.orchestra.run.smithi112.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:32:15.914 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/332 2023-09-12T17:32:15.915 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/332 2023-09-12T17:32:15.915 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:32:15.927 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:16.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:32:16.190 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-09-12T17:32:16.644 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:32:16.656 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:32:16.657 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:32:16.660 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:32:16.660 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:17.577 INFO:teuthology.orchestra.run.smithi112.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:32:17.595 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/333 2023-09-12T17:32:17.595 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/333 2023-09-12T17:32:17.595 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:32:17.609 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:17.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:32:17.891 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-09-12T17:32:18.344 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:32:18.357 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:32:18.358 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:32:18.360 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:32:18.360 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:19.228 INFO:teuthology.orchestra.run.smithi112.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:32:19.250 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/334 2023-09-12T17:32:19.250 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/334 2023-09-12T17:32:19.250 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:32:19.280 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:19.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:32:19.553 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-09-12T17:32:20.006 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:32:20.019 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:32:20.020 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:32:20.022 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:32:20.023 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:20.562 INFO:teuthology.orchestra.run.smithi112.stdout:generic/335 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T17:32:20.572 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/335 2023-09-12T17:32:20.572 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/335 2023-09-12T17:32:20.572 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:32:20.578 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:20.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:32:20.624 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-09-12T17:32:21.082 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:32:21.094 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:32:21.095 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:32:21.098 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:32:21.098 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:21.641 INFO:teuthology.orchestra.run.smithi112.stdout:generic/336 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T17:32:21.650 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/336 2023-09-12T17:32:21.651 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/336 2023-09-12T17:32:21.651 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:32:21.657 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:21.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:32:21.703 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-09-12T17:32:22.153 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:32:22.166 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:32:22.167 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:32:22.169 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:32:22.170 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:23.009 INFO:teuthology.orchestra.run.smithi112.stdout:generic/337 0s 2023-09-12T17:32:23.022 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/337 2023-09-12T17:32:23.022 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:32:23.028 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:23.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:32:23.049 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-09-12T17:32:23.503 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:32:23.516 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:32:23.517 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:32:23.519 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:32:23.520 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:24.066 INFO:teuthology.orchestra.run.smithi112.stdout:generic/338 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T17:32:24.077 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/338 2023-09-12T17:32:24.077 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/338 2023-09-12T17:32:24.077 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:32:24.083 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:32:24.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:32:24.123 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-09-12T17:32:24.574 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:32:24.587 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:32:24.588 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:32:24.591 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:32:24.591 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:12.955 INFO:teuthology.orchestra.run.smithi112.stdout:generic/339 48s 2023-09-12T17:33:12.968 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/339 2023-09-12T17:33:12.968 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:33:12.974 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:12.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:33:12.995 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-09-12T17:33:13.732 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:33:13.745 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:33:13.746 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:33:13.749 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:33:13.749 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:18.867 INFO:teuthology.orchestra.run.smithi112.stdout:generic/340 5s 2023-09-12T17:33:18.901 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/340 2023-09-12T17:33:18.901 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:33:18.917 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:18.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:33:18.985 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-09-12T17:33:19.678 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:33:19.701 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:33:19.703 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:33:19.706 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:33:19.706 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:20.269 INFO:teuthology.orchestra.run.smithi112.stdout:generic/341 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T17:33:20.279 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/341 2023-09-12T17:33:20.279 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/341 2023-09-12T17:33:20.279 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:33:20.285 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:20.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:33:20.321 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-09-12T17:33:20.769 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:33:20.781 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:33:20.782 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:33:20.785 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:33:20.785 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:21.304 INFO:teuthology.orchestra.run.smithi112.stdout:generic/342 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T17:33:21.313 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/342 2023-09-12T17:33:21.314 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/342 2023-09-12T17:33:21.314 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:33:21.669 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:21.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:33:21.714 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-09-12T17:33:22.170 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:33:22.183 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:33:22.184 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:33:22.187 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:33:22.187 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:22.729 INFO:teuthology.orchestra.run.smithi112.stdout:generic/343 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T17:33:22.739 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/343 2023-09-12T17:33:22.739 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/343 2023-09-12T17:33:22.739 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:33:22.745 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:22.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:33:22.795 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-09-12T17:33:23.249 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:33:23.262 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:33:23.263 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:33:23.266 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:33:23.266 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:33.056 INFO:teuthology.orchestra.run.smithi112.stdout:generic/344 10s 2023-09-12T17:33:33.086 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/344 2023-09-12T17:33:33.086 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:33:33.106 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:33.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:33:33.167 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-09-12T17:33:33.948 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:33:33.966 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:33:33.969 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:33:33.973 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:33:33.973 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:37.961 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:33:37.966 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:33:44.466 INFO:teuthology.orchestra.run.smithi112.stdout:generic/345 10s 2023-09-12T17:33:44.509 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/345 2023-09-12T17:33:44.510 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:33:44.527 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:44.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:33:44.576 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-09-12T17:33:45.108 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:33:45.121 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:33:45.122 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:33:45.125 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:33:45.125 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:50.354 INFO:teuthology.orchestra.run.smithi112.stdout:generic/346 5s 2023-09-12T17:33:50.410 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/346 2023-09-12T17:33:50.411 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:33:50.416 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:50.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:33:50.451 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-09-12T17:33:51.190 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:33:51.223 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:33:51.224 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:33:51.226 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:33:51.226 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:51.819 INFO:teuthology.orchestra.run.smithi112.stdout:generic/347 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T17:33:51.829 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/347 2023-09-12T17:33:51.830 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/347 2023-09-12T17:33:51.830 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:33:51.835 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:51.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:33:51.879 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-09-12T17:33:52.342 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:33:52.354 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:33:52.355 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:33:52.358 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:33:52.358 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:52.903 INFO:teuthology.orchestra.run.smithi112.stdout:generic/348 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T17:33:52.913 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/348 2023-09-12T17:33:52.914 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/348 2023-09-12T17:33:52.914 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:33:52.919 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:52.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:33:52.970 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-09-12T17:33:53.459 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:33:53.472 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:33:53.473 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:33:53.475 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:33:53.476 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:54.680 INFO:teuthology.orchestra.run.smithi112.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-12T17:33:54.690 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/349 2023-09-12T17:33:54.690 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/349 2023-09-12T17:33:54.690 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:33:54.696 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:54.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:33:54.744 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-09-12T17:33:55.199 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:33:55.211 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:33:55.212 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:33:55.215 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:33:55.215 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:56.467 INFO:teuthology.orchestra.run.smithi112.stdout:generic/350 1s 2023-09-12T17:33:56.480 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/350 2023-09-12T17:33:56.481 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:33:56.486 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:56.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:33:56.507 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-09-12T17:33:56.966 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:33:56.979 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:33:56.980 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:33:56.983 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:33:56.983 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:57.519 INFO:teuthology.orchestra.run.smithi112.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T17:33:57.530 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/351 2023-09-12T17:33:57.530 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/351 2023-09-12T17:33:57.530 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:33:57.536 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:57.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:33:57.591 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-09-12T17:33:58.042 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:33:58.055 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:33:58.056 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:33:58.058 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:33:58.059 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:58.933 INFO:teuthology.orchestra.run.smithi112.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:33:58.974 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/352 2023-09-12T17:33:58.974 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/352 2023-09-12T17:33:58.974 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:33:58.990 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:33:59.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:33:59.120 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-09-12T17:33:59.590 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:33:59.603 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:33:59.604 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:33:59.607 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:33:59.607 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:00.494 INFO:teuthology.orchestra.run.smithi112.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:34:00.527 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/353 2023-09-12T17:34:00.528 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/353 2023-09-12T17:34:00.528 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:00.543 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:00.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:00.722 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-09-12T17:34:01.179 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:01.192 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:01.193 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:01.196 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:01.196 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:08.147 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:34:08.153 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:34:10.971 INFO:teuthology.orchestra.run.smithi112.stdout:generic/354 9s 2023-09-12T17:34:11.022 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/354 2023-09-12T17:34:11.023 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:11.032 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:11.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:11.096 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-09-12T17:34:11.813 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:11.829 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:11.831 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:11.834 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:11.835 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:12.930 INFO:teuthology.orchestra.run.smithi112.stdout:generic/355 0s 2023-09-12T17:34:12.943 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/355 2023-09-12T17:34:12.943 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:12.949 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:13.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:13.110 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-09-12T17:34:13.740 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:13.753 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:13.754 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:13.757 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:13.757 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:14.539 INFO:teuthology.orchestra.run.smithi112.stdout:generic/356 [not run] swapfiles are not supported 2023-09-12T17:34:14.549 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/356 2023-09-12T17:34:14.550 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/356 2023-09-12T17:34:14.550 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:14.556 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:14.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:14.598 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-09-12T17:34:15.054 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:15.066 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:15.068 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:15.070 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:15.070 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:15.794 INFO:teuthology.orchestra.run.smithi112.stdout:generic/357 [not run] swapfiles are not supported 2023-09-12T17:34:15.804 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/357 2023-09-12T17:34:15.804 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/357 2023-09-12T17:34:15.804 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:15.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:15.851 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-09-12T17:34:16.305 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:16.318 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:16.319 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:16.322 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:16.322 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:17.151 INFO:teuthology.orchestra.run.smithi112.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:34:17.189 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/358 2023-09-12T17:34:17.190 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/358 2023-09-12T17:34:17.190 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:17.225 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:17.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:17.403 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-09-12T17:34:17.860 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:17.872 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:17.873 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:17.876 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:17.876 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:18.754 INFO:teuthology.orchestra.run.smithi112.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:34:18.787 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/359 2023-09-12T17:34:18.788 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/359 2023-09-12T17:34:18.788 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:18.812 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:18.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:18.947 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-09-12T17:34:19.413 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:19.425 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:19.426 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:19.428 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:19.429 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:19.995 INFO:teuthology.orchestra.run.smithi112.stdout:generic/360 0s 2023-09-12T17:34:20.008 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/360 2023-09-12T17:34:20.008 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:20.014 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:20.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:20.053 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-09-12T17:34:20.507 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:20.520 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:20.521 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:20.523 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:20.524 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:21.033 INFO:teuthology.orchestra.run.smithi112.stdout:generic/361 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T17:34:21.042 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/361 2023-09-12T17:34:21.043 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/361 2023-09-12T17:34:21.043 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:21.049 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:21.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:21.087 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-09-12T17:34:21.536 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:21.548 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:21.550 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:21.552 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:21.553 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:22.043 INFO:teuthology.orchestra.run.smithi112.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-12T17:34:22.054 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/362 2023-09-12T17:34:22.054 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/362 2023-09-12T17:34:22.054 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:22.060 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:22.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:22.100 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-09-12T17:34:22.548 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:22.561 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:22.562 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:22.565 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:22.565 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:23.048 INFO:teuthology.orchestra.run.smithi112.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-12T17:34:23.058 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/363 2023-09-12T17:34:23.058 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/363 2023-09-12T17:34:23.058 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:23.064 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:23.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:23.102 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-09-12T17:34:23.562 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:23.574 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:23.575 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:23.578 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:23.578 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:24.061 INFO:teuthology.orchestra.run.smithi112.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-12T17:34:24.071 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/364 2023-09-12T17:34:24.072 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/364 2023-09-12T17:34:24.072 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:24.077 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:24.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:24.118 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-09-12T17:34:24.570 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:24.583 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:24.584 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:24.587 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:24.587 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:25.071 INFO:teuthology.orchestra.run.smithi112.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-12T17:34:25.081 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/365 2023-09-12T17:34:25.082 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/365 2023-09-12T17:34:25.082 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:25.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:25.124 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-09-12T17:34:25.575 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:25.587 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:25.588 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:25.591 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:25.591 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:26.078 INFO:teuthology.orchestra.run.smithi112.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-12T17:34:26.089 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/366 2023-09-12T17:34:26.089 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/366 2023-09-12T17:34:26.089 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:26.095 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:26.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:26.132 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-09-12T17:34:26.589 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:26.601 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:26.602 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:26.605 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:26.605 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:27.081 INFO:teuthology.orchestra.run.smithi112.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-12T17:34:27.092 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/367 2023-09-12T17:34:27.092 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/367 2023-09-12T17:34:27.092 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:27.098 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:27.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:27.134 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-09-12T17:34:27.583 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:27.596 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:27.597 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:27.599 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:27.600 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:28.089 INFO:teuthology.orchestra.run.smithi112.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-12T17:34:28.099 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/368 2023-09-12T17:34:28.099 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/368 2023-09-12T17:34:28.099 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:28.105 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:28.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:28.148 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-09-12T17:34:28.597 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:28.609 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:28.611 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:28.613 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:28.613 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:29.120 INFO:teuthology.orchestra.run.smithi112.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-12T17:34:29.130 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/369 2023-09-12T17:34:29.130 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/369 2023-09-12T17:34:29.130 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:29.136 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:29.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:29.173 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-09-12T17:34:29.619 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:29.631 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:29.633 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:29.635 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:29.635 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:30.115 INFO:teuthology.orchestra.run.smithi112.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-12T17:34:30.125 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/370 2023-09-12T17:34:30.125 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/370 2023-09-12T17:34:30.125 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:30.131 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:30.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:30.172 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-09-12T17:34:30.620 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:30.632 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:30.633 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:30.636 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:31.150 INFO:teuthology.orchestra.run.smithi112.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T17:34:31.160 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/371 2023-09-12T17:34:31.160 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/371 2023-09-12T17:34:31.161 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:31.166 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:31.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:31.205 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-09-12T17:34:31.653 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:31.666 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:31.667 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:31.670 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:31.670 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:32.508 INFO:teuthology.orchestra.run.smithi112.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:34:32.559 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/372 2023-09-12T17:34:32.559 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/372 2023-09-12T17:34:32.559 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:32.567 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:32.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:32.749 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-09-12T17:34:33.207 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:33.219 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:33.221 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:33.223 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:33.223 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:34.065 INFO:teuthology.orchestra.run.smithi112.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:34:34.091 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/373 2023-09-12T17:34:34.091 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/373 2023-09-12T17:34:34.094 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:34.111 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:34.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:34.379 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-09-12T17:34:34.827 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:34.839 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:34.840 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:34.843 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:34.843 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:35.554 INFO:teuthology.orchestra.run.smithi112.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-09-12T17:34:35.692 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/374 2023-09-12T17:34:35.692 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/374 2023-09-12T17:34:35.692 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:35.697 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:36.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:36.006 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-09-12T17:34:36.469 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:36.481 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:36.483 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:36.485 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:36.485 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:37.130 INFO:teuthology.orchestra.run.smithi112.stdout:generic/375 1s 2023-09-12T17:34:37.143 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/375 2023-09-12T17:34:37.144 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:37.149 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:37.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:37.303 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-09-12T17:34:37.924 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:37.936 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:37.938 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:37.940 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:37.941 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:38.467 INFO:teuthology.orchestra.run.smithi112.stdout:generic/376 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T17:34:38.477 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/376 2023-09-12T17:34:38.477 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/376 2023-09-12T17:34:38.477 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:38.483 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:38.494 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:34:38.499 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:34:38.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:38.523 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-09-12T17:34:39.013 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:39.025 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:39.027 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:39.029 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:39.029 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:39.808 INFO:teuthology.orchestra.run.smithi112.stdout:generic/377 0s 2023-09-12T17:34:39.820 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/377 2023-09-12T17:34:39.821 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:39.826 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:39.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:39.847 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-09-12T17:34:40.300 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:40.312 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:40.313 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:40.316 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:40.316 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:41.201 INFO:teuthology.orchestra.run.smithi112.stdout:generic/378 1s 2023-09-12T17:34:41.277 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/378 2023-09-12T17:34:41.277 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:41.283 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:41.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:41.445 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-09-12T17:34:42.086 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:42.099 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:42.100 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:42.103 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:42.103 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:42.619 INFO:teuthology.orchestra.run.smithi112.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T17:34:42.630 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/379 2023-09-12T17:34:42.630 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/379 2023-09-12T17:34:42.630 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:42.636 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:42.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:42.673 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-09-12T17:34:43.129 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:43.142 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:43.143 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:43.145 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:43.145 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:43.632 INFO:teuthology.orchestra.run.smithi112.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T17:34:43.642 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/380 2023-09-12T17:34:43.643 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/380 2023-09-12T17:34:43.643 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:43.648 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:43.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:43.689 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-09-12T17:34:44.138 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:44.150 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:44.151 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:44.154 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:44.154 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:44.642 INFO:teuthology.orchestra.run.smithi112.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T17:34:44.652 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/381 2023-09-12T17:34:44.652 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/381 2023-09-12T17:34:44.653 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:44.658 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:44.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:44.695 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-09-12T17:34:45.152 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:45.165 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:45.166 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:45.169 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:45.169 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:45.669 INFO:teuthology.orchestra.run.smithi112.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T17:34:45.679 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/382 2023-09-12T17:34:45.680 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/382 2023-09-12T17:34:45.680 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:45.686 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:45.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:45.724 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-09-12T17:34:46.190 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:46.202 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:46.203 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:46.206 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:46.206 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:46.697 INFO:teuthology.orchestra.run.smithi112.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T17:34:46.707 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/383 2023-09-12T17:34:46.707 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/383 2023-09-12T17:34:46.708 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:46.714 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:46.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:46.755 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-09-12T17:34:47.206 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:47.219 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:47.220 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:47.222 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:47.222 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:47.739 INFO:teuthology.orchestra.run.smithi112.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T17:34:47.749 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/384 2023-09-12T17:34:47.749 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/384 2023-09-12T17:34:47.749 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:47.755 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:47.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:47.793 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-09-12T17:34:48.242 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:48.254 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:48.255 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:48.258 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:48.755 INFO:teuthology.orchestra.run.smithi112.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T17:34:48.765 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/385 2023-09-12T17:34:48.765 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/385 2023-09-12T17:34:48.765 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:48.771 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:48.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:48.808 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-09-12T17:34:49.259 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:49.272 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:49.273 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:49.276 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:49.276 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:49.761 INFO:teuthology.orchestra.run.smithi112.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T17:34:49.772 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/386 2023-09-12T17:34:49.772 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/386 2023-09-12T17:34:49.772 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:49.778 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:49.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:49.818 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-09-12T17:34:50.265 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:50.278 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:50.279 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:50.282 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:50.282 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:51.136 INFO:teuthology.orchestra.run.smithi112.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:34:51.175 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/387 2023-09-12T17:34:51.175 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/387 2023-09-12T17:34:51.175 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:51.185 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:51.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:51.376 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-09-12T17:34:51.831 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:51.844 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:51.845 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:51.849 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:51.850 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:52.368 INFO:teuthology.orchestra.run.smithi112.stdout:generic/388 [not run] require 172.21.15.112:6789:/scratch to be local device 2023-09-12T17:34:52.378 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/388 2023-09-12T17:34:52.378 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/388 2023-09-12T17:34:52.378 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:52.384 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:52.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:52.421 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-09-12T17:34:52.877 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:52.889 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:52.890 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:52.893 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:52.893 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:53.399 INFO:teuthology.orchestra.run.smithi112.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-09-12T17:34:53.410 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/389 2023-09-12T17:34:53.410 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/389 2023-09-12T17:34:53.410 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:53.416 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:53.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:53.462 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-09-12T17:34:53.910 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:53.922 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:53.924 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:53.926 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:53.927 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:54.449 INFO:teuthology.orchestra.run.smithi112.stdout:generic/390 [not run] ceph does not support freezing 2023-09-12T17:34:54.459 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/390 2023-09-12T17:34:54.459 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/390 2023-09-12T17:34:54.459 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:54.465 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:54.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:54.505 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-09-12T17:34:54.959 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:54.972 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:54.973 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:54.976 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:54.976 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:55.495 INFO:teuthology.orchestra.run.smithi112.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T17:34:55.506 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/391 2023-09-12T17:34:55.506 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/391 2023-09-12T17:34:55.506 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:55.512 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:55.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:55.561 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-09-12T17:34:56.013 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:56.025 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:56.027 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:56.029 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:56.029 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:56.683 INFO:teuthology.orchestra.run.smithi112.stdout:generic/392 [not run] ceph does not support shutdown 2023-09-12T17:34:56.709 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/392 2023-09-12T17:34:56.710 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/392 2023-09-12T17:34:56.710 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:56.717 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:56.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:56.756 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-09-12T17:34:57.210 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:57.222 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:57.223 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:57.226 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:57.226 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:58.491 INFO:teuthology.orchestra.run.smithi112.stdout:generic/393 1s 2023-09-12T17:34:58.504 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/393 2023-09-12T17:34:58.504 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:58.510 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:58.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:58.532 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-09-12T17:34:58.985 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:34:58.998 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:34:58.999 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:34:59.002 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:34:59.002 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:59.555 INFO:teuthology.orchestra.run.smithi112.stdout:generic/394 0s 2023-09-12T17:34:59.568 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/394 2023-09-12T17:34:59.568 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:34:59.574 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:34:59.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:34:59.714 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-09-12T17:35:00.353 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:00.372 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:00.373 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:00.376 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:00.376 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:02.484 INFO:teuthology.orchestra.run.smithi112.stdout:generic/395 2s 2023-09-12T17:35:02.513 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/395 2023-09-12T17:35:02.514 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:02.525 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:02.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:02.568 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-09-12T17:35:03.097 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:03.109 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:03.110 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:03.113 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:03.113 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:04.259 INFO:teuthology.orchestra.run.smithi112.stdout:generic/396 1s 2023-09-12T17:35:04.272 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/396 2023-09-12T17:35:04.272 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:04.277 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:04.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:04.299 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-09-12T17:35:04.749 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:04.762 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:04.763 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:04.766 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:04.766 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:06.765 INFO:teuthology.orchestra.run.smithi112.stdout:generic/397 2s 2023-09-12T17:35:06.778 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/397 2023-09-12T17:35:06.778 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:06.784 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:06.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:06.805 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-09-12T17:35:07.259 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:07.272 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:07.273 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:07.276 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:07.276 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:08.144 INFO:teuthology.orchestra.run.smithi112.stdout:generic/398 [not run] kernel doesn't support renameat2 syscall 2023-09-12T17:35:08.154 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/398 2023-09-12T17:35:08.154 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/398 2023-09-12T17:35:08.154 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:08.160 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:08.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:08.243 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-09-12T17:35:08.615 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:35:08.620 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:35:08.925 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:08.937 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:08.938 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:08.941 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:08.941 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:09.820 INFO:teuthology.orchestra.run.smithi112.stdout:generic/399 [not run] Filesystem ceph not supported in _scratch_mkfs_sized_encrypted 2023-09-12T17:35:09.830 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/399 2023-09-12T17:35:09.830 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/399 2023-09-12T17:35:09.830 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:09.836 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:09.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:09.881 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-09-12T17:35:10.330 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:10.342 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:10.344 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:10.346 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:10.346 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:10.834 INFO:teuthology.orchestra.run.smithi112.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T17:35:10.844 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/400 2023-09-12T17:35:10.844 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/400 2023-09-12T17:35:10.844 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:10.850 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:10.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:10.894 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-09-12T17:35:11.344 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:11.357 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:11.358 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:11.361 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:11.361 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:12.325 INFO:teuthology.orchestra.run.smithi112.stdout:generic/401 1s 2023-09-12T17:35:12.366 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/401 2023-09-12T17:35:12.366 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:12.375 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:12.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:12.440 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-09-12T17:35:12.981 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:12.993 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:12.995 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:12.997 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:12.998 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:13.701 INFO:teuthology.orchestra.run.smithi112.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-09-12T17:35:13.735 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/402 2023-09-12T17:35:13.735 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/402 2023-09-12T17:35:13.735 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:13.740 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:13.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:13.788 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-09-12T17:35:14.244 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:14.256 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:14.257 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:14.260 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:14.260 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:15.398 INFO:teuthology.orchestra.run.smithi112.stdout:generic/403 1s 2023-09-12T17:35:15.410 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/403 2023-09-12T17:35:15.410 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:15.416 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:15.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:15.438 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-09-12T17:35:15.893 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:15.905 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:15.906 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:15.909 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:16.437 INFO:teuthology.orchestra.run.smithi112.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T17:35:16.447 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/404 2023-09-12T17:35:16.447 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/404 2023-09-12T17:35:16.447 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:16.453 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:16.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:16.498 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-09-12T17:35:16.955 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:16.968 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:16.969 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:16.973 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:16.973 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:17.541 INFO:teuthology.orchestra.run.smithi112.stdout:generic/405 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T17:35:17.551 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/405 2023-09-12T17:35:17.552 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/405 2023-09-12T17:35:17.552 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:17.558 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:17.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:17.597 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-09-12T17:35:18.048 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:18.060 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:18.062 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:18.064 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:18.064 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:20.454 INFO:teuthology.orchestra.run.smithi112.stdout:generic/406 2s 2023-09-12T17:35:20.467 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/406 2023-09-12T17:35:20.468 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:20.473 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:20.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:20.495 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-09-12T17:35:20.947 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:20.959 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:20.960 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:20.963 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:20.963 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:21.585 INFO:teuthology.orchestra.run.smithi112.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T17:35:21.595 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/407 2023-09-12T17:35:21.595 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/407 2023-09-12T17:35:21.596 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:21.602 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:21.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:21.747 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-09-12T17:35:22.381 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:22.394 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:22.395 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:22.397 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:22.398 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:22.973 INFO:teuthology.orchestra.run.smithi112.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-12T17:35:22.983 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/408 2023-09-12T17:35:22.983 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/408 2023-09-12T17:35:22.983 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:22.989 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:23.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:23.137 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-09-12T17:35:23.778 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:23.791 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:23.792 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:23.795 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:23.795 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:24.300 INFO:teuthology.orchestra.run.smithi112.stdout:generic/409 [not run] require 172.21.15.112:6789:/scratch to be local device 2023-09-12T17:35:24.310 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/409 2023-09-12T17:35:24.310 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/409 2023-09-12T17:35:24.310 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:24.316 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:24.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:24.354 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-09-12T17:35:24.804 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:24.816 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:24.817 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:24.820 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:24.820 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:25.329 INFO:teuthology.orchestra.run.smithi112.stdout:generic/410 [not run] require 172.21.15.112:6789:/scratch to be local device 2023-09-12T17:35:25.339 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/410 2023-09-12T17:35:25.339 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/410 2023-09-12T17:35:25.339 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:25.345 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:25.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:25.382 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-09-12T17:35:25.836 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:25.849 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:25.850 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:25.853 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:25.853 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:26.360 INFO:teuthology.orchestra.run.smithi112.stdout:generic/411 [not run] require 172.21.15.112:6789:/scratch to be local device 2023-09-12T17:35:26.370 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/411 2023-09-12T17:35:26.370 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/411 2023-09-12T17:35:26.371 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:26.376 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:26.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:26.413 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-09-12T17:35:26.862 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:26.875 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:26.876 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:26.878 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:26.879 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:27.785 INFO:teuthology.orchestra.run.smithi112.stdout:generic/412 0s 2023-09-12T17:35:27.798 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/412 2023-09-12T17:35:27.798 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:27.804 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:27.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:27.826 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-09-12T17:35:28.273 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:28.286 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:28.286 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:28.289 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:28.289 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:28.939 INFO:teuthology.orchestra.run.smithi112.stdout:generic/413 [not run] mount 172.21.15.112:6789:/scratch with dax failed 2023-09-12T17:35:28.949 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/413 2023-09-12T17:35:28.950 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/413 2023-09-12T17:35:28.950 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:28.955 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:28.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:28.991 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-09-12T17:35:29.447 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:29.460 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:29.461 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:29.463 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:29.463 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:30.321 INFO:teuthology.orchestra.run.smithi112.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:35:30.363 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/414 2023-09-12T17:35:30.363 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/414 2023-09-12T17:35:30.364 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:30.377 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:30.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:30.509 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-09-12T17:35:30.982 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:30.994 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:30.995 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:30.998 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:30.998 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:31.882 INFO:teuthology.orchestra.run.smithi112.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T17:35:31.944 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/415 2023-09-12T17:35:31.944 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/415 2023-09-12T17:35:31.944 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:31.955 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:32.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:32.098 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-09-12T17:35:32.550 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:32.562 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:32.563 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:32.566 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:32.566 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:33.070 INFO:teuthology.orchestra.run.smithi112.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-12T17:35:33.080 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/416 2023-09-12T17:35:33.080 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/416 2023-09-12T17:35:33.081 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:33.086 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:33.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:33.124 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-09-12T17:35:33.576 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:33.589 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:33.590 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:33.593 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:33.593 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:34.226 INFO:teuthology.orchestra.run.smithi112.stdout:generic/417 [not run] ceph does not support shutdown 2023-09-12T17:35:34.257 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/417 2023-09-12T17:35:34.257 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/417 2023-09-12T17:35:34.257 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:34.262 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:34.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:34.300 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-09-12T17:35:34.750 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:34.762 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:34.763 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:34.766 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:34.766 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:35.299 INFO:teuthology.orchestra.run.smithi112.stdout:generic/418 [not run] require 172.21.15.112:6789:/test to be valid block disk 2023-09-12T17:35:35.309 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/418 2023-09-12T17:35:35.309 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/418 2023-09-12T17:35:35.309 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:35.315 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:35.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:35.356 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-09-12T17:35:35.806 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:35.818 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:35.819 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:35.822 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:35.822 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:36.658 INFO:teuthology.orchestra.run.smithi112.stdout:generic/419 [not run] kernel doesn't support renameat2 syscall 2023-09-12T17:35:36.668 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/419 2023-09-12T17:35:36.668 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/419 2023-09-12T17:35:36.668 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:36.674 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:36.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:36.843 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-09-12T17:35:37.457 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:37.469 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:37.470 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:37.473 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:37.473 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:38.181 INFO:teuthology.orchestra.run.smithi112.stdout:generic/420 1s 2023-09-12T17:35:38.194 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/420 2023-09-12T17:35:38.195 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:38.200 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:38.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:38.363 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-09-12T17:35:38.853 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:35:38.858 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:35:38.990 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:39.003 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:39.004 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:39.007 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:39.007 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:46.534 INFO:teuthology.orchestra.run.smithi112.stdout:generic/421 7s 2023-09-12T17:35:46.606 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/421 2023-09-12T17:35:46.606 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:46.628 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:46.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:46.678 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-09-12T17:35:47.174 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:47.186 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:47.187 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:47.190 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:47.191 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:47.720 INFO:teuthology.orchestra.run.smithi112.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-12T17:35:47.730 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/422 2023-09-12T17:35:47.730 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/422 2023-09-12T17:35:47.730 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:47.736 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:47.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:47.778 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-09-12T17:35:48.242 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:48.254 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:48.255 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:48.258 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:48.258 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:48.900 INFO:teuthology.orchestra.run.smithi112.stdout:generic/423 0s 2023-09-12T17:35:48.913 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/423 2023-09-12T17:35:48.913 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:48.919 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:49.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:49.072 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-09-12T17:35:49.719 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:49.732 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:49.733 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:49.736 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:49.736 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:50.265 INFO:teuthology.orchestra.run.smithi112.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-09-12T17:35:50.274 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/424 2023-09-12T17:35:50.275 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/424 2023-09-12T17:35:50.275 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:50.281 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:50.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:50.322 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-09-12T17:35:50.777 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:50.789 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:50.791 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:50.793 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:50.794 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:51.342 INFO:teuthology.orchestra.run.smithi112.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-09-12T17:35:51.352 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/425 2023-09-12T17:35:51.352 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/425 2023-09-12T17:35:51.352 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:35:51.358 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:35:51.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:35:51.481 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-09-12T17:35:52.134 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:35:52.147 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:35:52.148 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:35:52.150 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:35:52.150 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:36:09.024 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:36:09.030 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:36:38.269 INFO:teuthology.orchestra.run.smithi112.stdout:generic/426 46s 2023-09-12T17:36:38.352 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/426 2023-09-12T17:36:38.352 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:36:38.359 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:36:38.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:36:38.590 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-09-12T17:36:39.222 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:36:39.227 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:36:40.044 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:36:40.057 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:36:40.058 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:36:40.060 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:36:40.061 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:36:40.710 INFO:teuthology.orchestra.run.smithi112.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-12T17:36:40.720 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/427 2023-09-12T17:36:40.720 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/427 2023-09-12T17:36:40.720 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:36:40.726 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:36:40.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:36:40.771 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-09-12T17:36:41.226 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:36:41.239 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:36:41.240 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:36:41.243 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:36:41.243 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:36:41.790 INFO:teuthology.orchestra.run.smithi112.stdout:generic/428 0s 2023-09-12T17:36:41.803 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/428 2023-09-12T17:36:41.803 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:36:41.810 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:36:41.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:36:41.856 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-09-12T17:36:42.314 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:36:42.327 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:36:42.328 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:36:42.330 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:36:42.331 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:36:54.128 INFO:teuthology.orchestra.run.smithi112.stdout:generic/429 12s 2023-09-12T17:36:54.141 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/429 2023-09-12T17:36:54.141 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:36:54.147 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:36:54.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:36:54.169 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-09-12T17:36:54.617 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:36:54.632 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:36:54.634 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:36:54.638 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:36:54.638 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:36:55.430 INFO:teuthology.orchestra.run.smithi112.stdout:generic/430 1s 2023-09-12T17:36:55.443 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/430 2023-09-12T17:36:55.444 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:36:55.450 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:36:55.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:36:55.610 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-09-12T17:36:56.224 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:36:56.237 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:36:56.238 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:36:56.241 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:36:56.241 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:36:56.889 INFO:teuthology.orchestra.run.smithi112.stdout:generic/431 0s 2023-09-12T17:36:56.902 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/431 2023-09-12T17:36:56.903 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:36:56.908 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:36:57.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:36:57.070 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-09-12T17:36:57.680 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:36:57.693 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:36:57.694 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:36:57.696 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:36:57.697 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:36:58.368 INFO:teuthology.orchestra.run.smithi112.stdout:generic/432 1s 2023-09-12T17:36:58.381 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/432 2023-09-12T17:36:58.381 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:36:58.387 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:36:58.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:36:58.561 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-09-12T17:36:59.159 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:36:59.172 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:36:59.173 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:36:59.175 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:36:59.176 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:36:59.813 INFO:teuthology.orchestra.run.smithi112.stdout:generic/433 0s 2023-09-12T17:36:59.826 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/433 2023-09-12T17:36:59.826 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:36:59.832 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:36:59.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:36:59.972 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-09-12T17:37:00.578 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:37:00.591 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:37:00.592 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:37:00.595 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:37:00.595 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:37:01.245 INFO:teuthology.orchestra.run.smithi112.stdout:generic/434 1s 2023-09-12T17:37:01.258 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/434 2023-09-12T17:37:01.258 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T17:37:01.264 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:37:01.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T17:37:01.431 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-09-12T17:37:02.040 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T17:37:02.052 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T17:37:02.053 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T17:37:02.056 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T17:37:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T17:37:09.450 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:37:09.455 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:37:39.570 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:37:39.598 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:37:39.978 INFO:tasks.ceph.mds.a.smithi112.stderr:2023-09-12T17:37:39.977+0000 7fc85dff9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 438772) UID: 0 2023-09-12T17:37:39.980 INFO:tasks.ceph.mds.c.smithi112.stderr:2023-09-12T17:37:39.978+0000 7f35a2bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 438772) UID: 0 2023-09-12T17:41:33.176 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:41:33.183 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:41:33.279 INFO:tasks.ceph.mds.c.smithi112.stderr:2023-09-12T17:41:33.279+0000 7f35a2bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 438937) UID: 0 2023-09-12T17:41:33.280 INFO:tasks.ceph.mds.a.smithi112.stderr:2023-09-12T17:41:33.279+0000 7fc85dff9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 438937) UID: 0 2023-09-12T17:45:28.709 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T17:45:28.708+0000 7f195aff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 439069) UID: 0 2023-09-12T17:45:28.722 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T17:45:28.708+0000 7f49c5bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 439069) UID: 0 2023-09-12T17:45:28.724 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T17:45:28.708+0000 7fb9131f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 439069) UID: 0 2023-09-12T17:45:28.724 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T17:45:28.708+0000 7fed0e9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 439069) UID: 0 2023-09-12T17:49:11.051 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:49:11.058 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T17:49:13.581 INFO:tasks.ceph.mds.a.smithi112.stderr:2023-09-12T17:49:13.580+0000 7fc85dff9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 439130) UID: 0 2023-09-12T17:49:13.582 INFO:tasks.ceph.mds.c.smithi112.stderr:2023-09-12T17:49:13.580+0000 7f35a2bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 439130) UID: 0 2023-09-12T18:02:26.260 INFO:teuthology.orchestra.run.smithi112.stdout:generic/435 1524s 2023-09-12T18:02:26.329 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/435 2023-09-12T18:02:26.329 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:02:26.334 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:02:26.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:02:26.357 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-09-12T18:02:27.395 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:02:27.408 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:02:27.409 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:02:27.411 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:02:27.411 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:02:28.351 INFO:teuthology.orchestra.run.smithi112.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T18:02:28.361 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/436 2023-09-12T18:02:28.361 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/436 2023-09-12T18:02:28.361 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:02:28.367 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:02:28.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:02:28.521 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-09-12T18:02:29.259 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:02:29.271 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:02:29.272 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:02:29.274 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:02:29.275 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:02:30.563 INFO:teuthology.orchestra.run.smithi112.stdout:generic/437 1s 2023-09-12T18:02:30.576 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/437 2023-09-12T18:02:30.576 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:02:30.582 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:02:30.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:02:30.628 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-09-12T18:02:31.083 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:02:31.095 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:02:31.096 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:02:31.099 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:02:31.099 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:03:49.901 INFO:teuthology.orchestra.run.smithi112.stdout:generic/438 78s 2023-09-12T18:03:49.914 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/438 2023-09-12T18:03:49.915 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:03:49.920 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:03:49.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:03:49.968 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-09-12T18:03:50.420 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:03:50.432 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:03:50.434 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:03:50.436 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:03:50.436 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:03:51.969 INFO:teuthology.orchestra.run.smithi112.stdout:generic/439 1s 2023-09-12T18:03:51.982 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/439 2023-09-12T18:03:51.983 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:03:51.989 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:03:52.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:03:52.044 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-09-12T18:03:52.493 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:03:52.505 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:03:52.506 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:03:52.509 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:03:52.509 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:03:54.561 INFO:teuthology.orchestra.run.smithi112.stdout:generic/440 2s 2023-09-12T18:03:54.574 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/440 2023-09-12T18:03:54.575 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:03:54.580 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:03:54.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:03:54.603 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-09-12T18:03:55.064 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:03:55.077 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:03:55.078 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:03:55.081 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:03:55.081 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:03:55.715 INFO:teuthology.orchestra.run.smithi112.stdout:generic/441 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T18:03:55.725 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/441 2023-09-12T18:03:55.726 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/441 2023-09-12T18:03:55.726 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:03:55.732 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:03:55.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:03:55.777 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-09-12T18:03:56.239 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:03:56.252 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:03:56.253 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:03:56.255 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:03:56.255 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:03:56.835 INFO:teuthology.orchestra.run.smithi112.stdout:generic/442 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T18:03:56.845 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/442 2023-09-12T18:03:56.845 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/442 2023-09-12T18:03:56.845 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:03:56.851 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:03:56.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:03:56.893 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-09-12T18:03:57.351 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:03:57.363 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:03:57.364 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:03:57.367 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:03:57.367 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:03:57.955 INFO:teuthology.orchestra.run.smithi112.stdout:generic/443 0s 2023-09-12T18:03:57.968 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/443 2023-09-12T18:03:57.968 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:03:57.974 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:03:58.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:03:58.025 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-09-12T18:03:58.482 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:03:58.495 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:03:58.496 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:03:58.498 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:03:58.498 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:03:59.161 INFO:teuthology.orchestra.run.smithi112.stdout:generic/444 1s 2023-09-12T18:03:59.174 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/444 2023-09-12T18:03:59.174 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:03:59.180 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:03:59.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:03:59.234 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-09-12T18:03:59.690 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:03:59.702 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:03:59.703 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:03:59.705 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:03:59.706 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:04:00.645 INFO:teuthology.orchestra.run.smithi112.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T18:04:00.655 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/445 2023-09-12T18:04:00.655 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/445 2023-09-12T18:04:00.656 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:04:00.661 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:04:00.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:04:00.790 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-09-12T18:04:01.512 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:04:01.524 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:04:01.526 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:04:01.529 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:04:01.529 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:04:24.785 INFO:teuthology.orchestra.run.smithi112.stdout:generic/446 23s 2023-09-12T18:04:24.834 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/446 2023-09-12T18:04:24.834 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:04:24.845 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:04:24.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:04:24.888 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-09-12T18:04:25.521 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:04:25.534 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:04:25.535 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:04:25.538 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:04:25.538 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:04:26.388 INFO:teuthology.orchestra.run.smithi112.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T18:04:26.420 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/447 2023-09-12T18:04:26.420 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/447 2023-09-12T18:04:26.421 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:04:26.433 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:04:26.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:04:26.641 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-09-12T18:04:27.149 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:04:27.161 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:04:27.162 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:04:27.165 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:04:27.165 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:04:28.477 INFO:teuthology.orchestra.run.smithi112.stdout:generic/448 1s 2023-09-12T18:04:28.490 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/448 2023-09-12T18:04:28.490 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:04:28.496 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:04:28.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:04:28.625 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-09-12T18:04:29.387 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:04:29.399 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:04:29.400 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:04:29.403 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:04:29.403 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:04:29.973 INFO:teuthology.orchestra.run.smithi112.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-12T18:04:29.983 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/449 2023-09-12T18:04:29.983 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/449 2023-09-12T18:04:29.984 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:04:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:04:30.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:04:30.110 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-09-12T18:04:30.853 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:04:30.868 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:04:30.869 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:04:30.871 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:04:30.871 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:04:32.088 INFO:teuthology.orchestra.run.smithi112.stdout:generic/450 0s 2023-09-12T18:04:32.101 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/450 2023-09-12T18:04:32.101 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:04:32.107 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:04:32.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:04:32.255 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-09-12T18:04:33.000 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:04:33.012 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:04:33.014 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:04:33.016 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:04:33.017 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:04:37.470 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T18:04:37.469+0000 7f195aff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 467449) UID: 0 2023-09-12T18:04:37.471 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T18:04:37.469+0000 7f49c5bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 467449) UID: 0 2023-09-12T18:04:37.471 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T18:04:37.469+0000 7fed0e9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 467449) UID: 0 2023-09-12T18:04:37.472 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T18:04:37.469+0000 7fb9131f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 467449) UID: 0 2023-09-12T18:05:04.566 INFO:teuthology.orchestra.run.smithi112.stdout:generic/451 31s 2023-09-12T18:05:04.967 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/451 2023-09-12T18:05:04.968 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:05:04.973 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:05.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:05:05.247 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-09-12T18:05:05.864 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:05:05.876 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:05:05.877 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:05:05.880 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:05:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:07.839 INFO:teuthology.orchestra.run.smithi112.stdout:generic/452 1s 2023-09-12T18:05:07.852 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/452 2023-09-12T18:05:07.853 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:05:07.858 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:07.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:05:07.879 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-09-12T18:05:08.330 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:05:08.343 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:05:08.344 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:05:08.346 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:05:08.346 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:08.839 INFO:teuthology.orchestra.run.smithi112.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-09-12T18:05:08.849 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/453 2023-09-12T18:05:08.849 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/453 2023-09-12T18:05:08.850 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:05:08.855 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:08.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:05:08.900 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-09-12T18:05:09.364 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:05:09.376 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:05:09.377 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:05:09.380 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:05:09.380 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:09.932 INFO:teuthology.orchestra.run.smithi112.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-09-12T18:05:09.942 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/454 2023-09-12T18:05:09.943 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/454 2023-09-12T18:05:09.943 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:05:09.948 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:09.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:05:09.993 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-09-12T18:05:10.448 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:05:10.461 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:05:10.462 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:05:10.465 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:05:10.465 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:11.160 INFO:teuthology.orchestra.run.smithi112.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2023-09-12T18:05:11.169 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/455 2023-09-12T18:05:11.170 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/455 2023-09-12T18:05:11.170 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:05:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:11.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:05:11.218 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-09-12T18:05:11.673 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:05:11.686 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:05:11.687 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:05:11.689 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:05:11.689 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:12.221 INFO:teuthology.orchestra.run.smithi112.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T18:05:12.231 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/456 2023-09-12T18:05:12.231 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/456 2023-09-12T18:05:12.232 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:05:12.237 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:12.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:05:12.284 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-09-12T18:05:12.744 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:05:12.757 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:05:12.758 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:05:12.761 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:05:12.761 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:13.919 INFO:teuthology.orchestra.run.smithi112.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T18:05:13.944 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/457 2023-09-12T18:05:13.944 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/457 2023-09-12T18:05:13.945 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:05:13.951 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:14.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:05:14.002 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-09-12T18:05:14.480 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:05:14.492 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:05:14.493 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:05:14.496 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:05:14.496 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:15.350 INFO:teuthology.orchestra.run.smithi112.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T18:05:15.433 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/458 2023-09-12T18:05:15.434 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/458 2023-09-12T18:05:15.434 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:05:15.440 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:15.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:05:15.622 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-09-12T18:05:16.094 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:05:16.106 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:05:16.107 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:05:16.109 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:05:16.110 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:17.036 INFO:teuthology.orchestra.run.smithi112.stdout:generic/459 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T18:05:17.048 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/459 2023-09-12T18:05:17.048 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/459 2023-09-12T18:05:17.048 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:05:17.053 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:17.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:05:17.096 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-09-12T18:05:17.554 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:05:17.567 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:05:17.568 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:05:17.570 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:05:17.571 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:20.788 INFO:teuthology.orchestra.run.smithi112.stdout:generic/460 3s 2023-09-12T18:05:20.802 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/460 2023-09-12T18:05:20.803 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:05:20.809 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:20.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:05:20.833 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-09-12T18:05:21.294 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:05:21.306 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:05:21.307 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:05:21.309 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:05:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:22.290 INFO:teuthology.orchestra.run.smithi112.stdout:generic/461 [not run] ceph does not support shutdown 2023-09-12T18:05:22.302 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/461 2023-09-12T18:05:22.302 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/461 2023-09-12T18:05:22.302 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:05:22.575 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:22.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:05:22.616 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-09-12T18:05:23.075 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:05:23.087 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:05:23.089 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:05:23.091 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:05:23.092 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:23.758 INFO:teuthology.orchestra.run.smithi112.stdout:generic/462 [not run] mount 172.21.15.112:6789:/scratch with dax failed 2023-09-12T18:05:23.768 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/462 2023-09-12T18:05:23.769 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/462 2023-09-12T18:05:23.769 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:05:23.774 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:23.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:05:23.814 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-09-12T18:05:24.272 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:05:24.285 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:05:24.286 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:05:24.288 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:05:24.289 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:24.867 INFO:teuthology.orchestra.run.smithi112.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T18:05:24.877 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/463 2023-09-12T18:05:24.877 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/463 2023-09-12T18:05:24.878 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:05:24.883 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:05:25.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:05:25.011 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-09-12T18:05:25.754 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:05:25.767 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:05:25.768 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:05:25.771 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:05:25.771 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:06:29.090 INFO:teuthology.orchestra.run.smithi112.stdout:generic/464 64s 2023-09-12T18:06:29.102 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/464 2023-09-12T18:06:29.103 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:06:29.108 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:06:29.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:06:29.130 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-09-12T18:06:29.585 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:06:29.597 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:06:29.599 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:06:29.601 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:06:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:06:34.954 INFO:teuthology.orchestra.run.smithi112.stdout:generic/465 4s 2023-09-12T18:06:34.981 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/465 2023-09-12T18:06:34.981 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:06:35.001 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:06:35.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:06:35.030 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-09-12T18:06:35.685 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:06:35.697 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:06:35.698 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:06:35.701 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:06:35.701 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:06:36.222 INFO:teuthology.orchestra.run.smithi112.stdout:generic/466 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T18:06:36.232 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/466 2023-09-12T18:06:36.232 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/466 2023-09-12T18:06:36.233 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:06:36.238 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:06:36.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:06:36.278 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-09-12T18:06:36.736 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:06:36.749 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:06:36.750 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:06:36.753 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:06:36.753 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:07:08.841 INFO:teuthology.orchestra.run.smithi112.stdout:generic/467 32s 2023-09-12T18:07:09.126 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/467 2023-09-12T18:07:09.126 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:07:09.179 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:07:09.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:07:09.601 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-09-12T18:07:13.628 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:07:13.640 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:07:13.641 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:07:13.644 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:07:13.644 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:07:14.658 INFO:teuthology.orchestra.run.smithi112.stdout:generic/468 [not run] ceph does not support shutdown 2023-09-12T18:07:14.685 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/468 2023-09-12T18:07:14.685 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/468 2023-09-12T18:07:14.685 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:07:14.689 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:07:14.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:07:14.727 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-09-12T18:07:15.182 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:07:15.195 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:07:15.196 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:07:15.198 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:07:15.198 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:07:15.767 INFO:teuthology.orchestra.run.smithi112.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-12T18:07:15.777 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/469 2023-09-12T18:07:15.777 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/469 2023-09-12T18:07:15.777 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:07:15.783 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:07:15.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:07:15.826 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-09-12T18:07:16.290 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:07:16.302 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:07:16.303 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:07:16.306 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:07:16.306 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:07:17.084 INFO:teuthology.orchestra.run.smithi112.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-09-12T18:07:17.094 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/470 2023-09-12T18:07:17.094 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/470 2023-09-12T18:07:17.095 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:07:17.100 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:07:17.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:07:17.146 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-09-12T18:07:17.604 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:07:17.617 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:07:17.618 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:07:17.621 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:07:17.621 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:07:18.564 INFO:teuthology.orchestra.run.smithi112.stdout:generic/472 [not run] swapfiles are not supported 2023-09-12T18:07:18.574 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/472 2023-09-12T18:07:18.574 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/472 2023-09-12T18:07:18.575 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:07:18.581 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:07:18.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:07:18.620 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-09-12T18:07:19.110 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:07:19.122 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:07:19.123 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:07:19.125 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:07:19.126 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:07:19.776 INFO:teuthology.orchestra.run.smithi112.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-12T18:07:19.785 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/473 2023-09-12T18:07:19.786 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/473 2023-09-12T18:07:19.786 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:07:19.791 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:07:19.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:07:19.837 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-09-12T18:07:20.290 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:07:20.303 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:07:20.304 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:07:20.306 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:07:20.306 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:07:20.966 INFO:teuthology.orchestra.run.smithi112.stdout:generic/474 [not run] ceph does not support shutdown 2023-09-12T18:07:21.004 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/474 2023-09-12T18:07:21.004 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/474 2023-09-12T18:07:21.004 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:07:21.010 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:07:21.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:07:21.057 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-09-12T18:07:21.516 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:07:21.529 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:07:21.530 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:07:21.532 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:07:21.532 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:07:22.125 INFO:teuthology.orchestra.run.smithi112.stdout:generic/475 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T18:07:22.135 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/475 2023-09-12T18:07:22.136 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/475 2023-09-12T18:07:22.136 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T18:07:22.141 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:07:22.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T18:07:22.184 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-09-12T18:07:22.640 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T18:07:22.653 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T18:07:22.654 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T18:07:22.656 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T18:07:22.657 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T18:08:11.787 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T18:08:11.794 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T18:08:11.942 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T18:08:11.941+0000 7fd0eedf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130466) UID: 0 2023-09-12T18:08:11.942 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T18:08:11.942+0000 7f2623ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130466) UID: 0 2023-09-12T18:08:11.943 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T18:08:11.943+0000 7f05c55f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130466) UID: 0 2023-09-12T18:08:11.944 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T18:08:11.944+0000 7f858dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130466) UID: 0 2023-09-12T18:08:12.064 INFO:tasks.ceph.mds.c.smithi112.stderr:2023-09-12T18:08:12.064+0000 7f35a2bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 544576) UID: 0 2023-09-12T18:08:12.065 INFO:tasks.ceph.mds.a.smithi112.stderr:2023-09-12T18:08:12.063+0000 7fc85dff9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 544576) UID: 0 2023-09-12T18:56:55.362 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T18:56:55.361+0000 7fed0e9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 545548) UID: 0 2023-09-12T18:56:55.394 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T18:56:55.361+0000 7f195aff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 545548) UID: 0 2023-09-12T18:56:55.394 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T18:56:55.360+0000 7fb9131f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 545548) UID: 0 2023-09-12T18:56:55.395 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T18:56:55.361+0000 7f49c5bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 545548) UID: 0 2023-09-12T19:16:24.322 INFO:teuthology.orchestra.run.smithi112.stdout:generic/476 4138s 2023-09-12T19:16:24.447 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/476 2023-09-12T19:16:24.448 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:16:24.467 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:16:24.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:16:24.544 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-09-12T19:16:33.924 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:16:33.942 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:16:33.944 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:16:33.947 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:16:33.948 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:24:09.945 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T19:24:09.979 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T19:24:10.196 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T19:24:10.194+0000 7fd0eedf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131726) UID: 0 2023-09-12T19:24:10.197 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T19:24:10.194+0000 7f05c55f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131726) UID: 0 2023-09-12T19:24:10.197 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T19:24:10.194+0000 7f2623ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131726) UID: 0 2023-09-12T19:24:10.198 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T19:24:10.195+0000 7f858dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131726) UID: 0 2023-09-12T19:24:13.095 INFO:tasks.ceph.mds.a.smithi112.stderr:2023-09-12T19:24:13.094+0000 7fc85dff9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 546173) UID: 0 2023-09-12T19:24:13.096 INFO:tasks.ceph.mds.c.smithi112.stderr:2023-09-12T19:24:13.094+0000 7f35a2bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 546173) UID: 0 2023-09-12T19:25:36.110 INFO:teuthology.orchestra.run.smithi112.stdout:generic/477 67s 2023-09-12T19:25:36.364 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/477 2023-09-12T19:25:36.364 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:25:36.395 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:25:36.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:25:36.708 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-09-12T19:25:40.169 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:25:40.185 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:25:40.187 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:25:40.191 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:25:40.191 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:25:52.797 INFO:teuthology.orchestra.run.smithi112.stdout:generic/478 12s 2023-09-12T19:25:52.816 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/478 2023-09-12T19:25:52.816 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:25:52.825 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:25:52.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:25:52.913 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-09-12T19:25:53.661 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:25:53.688 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:25:53.689 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:25:53.693 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:25:53.694 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:25:55.218 INFO:teuthology.orchestra.run.smithi112.stdout:generic/479 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T19:25:55.236 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/479 2023-09-12T19:25:55.236 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/479 2023-09-12T19:25:55.236 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:25:55.245 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:25:55.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:25:55.332 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-09-12T19:25:56.106 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:25:56.126 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:25:56.128 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:25:56.131 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:25:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:25:57.059 INFO:teuthology.orchestra.run.smithi112.stdout:generic/480 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T19:25:57.074 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/480 2023-09-12T19:25:57.075 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/480 2023-09-12T19:25:57.075 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:25:57.081 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:25:57.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:25:57.145 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-09-12T19:25:57.891 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:25:57.913 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:25:57.916 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:25:57.920 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:25:57.920 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:25:58.734 INFO:teuthology.orchestra.run.smithi112.stdout:generic/481 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T19:25:58.748 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/481 2023-09-12T19:25:58.749 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/481 2023-09-12T19:25:58.749 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:25:58.759 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:25:58.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:25:58.822 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-09-12T19:25:59.451 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:25:59.471 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:25:59.473 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:25:59.477 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:25:59.477 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:01.833 INFO:teuthology.orchestra.run.smithi112.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2023-09-12T19:26:01.845 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/482 2023-09-12T19:26:01.845 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/482 2023-09-12T19:26:01.846 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:01.855 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:01.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:01.930 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-09-12T19:26:02.779 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:02.797 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:02.799 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:02.802 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:02.803 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:04.247 INFO:teuthology.orchestra.run.smithi112.stdout:generic/483 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T19:26:04.258 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/483 2023-09-12T19:26:04.259 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/483 2023-09-12T19:26:04.259 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:04.266 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:04.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:04.314 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-09-12T19:26:05.002 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:05.025 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:05.027 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:05.029 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:05.030 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:05.992 INFO:teuthology.orchestra.run.smithi112.stdout:generic/484 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T19:26:06.010 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/484 2023-09-12T19:26:06.010 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/484 2023-09-12T19:26:06.011 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:06.018 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:06.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:06.078 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-09-12T19:26:06.816 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:06.847 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:06.849 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:06.854 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:06.854 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:07.704 INFO:teuthology.orchestra.run.smithi112.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-12T19:26:07.725 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/485 2023-09-12T19:26:07.726 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/485 2023-09-12T19:26:07.726 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:07.734 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:07.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:07.816 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-09-12T19:26:08.564 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:08.585 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:08.585 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:08.589 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:08.590 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:09.972 INFO:teuthology.orchestra.run.smithi112.stdout:generic/486 1s 2023-09-12T19:26:09.999 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/486 2023-09-12T19:26:09.999 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:10.006 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:10.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:10.045 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-09-12T19:26:10.792 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:10.809 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:10.811 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:10.816 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:10.817 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:11.690 INFO:teuthology.orchestra.run.smithi112.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-09-12T19:26:11.704 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/487 2023-09-12T19:26:11.704 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/487 2023-09-12T19:26:11.704 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:11.716 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:11.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:11.773 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-09-12T19:26:12.500 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:12.523 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:12.525 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:12.530 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:12.530 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:13.350 INFO:teuthology.orchestra.run.smithi112.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-12T19:26:13.366 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/488 2023-09-12T19:26:13.367 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/488 2023-09-12T19:26:13.367 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:13.374 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:13.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:13.449 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-09-12T19:26:14.240 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:14.260 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:14.261 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:14.264 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:14.264 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:15.091 INFO:teuthology.orchestra.run.smithi112.stdout:generic/489 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T19:26:15.105 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/489 2023-09-12T19:26:15.105 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/489 2023-09-12T19:26:15.106 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:15.116 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:15.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:15.175 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-09-12T19:26:15.948 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:15.966 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:15.967 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:15.969 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:15.970 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:18.721 INFO:teuthology.orchestra.run.smithi112.stdout:generic/490 2s 2023-09-12T19:26:18.743 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/490 2023-09-12T19:26:18.744 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:18.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:18.988 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-09-12T19:26:19.889 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:19.919 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:19.920 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:19.923 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:19.923 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:20.823 INFO:teuthology.orchestra.run.smithi112.stdout:generic/491 [not run] ceph does not support freezing 2023-09-12T19:26:20.840 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/491 2023-09-12T19:26:20.840 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/491 2023-09-12T19:26:20.841 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:20.854 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:20.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:20.908 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-09-12T19:26:21.638 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:21.655 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:21.657 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:21.661 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:21.661 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:22.475 INFO:teuthology.orchestra.run.smithi112.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-09-12T19:26:22.493 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/492 2023-09-12T19:26:22.494 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/492 2023-09-12T19:26:22.494 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:22.513 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:22.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:22.576 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-09-12T19:26:23.314 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:23.341 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:23.342 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:23.345 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:23.346 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:24.714 INFO:teuthology.orchestra.run.smithi112.stdout:generic/493 [not run] swapfiles are not supported 2023-09-12T19:26:24.738 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/493 2023-09-12T19:26:24.738 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/493 2023-09-12T19:26:24.739 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:24.755 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:24.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:24.828 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-09-12T19:26:25.552 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:25.573 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:25.575 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:25.578 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:25.578 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:26.774 INFO:teuthology.orchestra.run.smithi112.stdout:generic/494 [not run] swapfiles are not supported 2023-09-12T19:26:26.789 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/494 2023-09-12T19:26:26.790 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/494 2023-09-12T19:26:26.790 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:26.801 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:26.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:26.880 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-09-12T19:26:27.607 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:27.631 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:27.633 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:27.637 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:27.638 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:28.866 INFO:teuthology.orchestra.run.smithi112.stdout:generic/495 [not run] swapfiles are not supported 2023-09-12T19:26:28.877 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/495 2023-09-12T19:26:28.878 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/495 2023-09-12T19:26:28.878 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:28.885 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:28.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:28.954 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-09-12T19:26:29.681 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:29.702 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:29.703 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:29.707 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:29.708 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:30.947 INFO:teuthology.orchestra.run.smithi112.stdout:generic/496 [not run] swapfiles are not supported 2023-09-12T19:26:30.969 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/496 2023-09-12T19:26:30.969 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/496 2023-09-12T19:26:30.969 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:30.981 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:31.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:31.045 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-09-12T19:26:31.728 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:31.745 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:31.747 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:31.750 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:31.750 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:32.970 INFO:teuthology.orchestra.run.smithi112.stdout:generic/497 [not run] swapfiles are not supported 2023-09-12T19:26:32.985 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/497 2023-09-12T19:26:32.986 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/497 2023-09-12T19:26:32.986 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:32.997 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:33.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:33.061 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-09-12T19:26:33.801 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:33.829 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:33.830 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:33.834 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:33.834 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:34.688 INFO:teuthology.orchestra.run.smithi112.stdout:generic/498 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T19:26:34.702 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/498 2023-09-12T19:26:34.702 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/498 2023-09-12T19:26:34.702 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:34.709 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:34.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:34.772 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-09-12T19:26:35.582 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:35.613 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:35.615 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:35.622 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:35.623 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:36.630 INFO:teuthology.orchestra.run.smithi112.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-12T19:26:36.645 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/499 2023-09-12T19:26:36.646 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/499 2023-09-12T19:26:36.646 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:36.654 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:36.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:36.726 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-09-12T19:26:37.486 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:37.504 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:37.505 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:37.508 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:37.509 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:38.937 INFO:teuthology.orchestra.run.smithi112.stdout:generic/500 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T19:26:38.956 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/500 2023-09-12T19:26:38.956 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/500 2023-09-12T19:26:38.957 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:38.968 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:39.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:39.025 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-09-12T19:26:39.729 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:39.753 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:39.756 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:39.760 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:39.760 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:41.916 INFO:teuthology.orchestra.run.smithi112.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T19:26:41.942 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/501 2023-09-12T19:26:41.942 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/501 2023-09-12T19:26:41.942 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:41.962 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:42.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:42.142 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-09-12T19:26:42.901 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:42.929 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:42.931 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:42.937 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:42.937 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:43.824 INFO:teuthology.orchestra.run.smithi112.stdout:generic/502 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T19:26:43.842 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/502 2023-09-12T19:26:43.842 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/502 2023-09-12T19:26:43.842 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:43.849 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:43.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:43.914 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-09-12T19:26:44.659 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:44.676 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:44.677 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:44.681 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:44.681 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:45.523 INFO:teuthology.orchestra.run.smithi112.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T19:26:45.537 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/503 2023-09-12T19:26:45.537 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/503 2023-09-12T19:26:45.537 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:45.543 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:45.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:45.645 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-09-12T19:26:46.376 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:46.392 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:46.393 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:46.396 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:46.396 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:47.537 INFO:teuthology.orchestra.run.smithi112.stdout:generic/504 1s 2023-09-12T19:26:47.555 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/504 2023-09-12T19:26:47.555 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:47.562 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:47.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:47.635 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-09-12T19:26:48.337 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:48.362 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:48.364 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:48.367 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:48.367 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:49.450 INFO:teuthology.orchestra.run.smithi112.stdout:generic/505 [not run] ceph does not support shutdown 2023-09-12T19:26:49.498 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/505 2023-09-12T19:26:49.499 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/505 2023-09-12T19:26:49.499 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:49.505 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:49.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:49.571 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-09-12T19:26:50.291 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:50.305 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:50.306 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:50.309 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:50.309 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:51.130 INFO:teuthology.orchestra.run.smithi112.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T19:26:51.142 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/506 2023-09-12T19:26:51.142 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/506 2023-09-12T19:26:51.143 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:51.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:51.222 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-09-12T19:26:51.934 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:51.960 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:51.962 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:51.965 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:51.965 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:52.832 INFO:teuthology.orchestra.run.smithi112.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-09-12T19:26:52.848 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/507 2023-09-12T19:26:52.848 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/507 2023-09-12T19:26:52.848 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:52.861 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:52.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:52.951 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-09-12T19:26:53.738 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:53.760 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:53.761 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:53.766 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:53.766 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:54.596 INFO:teuthology.orchestra.run.smithi112.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-09-12T19:26:54.614 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/508 2023-09-12T19:26:54.614 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/508 2023-09-12T19:26:54.615 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:54.624 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:54.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:54.680 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-09-12T19:26:55.418 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:55.436 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:55.437 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:55.439 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:55.440 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:56.333 INFO:teuthology.orchestra.run.smithi112.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-09-12T19:26:56.348 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/509 2023-09-12T19:26:56.349 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/509 2023-09-12T19:26:56.349 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:56.359 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:56.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:56.414 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-09-12T19:26:57.141 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:57.165 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:57.166 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:57.173 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:57.173 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:58.032 INFO:teuthology.orchestra.run.smithi112.stdout:generic/510 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T19:26:58.050 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/510 2023-09-12T19:26:58.051 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/510 2023-09-12T19:26:58.051 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:58.061 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:58.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:58.124 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-09-12T19:26:58.861 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:26:58.881 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:26:58.883 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:26:58.887 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:26:58.887 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:59.692 INFO:teuthology.orchestra.run.smithi112.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-12T19:26:59.708 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/511 2023-09-12T19:26:59.708 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/511 2023-09-12T19:26:59.709 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:26:59.715 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:26:59.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:26:59.800 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-09-12T19:27:00.545 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:27:00.569 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:27:00.573 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:27:00.576 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:27:00.576 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:27:01.459 INFO:teuthology.orchestra.run.smithi112.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T19:27:01.475 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/512 2023-09-12T19:27:01.476 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/512 2023-09-12T19:27:01.476 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:27:01.486 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:27:01.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:27:01.569 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-09-12T19:27:02.322 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:27:02.344 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:27:02.345 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:27:02.348 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:27:02.349 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:27:03.695 INFO:teuthology.orchestra.run.smithi112.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T19:27:03.750 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/513 2023-09-12T19:27:03.751 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/513 2023-09-12T19:27:03.751 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:27:03.765 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:27:04.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:27:04.019 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-09-12T19:27:04.776 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:27:04.799 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:27:04.800 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:27:04.804 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:27:04.804 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:27:06.097 INFO:teuthology.orchestra.run.smithi112.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T19:27:06.154 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/514 2023-09-12T19:27:06.155 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/514 2023-09-12T19:27:06.155 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:27:06.164 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:27:06.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:27:06.401 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-09-12T19:27:07.155 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:27:07.184 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:27:07.187 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:27:07.193 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:27:07.193 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:27:08.460 INFO:teuthology.orchestra.run.smithi112.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T19:27:08.501 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/515 2023-09-12T19:27:08.502 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/515 2023-09-12T19:27:08.502 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:27:08.510 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:27:08.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:27:08.790 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-09-12T19:27:09.467 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:27:09.489 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:27:09.490 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:27:09.500 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:27:09.500 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:27:10.395 INFO:teuthology.orchestra.run.smithi112.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-12T19:27:10.413 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/516 2023-09-12T19:27:10.413 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/516 2023-09-12T19:27:10.414 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:27:10.424 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:27:10.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:27:10.594 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-09-12T19:27:11.579 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:27:11.603 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:27:11.604 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:27:11.609 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:27:11.609 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:27:12.757 INFO:teuthology.orchestra.run.smithi112.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-09-12T19:27:12.892 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/517 2023-09-12T19:27:12.903 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/517 2023-09-12T19:27:12.903 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:27:12.932 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:27:13.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:27:13.245 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-09-12T19:27:14.021 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:27:14.036 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:27:14.037 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:27:14.041 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:27:14.041 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:27:15.304 INFO:teuthology.orchestra.run.smithi112.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T19:27:15.335 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/518 2023-09-12T19:27:15.336 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/518 2023-09-12T19:27:15.336 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:27:15.355 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:27:15.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:27:15.544 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-09-12T19:27:16.263 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:27:16.290 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:27:16.291 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:27:16.296 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:27:16.297 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:27:17.615 INFO:teuthology.orchestra.run.smithi112.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-09-12T19:27:17.635 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/519 2023-09-12T19:27:17.635 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/519 2023-09-12T19:27:17.635 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:27:17.642 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:27:17.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:27:17.801 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-09-12T19:27:18.779 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:27:18.804 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:27:18.806 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:27:18.809 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:27:18.809 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:27:19.625 INFO:teuthology.orchestra.run.smithi112.stdout:generic/520 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T19:27:19.638 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/520 2023-09-12T19:27:19.639 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/520 2023-09-12T19:27:19.639 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T19:27:19.647 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:27:19.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T19:27:19.710 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-09-12T19:27:20.442 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T19:27:20.466 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T19:27:20.470 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T19:27:20.475 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T19:27:20.475 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T19:45:08.550 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T19:45:08.547+0000 7f49c5bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 569065) UID: 0 2023-09-12T19:45:08.573 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T19:45:08.547+0000 7fb9131f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 569065) UID: 0 2023-09-12T19:45:08.574 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T19:45:08.548+0000 7f195aff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 569065) UID: 0 2023-09-12T19:45:08.574 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T19:45:08.549+0000 7fed0e9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 569065) UID: 0 2023-09-12T20:02:36.366 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:02:36.373 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:02:38.734 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T20:02:38.733+0000 7f05c55f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132132) UID: 0 2023-09-12T20:02:38.735 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T20:02:38.733+0000 7f2623ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132132) UID: 0 2023-09-12T20:02:38.735 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T20:02:38.734+0000 7f858dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132132) UID: 0 2023-09-12T20:02:38.736 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T20:02:38.733+0000 7fd0eedf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132132) UID: 0 2023-09-12T20:11:27.543 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:11:27.551 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:11:27.709 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T20:11:27.707+0000 7f49c5bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 569371) UID: 0 2023-09-12T20:11:27.710 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T20:11:27.706+0000 7fed0e9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 569371) UID: 0 2023-09-12T20:11:27.710 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T20:11:27.708+0000 7fb9131f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 569371) UID: 0 2023-09-12T20:11:27.712 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T20:11:27.710+0000 7f195aff9700 -1 Fail to open '/proc/569371/cmdline' error = (2) No such file or directory 2023-09-12T20:11:27.712 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T20:11:27.710+0000 7f195aff9700 -1 received signal: Hangup from (PID: 569371) UID: 0 2023-09-12T20:11:27.827 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T20:11:27.825+0000 7f05c55f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132246) UID: 0 2023-09-12T20:11:27.828 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T20:11:27.826+0000 7f2623ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132246) UID: 0 2023-09-12T20:11:27.828 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T20:11:27.825+0000 7fd0eedf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132246) UID: 0 2023-09-12T20:11:27.828 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T20:11:27.826+0000 7f858dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132246) UID: 0 2023-09-12T20:18:33.171 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:18:33.178 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:19:03.322 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:19:03.328 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:19:34.285 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:19:34.291 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:20:04.425 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:20:04.432 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:20:34.579 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:20:34.586 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:21:04.745 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:21:04.753 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:21:34.907 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:21:34.917 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:22:05.060 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:22:05.066 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:22:36.061 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:22:36.072 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:23:07.182 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:23:07.188 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:23:37.324 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:23:37.332 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:24:07.475 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:24:07.482 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:24:37.632 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:24:37.638 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:25:07.950 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:25:07.957 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:25:38.089 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:25:38.095 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:26:09.018 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:26:09.025 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:26:39.296 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:26:39.306 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:27:09.531 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:27:09.538 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:27:39.682 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:27:39.690 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:28:09.832 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:28:09.839 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:28:39.972 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:28:39.978 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:29:10.112 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:29:10.119 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:29:40.273 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:29:40.280 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:29:40.381 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T20:29:40.380+0000 7f49c5bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 570091) UID: 0 2023-09-12T20:29:40.381 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T20:29:40.380+0000 7f195aff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 570091) UID: 0 2023-09-12T20:29:40.382 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T20:29:40.380+0000 7fed0e9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 570091) UID: 0 2023-09-12T20:29:40.383 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T20:29:40.380+0000 7fb9131f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 570091) UID: 0 2023-09-12T20:33:23.212 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:33:23.220 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:33:23.346 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T20:33:23.345+0000 7f49c5bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 570156) UID: 0 2023-09-12T20:33:23.346 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T20:33:23.345+0000 7fed0e9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 570156) UID: 0 2023-09-12T20:33:23.347 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T20:33:23.345+0000 7f195aff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 570156) UID: 0 2023-09-12T20:33:23.347 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T20:33:23.345+0000 7fb9131f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 570156) UID: 0 2023-09-12T20:33:23.357 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T20:33:23.356+0000 7f05c55f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133032) UID: 0 2023-09-12T20:33:23.358 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T20:33:23.358+0000 7f858dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133032) UID: 0 2023-09-12T20:33:23.358 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T20:33:23.356+0000 7fd0eedf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133032) UID: 0 2023-09-12T20:33:23.360 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T20:33:23.359+0000 7f2623ff9700 -1 received signal: Hangup from (PID: 133032) UID: 0 2023-09-12T20:40:43.283 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:40:43.290 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:40:43.417 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T20:40:43.415+0000 7f05c55f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133130) UID: 0 2023-09-12T20:40:43.417 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T20:40:43.415+0000 7fd0eedf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133130) UID: 0 2023-09-12T20:40:43.418 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T20:40:43.415+0000 7f858dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133130) UID: 0 2023-09-12T20:40:43.418 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T20:40:43.415+0000 7f2623ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133130) UID: 0 2023-09-12T20:40:43.590 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T20:40:43.589+0000 7f49c5bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 570249) UID: 0 2023-09-12T20:40:43.590 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T20:40:43.589+0000 7f195aff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 570249) UID: 0 2023-09-12T20:40:43.591 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T20:40:43.589+0000 7fb9131f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 570249) UID: 0 2023-09-12T20:40:43.591 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T20:40:43.589+0000 7fed0e9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 570249) UID: 0 2023-09-12T20:45:05.332 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:45:05.338 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:45:37.803 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:45:37.810 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:46:08.011 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:46:08.019 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:46:38.151 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:46:38.158 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:47:08.308 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:47:08.314 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:47:39.392 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:47:39.398 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:48:11.255 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:48:11.263 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:48:41.412 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:48:41.419 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:49:11.554 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:49:11.561 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:49:42.255 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:49:42.262 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:50:15.324 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:50:15.331 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:50:45.489 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:50:45.497 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:51:15.638 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:51:15.646 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:51:15.797 INFO:tasks.ceph.mds.a.smithi112.stderr:2023-09-12T20:51:15.796+0000 7fc85dff9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 570668) UID: 0 2023-09-12T20:51:15.798 INFO:tasks.ceph.mds.c.smithi112.stderr:2023-09-12T20:51:15.796+0000 7f35a2bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 570668) UID: 0 2023-09-12T20:54:59.333 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:54:59.338 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:55:02.980 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T20:55:02.979+0000 7f49c5bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 570722) UID: 0 2023-09-12T20:55:02.980 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T20:55:02.979+0000 7f195aff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 570722) UID: 0 2023-09-12T20:55:02.981 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T20:55:02.979+0000 7fed0e9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 570722) UID: 0 2023-09-12T20:55:02.981 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T20:55:02.979+0000 7fb9131f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 570722) UID: 0 2023-09-12T20:58:44.554 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:58:44.559 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T20:58:44.691 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T20:58:44.690+0000 7fd0eedf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133662) UID: 0 2023-09-12T20:58:44.692 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T20:58:44.690+0000 7f05c55f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133662) UID: 0 2023-09-12T20:58:44.692 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T20:58:44.690+0000 7f2623ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133662) UID: 0 2023-09-12T20:58:44.693 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T20:58:44.690+0000 7f858dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133662) UID: 0 2023-09-12T21:03:02.746 INFO:teuthology.orchestra.run.smithi112.stdout:generic/521 5742s 2023-09-12T21:03:02.792 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/521 2023-09-12T21:03:02.793 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T21:03:02.804 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T21:03:02.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T21:03:03.004 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-09-12T21:03:04.035 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T21:03:04.049 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T21:03:04.050 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T21:03:04.054 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T21:03:04.054 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T21:06:06.839 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:06:06.846 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:06:06.998 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T21:06:06.996+0000 7fd0eedf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133774) UID: 0 2023-09-12T21:06:06.998 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T21:06:06.996+0000 7f05c55f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133774) UID: 0 2023-09-12T21:06:06.999 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T21:06:06.996+0000 7f858dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133774) UID: 0 2023-09-12T21:06:06.999 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T21:06:06.996+0000 7f2623ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133774) UID: 0 2023-09-12T21:10:32.137 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:10:32.144 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:11:02.291 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:11:02.298 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:11:32.439 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:11:32.445 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:11:32.564 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T21:11:32.562+0000 7f49c5bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 571506) UID: 0 2023-09-12T21:11:32.564 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T21:11:32.563+0000 7f195aff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 571506) UID: 0 2023-09-12T21:11:32.565 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T21:11:32.563+0000 7fed0e9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 571506) UID: 0 2023-09-12T21:11:32.565 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T21:11:32.563+0000 7fb9131f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 571506) UID: 0 2023-09-12T21:15:06.703 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:15:06.711 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:15:06.855 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T21:15:06.853+0000 7fd0eedf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133956) UID: 0 2023-09-12T21:15:06.855 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T21:15:06.853+0000 7f2623ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133956) UID: 0 2023-09-12T21:15:06.856 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T21:15:06.853+0000 7f05c55f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133956) UID: 0 2023-09-12T21:15:06.857 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T21:15:06.853+0000 7f858dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133956) UID: 0 2023-09-12T21:19:12.383 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:19:12.396 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:19:12.525 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T21:19:12.524+0000 7f49c5bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 571629) UID: 0 2023-09-12T21:19:12.526 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T21:19:12.524+0000 7f195aff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 571629) UID: 0 2023-09-12T21:19:12.526 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T21:19:12.524+0000 7fed0e9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 571629) UID: 0 2023-09-12T21:19:12.527 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T21:19:12.526+0000 7fb9131f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 571629) UID: 0 2023-09-12T21:23:13.340 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:23:13.346 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:23:43.494 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:23:43.509 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:24:14.058 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:24:14.066 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:24:44.538 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:24:44.546 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:25:15.676 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:25:15.683 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:25:15.798 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T21:25:15.797+0000 7f195aff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 571808) UID: 0 2023-09-12T21:25:15.799 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T21:25:15.797+0000 7f49c5bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 571808) UID: 0 2023-09-12T21:25:15.799 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T21:25:15.797+0000 7fed0e9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 571808) UID: 0 2023-09-12T21:25:15.800 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T21:25:15.797+0000 7fb9131f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 571808) UID: 0 2023-09-12T21:28:58.110 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:28:58.117 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:28:58.516 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T21:28:58.514+0000 7f05c55f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134247) UID: 0 2023-09-12T21:28:58.516 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T21:28:58.514+0000 7fd0eedf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134247) UID: 0 2023-09-12T21:28:58.517 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T21:28:58.514+0000 7f2623ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134247) UID: 0 2023-09-12T21:28:58.517 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T21:28:58.514+0000 7f858dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134247) UID: 0 2023-09-12T21:33:01.019 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:33:01.030 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:33:01.162 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T21:33:01.161+0000 7f49c5bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 571922) UID: 0 2023-09-12T21:33:01.162 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T21:33:01.161+0000 7f195aff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 571922) UID: 0 2023-09-12T21:33:01.163 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T21:33:01.161+0000 7fb9131f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 571922) UID: 0 2023-09-12T21:33:01.163 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T21:33:01.161+0000 7fed0e9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 571922) UID: 0 2023-09-12T21:37:04.991 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:37:04.998 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:37:05.091 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T21:37:05.090+0000 7fd0eedf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134370) UID: 0 2023-09-12T21:37:05.092 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T21:37:05.090+0000 7f05c55f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134370) UID: 0 2023-09-12T21:37:05.092 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T21:37:05.090+0000 7f2623ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134370) UID: 0 2023-09-12T21:37:05.093 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T21:37:05.090+0000 7f858dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134370) UID: 0 2023-09-12T21:41:09.844 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:41:09.853 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:41:39.998 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:41:40.004 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:42:10.151 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:42:10.158 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:42:40.301 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:42:40.306 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:43:10.453 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:43:10.460 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:43:10.595 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T21:43:10.593+0000 7fd0eedf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134557) UID: 0 2023-09-12T21:43:10.596 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T21:43:10.594+0000 7f05c55f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134557) UID: 0 2023-09-12T21:43:10.597 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T21:43:10.595+0000 7f2623ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134557) UID: 0 2023-09-12T21:43:10.597 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T21:43:10.595+0000 7f858dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134557) UID: 0 2023-09-12T21:46:57.493 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:46:57.501 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:46:57.656 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T21:46:57.655+0000 7f05c55f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134610) UID: 0 2023-09-12T21:46:57.657 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T21:46:57.655+0000 7fd0eedf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134610) UID: 0 2023-09-12T21:46:57.658 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T21:46:57.656+0000 7f858dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134610) UID: 0 2023-09-12T21:46:57.658 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T21:46:57.656+0000 7f2623ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134610) UID: 0 2023-09-12T21:50:51.945 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:50:51.951 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:51:22.091 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:51:22.098 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:51:52.245 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:51:52.252 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:52:23.947 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:52:23.953 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:52:24.549 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T21:52:24.547+0000 7f195aff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 572367) UID: 0 2023-09-12T21:52:24.550 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T21:52:24.547+0000 7fed0e9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 572367) UID: 0 2023-09-12T21:52:24.550 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T21:52:24.548+0000 7fb9131f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 572367) UID: 0 2023-09-12T21:52:24.551 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T21:52:24.547+0000 7f49c5bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 572367) UID: 0 2023-09-12T21:56:03.012 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:56:03.018 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:56:33.326 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:56:33.333 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:57:03.503 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:57:03.509 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:57:33.647 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:57:33.652 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T21:57:33.737 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T21:57:33.736+0000 7fd0eedf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134903) UID: 0 2023-09-12T21:57:33.738 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T21:57:33.736+0000 7f05c55f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134903) UID: 0 2023-09-12T21:57:33.739 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T21:57:33.736+0000 7f2623ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134903) UID: 0 2023-09-12T21:57:33.739 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T21:57:33.736+0000 7f858dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134903) UID: 0 2023-09-12T22:01:24.145 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:01:24.151 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:01:24.278 INFO:tasks.ceph.mds.a.smithi112.stderr:2023-09-12T22:01:24.278+0000 7fc85dff9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 572582) UID: 0 2023-09-12T22:01:24.279 INFO:tasks.ceph.mds.c.smithi112.stderr:2023-09-12T22:01:24.278+0000 7f35a2bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 572582) UID: 0 2023-09-12T22:04:34.880 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T22:04:34.879+0000 7f49c5bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 572612) UID: 0 2023-09-12T22:04:34.881 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T22:04:34.879+0000 7f195aff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 572612) UID: 0 2023-09-12T22:04:34.882 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T22:04:34.879+0000 7fed0e9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 572612) UID: 0 2023-09-12T22:04:34.882 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T22:04:34.879+0000 7fb9131f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 572612) UID: 0 2023-09-12T22:10:07.483 INFO:teuthology.orchestra.run.smithi112.stdout:generic/522 4023s 2023-09-12T22:10:07.552 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/522 2023-09-12T22:10:07.552 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:10:07.562 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:07.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:10:07.648 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-09-12T22:10:09.216 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:10:09.235 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:10:09.236 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:10:09.239 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:10:09.240 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:10.625 INFO:teuthology.orchestra.run.smithi112.stdout:generic/523 1s 2023-09-12T22:10:10.646 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/523 2023-09-12T22:10:10.646 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:10:10.658 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:10.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:10:10.693 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-09-12T22:10:11.436 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:10:11.456 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:10:11.459 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:10:11.463 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:10:11.463 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:20.066 INFO:teuthology.orchestra.run.smithi112.stdout:generic/524 9s 2023-09-12T22:10:20.097 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/524 2023-09-12T22:10:20.097 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:10:20.106 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:20.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:10:20.140 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-09-12T22:10:20.844 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:10:20.862 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:10:20.863 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:10:20.868 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:10:20.868 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:22.950 INFO:teuthology.orchestra.run.smithi112.stdout:generic/525 [not run] filesystem does not support huge file size 2023-09-12T22:10:23.003 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/525 2023-09-12T22:10:23.003 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/525 2023-09-12T22:10:23.003 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:10:23.010 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:23.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:10:23.065 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-09-12T22:10:23.899 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:10:23.923 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:10:23.926 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:10:23.929 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:10:23.929 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:25.230 INFO:teuthology.orchestra.run.smithi112.stdout:generic/526 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T22:10:25.246 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/526 2023-09-12T22:10:25.247 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/526 2023-09-12T22:10:25.247 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:10:25.261 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:25.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:10:25.340 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-09-12T22:10:26.093 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:10:26.111 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:10:26.116 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:10:26.121 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:10:26.121 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:27.264 INFO:teuthology.orchestra.run.smithi112.stdout:generic/527 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T22:10:27.279 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/527 2023-09-12T22:10:27.279 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/527 2023-09-12T22:10:27.280 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:10:27.292 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:27.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:10:27.361 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-09-12T22:10:28.119 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:10:28.151 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:10:28.153 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:10:28.156 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:10:28.157 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:29.599 INFO:teuthology.orchestra.run.smithi112.stdout:generic/528 1s 2023-09-12T22:10:29.619 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/528 2023-09-12T22:10:29.620 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:10:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:29.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:10:29.775 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-09-12T22:10:30.796 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:10:30.815 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:10:30.817 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:10:30.820 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:10:30.820 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:32.787 INFO:teuthology.orchestra.run.smithi112.stdout:generic/529 1s 2023-09-12T22:10:32.808 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/529 2023-09-12T22:10:32.808 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:10:32.820 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:32.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:10:32.854 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-09-12T22:10:34.238 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:10:34.254 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:10:34.259 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:10:34.261 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:10:34.262 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:35.466 INFO:teuthology.orchestra.run.smithi112.stdout:generic/530 [not run] ceph does not support shutdown 2023-09-12T22:10:35.528 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/530 2023-09-12T22:10:35.528 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/530 2023-09-12T22:10:35.529 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:10:35.541 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:35.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:10:35.619 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-09-12T22:10:36.496 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:10:36.514 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:10:36.515 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:10:36.517 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:10:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:37.376 INFO:teuthology.orchestra.run.smithi112.stdout:generic/531 [not run] O_TMPFILE is not supported 2023-09-12T22:10:37.391 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/531 2023-09-12T22:10:37.391 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/531 2023-09-12T22:10:37.391 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:10:37.400 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:37.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:10:37.462 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-09-12T22:10:38.234 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:10:38.257 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:10:38.261 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:10:38.262 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:10:38.263 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:39.373 INFO:teuthology.orchestra.run.smithi112.stdout:generic/532 1s 2023-09-12T22:10:39.398 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/532 2023-09-12T22:10:39.399 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:10:39.410 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:39.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:10:39.496 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-09-12T22:10:40.233 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:10:40.257 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:10:40.258 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:10:40.262 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:10:40.262 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:42.265 INFO:teuthology.orchestra.run.smithi112.stdout:generic/533 2s 2023-09-12T22:10:42.288 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/533 2023-09-12T22:10:42.289 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:10:42.300 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:42.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:10:42.364 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-09-12T22:10:43.136 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:10:43.157 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:10:43.161 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:10:43.166 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:10:43.166 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:44.159 INFO:teuthology.orchestra.run.smithi112.stdout:generic/534 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T22:10:44.175 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/534 2023-09-12T22:10:44.175 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/534 2023-09-12T22:10:44.176 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:10:44.188 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:44.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:10:44.249 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-09-12T22:10:45.026 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:10:45.048 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:10:45.050 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:10:45.054 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:10:45.054 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:46.888 INFO:teuthology.orchestra.run.smithi112.stdout:generic/535 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T22:10:46.907 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/535 2023-09-12T22:10:46.908 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/535 2023-09-12T22:10:46.908 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:10:46.917 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:47.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:10:47.007 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-09-12T22:10:48.213 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:10:48.236 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:10:48.237 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:10:48.241 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:10:48.242 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:49.355 INFO:teuthology.orchestra.run.smithi112.stdout:generic/536 [not run] ceph does not support shutdown 2023-09-12T22:10:49.395 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/536 2023-09-12T22:10:49.395 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/536 2023-09-12T22:10:49.396 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:10:49.409 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:49.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:10:49.479 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-09-12T22:10:50.230 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:10:50.249 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:10:50.250 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:10:50.259 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:10:50.259 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:51.412 INFO:teuthology.orchestra.run.smithi112.stdout:generic/537 [not run] FSTRIM not supported 2023-09-12T22:10:51.455 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/537 2023-09-12T22:10:51.455 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/537 2023-09-12T22:10:51.456 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:10:51.471 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:10:51.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:10:51.531 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-09-12T22:10:52.271 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:10:52.290 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:10:52.291 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:10:52.294 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:10:52.294 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:12:17.995 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:12:18.008 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:12:48.242 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:12:48.249 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:13:18.405 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:13:18.411 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:13:48.554 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:13:48.562 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:14:18.718 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:14:18.724 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:14:50.167 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:14:50.176 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:15:20.915 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:15:20.924 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:15:21.047 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T22:15:21.047+0000 7f2623ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135699) UID: 0 2023-09-12T22:15:21.048 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T22:15:21.047+0000 7f05c55f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135699) UID: 0 2023-09-12T22:15:21.048 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T22:15:21.047+0000 7fd0eedf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135699) UID: 0 2023-09-12T22:15:21.049 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T22:15:21.047+0000 7f858dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135699) UID: 0 2023-09-12T22:19:15.620 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:19:15.626 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:19:15.855 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T22:19:15.854+0000 7f2623ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135793) UID: 0 2023-09-12T22:19:15.855 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T22:19:15.854+0000 7f05c55f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135793) UID: 0 2023-09-12T22:19:15.856 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T22:19:15.853+0000 7fd0eedf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135793) UID: 0 2023-09-12T22:19:15.856 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T22:19:15.854+0000 7f858dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135793) UID: 0 2023-09-12T22:23:42.989 INFO:teuthology.orchestra.run.smithi112.stdout:generic/538 770s 2023-09-12T22:23:43.009 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/538 2023-09-12T22:23:43.010 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:23:43.020 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:23:43.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:23:43.285 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-09-12T22:23:44.140 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:23:44.160 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:23:44.162 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:23:44.166 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:23:44.166 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:23:47.156 INFO:teuthology.orchestra.run.smithi112.stdout:generic/539 3s 2023-09-12T22:23:47.171 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/539 2023-09-12T22:23:47.172 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:23:47.179 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:23:47.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:23:47.361 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-09-12T22:23:48.194 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:23:48.210 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:23:48.212 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:23:48.216 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:23:48.217 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:23:49.754 INFO:teuthology.orchestra.run.smithi112.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T22:23:49.804 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/540 2023-09-12T22:23:49.805 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/540 2023-09-12T22:23:49.805 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:23:49.927 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:23:50.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:23:50.068 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-09-12T22:23:50.729 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:23:50.749 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:23:50.750 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:23:50.753 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:23:50.753 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:23:52.157 INFO:teuthology.orchestra.run.smithi112.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T22:23:52.194 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/541 2023-09-12T22:23:52.194 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/541 2023-09-12T22:23:52.195 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:23:52.214 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:23:52.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:23:52.540 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-09-12T22:23:53.187 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:23:53.208 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:23:53.209 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:23:53.212 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:23:53.213 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:23:54.682 INFO:teuthology.orchestra.run.smithi112.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T22:23:54.728 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/542 2023-09-12T22:23:54.728 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/542 2023-09-12T22:23:54.728 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:23:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:23:54.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:23:54.972 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-09-12T22:23:55.657 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:23:55.675 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:23:55.676 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:23:55.679 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:23:55.679 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:23:56.879 INFO:teuthology.orchestra.run.smithi112.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T22:23:56.944 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/543 2023-09-12T22:23:56.944 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/543 2023-09-12T22:23:56.950 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:23:56.982 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:23:57.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:23:57.157 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-09-12T22:23:57.795 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:23:57.823 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:23:57.830 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:23:57.833 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:23:57.833 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:23:59.027 INFO:teuthology.orchestra.run.smithi112.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T22:23:59.068 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/544 2023-09-12T22:23:59.069 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/544 2023-09-12T22:23:59.069 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:23:59.082 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:23:59.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:23:59.378 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-09-12T22:24:00.010 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:24:00.025 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:24:00.027 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:24:00.031 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:24:00.031 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:24:00.871 INFO:teuthology.orchestra.run.smithi112.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-09-12T22:24:00.886 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/545 2023-09-12T22:24:00.887 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/545 2023-09-12T22:24:00.887 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:24:00.896 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:24:00.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:24:00.980 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-09-12T22:24:01.668 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:24:01.688 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:24:01.690 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:24:01.693 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:24:01.693 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:24:02.539 INFO:teuthology.orchestra.run.smithi112.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T22:24:02.552 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/546 2023-09-12T22:24:02.552 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/546 2023-09-12T22:24:02.553 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:24:02.560 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:24:02.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:24:02.634 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-09-12T22:24:03.260 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:24:03.277 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:24:03.279 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:24:03.283 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:24:03.283 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:24:04.042 INFO:teuthology.orchestra.run.smithi112.stdout:generic/547 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T22:24:04.054 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/547 2023-09-12T22:24:04.055 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/547 2023-09-12T22:24:04.055 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:24:04.064 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:24:04.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:24:04.133 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-09-12T22:24:04.867 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:24:04.887 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:24:04.888 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:24:04.891 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:24:04.891 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:24:06.747 INFO:teuthology.orchestra.run.smithi112.stdout:generic/548 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-12T22:24:06.762 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/548 2023-09-12T22:24:06.762 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/548 2023-09-12T22:24:06.762 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:24:06.769 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:24:06.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:24:06.883 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-09-12T22:24:07.535 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:24:07.555 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:24:07.556 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:24:07.559 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:24:07.559 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:24:09.485 INFO:teuthology.orchestra.run.smithi112.stdout:generic/549 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-12T22:24:09.500 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/549 2023-09-12T22:24:09.500 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/549 2023-09-12T22:24:09.500 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:24:09.507 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:24:09.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:24:09.588 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-09-12T22:24:10.253 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:24:10.279 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:24:10.281 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:24:10.284 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:24:10.285 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:24:11.830 INFO:teuthology.orchestra.run.smithi112.stdout:generic/550 [not run] encryption policy '-c 9 -n 9 -f 0' is unusable; probably missing kernel crypto API support 2023-09-12T22:24:11.891 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/550 2023-09-12T22:24:11.892 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/550 2023-09-12T22:24:11.892 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:24:11.898 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:24:11.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:24:11.960 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-09-12T22:24:12.649 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:24:12.670 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:24:12.671 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:24:12.674 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:24:12.674 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:26:43.556 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:26:43.567 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:26:43.853 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T22:26:43.853+0000 7fb9131f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595992) UID: 0 2023-09-12T22:26:43.856 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T22:26:43.852+0000 7f195aff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595992) UID: 0 2023-09-12T22:26:43.858 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T22:26:43.853+0000 7f49c5bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595992) UID: 0 2023-09-12T22:26:43.858 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T22:26:43.853+0000 7fed0e9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595992) UID: 0 2023-09-12T22:31:21.767 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:31:21.772 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:31:21.957 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T22:31:21.956+0000 7fb9131f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 596282) UID: 0 2023-09-12T22:31:21.961 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T22:31:21.958+0000 7f49c5bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 596282) UID: 0 2023-09-12T22:31:21.961 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T22:31:21.960+0000 7fed0e9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 596282) UID: 0 2023-09-12T22:31:21.962 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T22:31:21.960+0000 7f195aff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 596282) UID: 0 2023-09-12T22:34:56.565 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:34:56.571 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:34:56.663 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T22:34:56.661+0000 7fd0eedf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136813) UID: 0 2023-09-12T22:34:56.664 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T22:34:56.661+0000 7f05c55f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136813) UID: 0 2023-09-12T22:34:56.664 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T22:34:56.661+0000 7f2623ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136813) UID: 0 2023-09-12T22:34:56.665 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T22:34:56.661+0000 7f858dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136813) UID: 0 2023-09-12T22:34:56.764 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T22:34:56.763+0000 7f49c5bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 596587) UID: 0 2023-09-12T22:34:56.765 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T22:34:56.763+0000 7f195aff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 596587) UID: 0 2023-09-12T22:34:56.765 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T22:34:56.763+0000 7fed0e9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 596587) UID: 0 2023-09-12T22:34:56.765 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T22:34:56.763+0000 7fb9131f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 596587) UID: 0 2023-09-12T22:38:12.264 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:38:12.270 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:38:42.384 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:38:42.389 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:39:12.491 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:39:12.496 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:39:43.364 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:39:43.369 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:40:13.490 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:40:13.496 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:40:43.619 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:40:43.626 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:41:13.743 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:41:13.748 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:41:43.854 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:41:43.860 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:42:14.017 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:42:14.026 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:42:44.150 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:42:44.156 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:43:14.786 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:43:14.800 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:43:44.959 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:43:44.964 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:44:15.071 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:44:15.076 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:44:45.248 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:44:45.263 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:45:15.454 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:45:15.459 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:45:45.562 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:45:45.567 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:46:15.724 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:46:15.729 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:46:45.929 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:46:45.935 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:46:46.030 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T22:46:46.029+0000 7f195aff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 598292) UID: 0 2023-09-12T22:46:46.031 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T22:46:46.029+0000 7fed0e9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 598292) UID: 0 2023-09-12T22:46:46.031 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T22:46:46.029+0000 7f49c5bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 598292) UID: 0 2023-09-12T22:46:46.031 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T22:46:46.029+0000 7fb9131f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 598292) UID: 0 2023-09-12T22:49:48.295 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:49:48.303 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:50:17.142 INFO:teuthology.orchestra.run.smithi112.stdout:generic/551 1565s 2023-09-12T22:50:17.170 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/551 2023-09-12T22:50:17.170 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:17.176 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:17.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:17.198 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-09-12T22:50:17.868 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:17.881 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:17.882 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:17.884 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:17.885 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:18.487 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:50:18.493 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:50:21.170 INFO:teuthology.orchestra.run.smithi112.stdout:generic/552 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T22:50:21.181 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/552 2023-09-12T22:50:21.181 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/552 2023-09-12T22:50:21.182 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:21.188 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:21.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:21.243 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-09-12T22:50:21.709 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:21.723 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:21.723 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:21.726 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:21.726 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:22.334 INFO:teuthology.orchestra.run.smithi112.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2023-09-12T22:50:22.344 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/553 2023-09-12T22:50:22.345 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/553 2023-09-12T22:50:22.345 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:22.350 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:22.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:22.475 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-09-12T22:50:23.175 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:23.187 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:23.188 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:23.191 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:23.191 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:24.095 INFO:teuthology.orchestra.run.smithi112.stdout:generic/554 [not run] swapfiles are not supported 2023-09-12T22:50:24.105 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/554 2023-09-12T22:50:24.105 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/554 2023-09-12T22:50:24.106 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:24.111 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:24.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:24.257 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-09-12T22:50:24.948 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:24.961 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:24.962 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:24.964 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:24.965 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:25.571 INFO:teuthology.orchestra.run.smithi112.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2023-09-12T22:50:25.581 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/555 2023-09-12T22:50:25.582 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/555 2023-09-12T22:50:25.582 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:25.587 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:25.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:25.739 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-09-12T22:50:26.425 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:26.438 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:26.439 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:26.441 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:26.441 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:26.946 INFO:teuthology.orchestra.run.smithi112.stdout:generic/556 [not run] ceph does not support casefold feature 2023-09-12T22:50:26.956 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/556 2023-09-12T22:50:26.957 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/556 2023-09-12T22:50:26.957 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:26.963 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:27.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:27.005 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-09-12T22:50:27.461 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:27.471 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:27.473 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:27.475 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:27.475 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:28.012 INFO:teuthology.orchestra.run.smithi112.stdout:generic/557 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T22:50:28.022 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/557 2023-09-12T22:50:28.023 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/557 2023-09-12T22:50:28.023 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:28.028 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:28.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:28.069 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-09-12T22:50:28.528 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:28.541 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:28.542 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:28.545 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:28.545 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:29.059 INFO:teuthology.orchestra.run.smithi112.stdout:generic/558 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-12T22:50:29.069 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/558 2023-09-12T22:50:29.070 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/558 2023-09-12T22:50:29.070 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:29.075 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:29.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:29.118 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-09-12T22:50:29.575 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:29.588 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:29.589 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:29.591 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:30.104 INFO:teuthology.orchestra.run.smithi112.stdout:generic/559 [not run] duperemove utility required, skipped this test 2023-09-12T22:50:30.114 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/559 2023-09-12T22:50:30.114 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/559 2023-09-12T22:50:30.115 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:30.120 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:30.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:30.170 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-09-12T22:50:30.625 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:30.638 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:30.639 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:30.641 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:31.154 INFO:teuthology.orchestra.run.smithi112.stdout:generic/560 [not run] duperemove utility required, skipped this test 2023-09-12T22:50:31.164 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/560 2023-09-12T22:50:31.165 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/560 2023-09-12T22:50:31.165 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:31.170 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:31.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:31.213 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-09-12T22:50:31.677 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:31.689 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:31.690 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:31.693 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:31.693 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:32.211 INFO:teuthology.orchestra.run.smithi112.stdout:generic/561 [not run] duperemove utility required, skipped this test 2023-09-12T22:50:32.221 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/561 2023-09-12T22:50:32.222 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/561 2023-09-12T22:50:32.222 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:32.227 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:32.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:32.268 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-09-12T22:50:32.733 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:32.745 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:32.746 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:32.749 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:32.749 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:33.622 INFO:teuthology.orchestra.run.smithi112.stdout:generic/562 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T22:50:33.647 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/562 2023-09-12T22:50:33.647 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/562 2023-09-12T22:50:33.648 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:33.662 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:33.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:33.894 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-09-12T22:50:34.352 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:34.365 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:34.366 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:34.368 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:34.369 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:34.921 INFO:teuthology.orchestra.run.smithi112.stdout:generic/563 [not run] cgroup2 not mounted on /sys/fs/cgroup 2023-09-12T22:50:34.931 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/563 2023-09-12T22:50:34.931 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/563 2023-09-12T22:50:34.931 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:34.937 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:34.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:34.978 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-09-12T22:50:35.439 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:35.452 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:35.453 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:35.456 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:35.457 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:36.077 INFO:teuthology.orchestra.run.smithi112.stdout:generic/564 [not run] xfs_io copy_range doesn't support -f 2023-09-12T22:50:36.086 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/564 2023-09-12T22:50:36.087 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/564 2023-09-12T22:50:36.087 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:36.092 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:36.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:36.209 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-09-12T22:50:36.904 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:36.917 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:36.918 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:36.920 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:36.921 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:37.778 INFO:teuthology.orchestra.run.smithi112.stdout:generic/565 0s 2023-09-12T22:50:37.791 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/565 2023-09-12T22:50:37.791 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:37.798 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:37.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:37.946 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-09-12T22:50:38.634 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:38.646 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:38.648 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:38.650 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:38.650 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:39.168 INFO:teuthology.orchestra.run.smithi112.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T22:50:39.178 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/566 2023-09-12T22:50:39.178 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/566 2023-09-12T22:50:39.178 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:39.184 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:39.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:39.224 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-09-12T22:50:39.684 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:39.697 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:39.698 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:39.700 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:39.701 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:40.762 INFO:teuthology.orchestra.run.smithi112.stdout:generic/567 1s 2023-09-12T22:50:40.775 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/567 2023-09-12T22:50:40.775 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:40.781 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:40.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:40.802 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-09-12T22:50:41.257 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:41.269 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:41.270 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:41.272 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:41.273 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:41.817 INFO:teuthology.orchestra.run.smithi112.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T22:50:42.515 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/568 2023-09-12T22:50:42.515 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/568 2023-09-12T22:50:42.515 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:42.516 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:42.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:42.516 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-09-12T22:50:42.983 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:42.996 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:42.997 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:43.000 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:43.000 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:43.524 INFO:teuthology.orchestra.run.smithi112.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T22:50:43.534 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/569 2023-09-12T22:50:43.534 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/569 2023-09-12T22:50:43.534 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:43.540 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:43.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:43.587 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-09-12T22:50:44.044 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:44.057 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:44.058 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:44.060 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:44.060 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:44.574 INFO:teuthology.orchestra.run.smithi112.stdout:generic/570 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T22:50:44.584 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/570 2023-09-12T22:50:44.585 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/570 2023-09-12T22:50:44.585 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:44.591 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:44.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:44.640 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-09-12T22:50:45.095 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:45.108 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:45.109 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:45.111 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:45.112 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:45.646 INFO:teuthology.orchestra.run.smithi112.stdout:generic/571 [not run] Require fcntl setlease support 2023-09-12T22:50:45.656 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/571 2023-09-12T22:50:45.656 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/571 2023-09-12T22:50:45.657 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:45.662 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:45.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:45.714 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-09-12T22:50:46.168 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:46.181 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:46.182 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:46.184 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:46.184 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:46.701 INFO:teuthology.orchestra.run.smithi112.stdout:generic/572 [not run] fsverity utility required, skipped this test 2023-09-12T22:50:46.711 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/572 2023-09-12T22:50:46.711 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/572 2023-09-12T22:50:46.711 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:46.717 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:46.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:46.758 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-09-12T22:50:47.213 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:47.227 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:47.227 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:47.230 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:47.230 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:47.736 INFO:teuthology.orchestra.run.smithi112.stdout:generic/573 [not run] fsverity utility required, skipped this test 2023-09-12T22:50:47.746 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/573 2023-09-12T22:50:47.746 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/573 2023-09-12T22:50:47.747 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:47.752 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:47.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:47.791 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-09-12T22:50:48.256 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:48.268 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:48.269 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:48.272 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:48.272 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:48.774 INFO:teuthology.orchestra.run.smithi112.stdout:generic/574 [not run] fsverity utility required, skipped this test 2023-09-12T22:50:48.784 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/574 2023-09-12T22:50:48.784 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/574 2023-09-12T22:50:48.785 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:48.793 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:48.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:48.832 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-09-12T22:50:49.291 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:49.303 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:49.304 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:49.307 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:49.307 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:49.708 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:50:49.713 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:50:49.816 INFO:teuthology.orchestra.run.smithi112.stdout:generic/575 [not run] fsverity utility required, skipped this test 2023-09-12T22:50:49.826 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/575 2023-09-12T22:50:49.826 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/575 2023-09-12T22:50:49.826 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:49.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:49.873 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-09-12T22:50:50.363 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:50.376 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:50.377 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:50.379 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:50.380 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:50.965 INFO:teuthology.orchestra.run.smithi112.stdout:generic/576 [not run] fsverity utility required, skipped this test 2023-09-12T22:50:50.975 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/576 2023-09-12T22:50:50.975 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/576 2023-09-12T22:50:50.975 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:50.981 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:51.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:51.020 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-09-12T22:50:51.473 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:51.485 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:51.486 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:51.489 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:51.489 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:52.016 INFO:teuthology.orchestra.run.smithi112.stdout:generic/577 [not run] fsverity utility required, skipped this test 2023-09-12T22:50:52.026 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/577 2023-09-12T22:50:52.026 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/577 2023-09-12T22:50:52.026 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:52.032 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:52.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:52.081 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-09-12T22:50:52.539 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:52.552 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:52.553 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:52.555 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:52.556 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:53.156 INFO:teuthology.orchestra.run.smithi112.stdout:generic/578 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T22:50:53.166 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/578 2023-09-12T22:50:53.167 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/578 2023-09-12T22:50:53.167 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:53.173 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:53.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:53.352 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-09-12T22:50:54.003 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:54.015 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:54.016 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:54.019 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:54.019 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:54.602 INFO:teuthology.orchestra.run.smithi112.stdout:generic/579 [not run] fsverity utility required, skipped this test 2023-09-12T22:50:54.612 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/579 2023-09-12T22:50:54.613 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/579 2023-09-12T22:50:54.613 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:54.618 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:54.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:54.660 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-09-12T22:50:55.114 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:55.127 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:55.128 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:55.131 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:55.131 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:55.970 INFO:teuthology.orchestra.run.smithi112.stdout:generic/580 [not run] xfs_io get_encpolicy doesn't support -t 2023-09-12T22:50:56.010 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/580 2023-09-12T22:50:56.010 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/580 2023-09-12T22:50:56.010 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:56.015 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:56.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:56.060 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-09-12T22:50:56.515 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:56.528 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:56.529 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:56.532 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:56.532 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:57.892 INFO:teuthology.orchestra.run.smithi112.stdout:generic/581 [not run] xfs_io get_encpolicy doesn't support -t 2023-09-12T22:50:57.932 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/581 2023-09-12T22:50:57.932 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/581 2023-09-12T22:50:57.933 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:57.938 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:57.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:57.978 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-09-12T22:50:58.433 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:58.446 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:58.447 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:58.449 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:58.450 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:59.303 INFO:teuthology.orchestra.run.smithi112.stdout:generic/582 [not run] xfs_io get_encpolicy doesn't support -t 2023-09-12T22:50:59.338 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/582 2023-09-12T22:50:59.338 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/582 2023-09-12T22:50:59.339 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:50:59.344 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:50:59.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:50:59.390 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-09-12T22:50:59.846 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:50:59.858 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:50:59.859 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:50:59.862 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:50:59.862 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:00.712 INFO:teuthology.orchestra.run.smithi112.stdout:generic/583 [not run] xfs_io get_encpolicy doesn't support -t 2023-09-12T22:51:00.745 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/583 2023-09-12T22:51:00.746 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/583 2023-09-12T22:51:00.746 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:00.751 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:00.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:00.798 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-09-12T22:51:01.257 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:01.270 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:01.271 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:01.273 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:01.274 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:02.139 INFO:teuthology.orchestra.run.smithi112.stdout:generic/584 [not run] xfs_io get_encpolicy doesn't support -t 2023-09-12T22:51:02.179 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/584 2023-09-12T22:51:02.179 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/584 2023-09-12T22:51:02.179 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:02.185 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:02.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:02.226 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-09-12T22:51:02.685 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:02.698 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:02.699 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:02.701 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:02.702 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:03.283 INFO:teuthology.orchestra.run.smithi112.stdout:generic/585 [not run] kernel doesn't support renameat2 syscall 2023-09-12T22:51:03.293 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/585 2023-09-12T22:51:03.293 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/585 2023-09-12T22:51:03.293 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:03.299 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:03.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:03.428 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-09-12T22:51:04.120 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:04.133 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:04.134 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:04.137 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:04.137 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:04.750 INFO:teuthology.orchestra.run.smithi112.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T22:51:04.761 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/586 2023-09-12T22:51:04.761 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/586 2023-09-12T22:51:04.762 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:04.766 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:04.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:04.886 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-09-12T22:51:05.598 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:05.610 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:05.611 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:05.614 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:05.614 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:06.166 INFO:teuthology.orchestra.run.smithi112.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T22:51:06.176 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/587 2023-09-12T22:51:06.177 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/587 2023-09-12T22:51:06.177 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:06.183 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:06.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:06.234 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-09-12T22:51:06.691 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:06.704 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:06.705 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:06.707 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:06.708 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:07.690 INFO:teuthology.orchestra.run.smithi112.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T22:51:07.722 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/588 2023-09-12T22:51:07.723 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/588 2023-09-12T22:51:07.723 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:07.742 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:07.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:07.892 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-09-12T22:51:08.350 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:08.362 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:08.363 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:08.366 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:08.366 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:08.909 INFO:teuthology.orchestra.run.smithi112.stdout:generic/589 [not run] require 172.21.15.112:6789:/scratch to be local device 2023-09-12T22:51:08.919 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/589 2023-09-12T22:51:08.920 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/589 2023-09-12T22:51:08.920 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:08.926 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:08.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:08.965 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-09-12T22:51:09.425 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:09.438 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:09.439 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:09.441 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:09.442 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:09.965 INFO:teuthology.orchestra.run.smithi112.stdout:generic/590 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T22:51:09.976 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/590 2023-09-12T22:51:09.976 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/590 2023-09-12T22:51:09.976 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:09.982 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:10.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:10.040 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-09-12T22:51:10.493 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:10.506 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:10.507 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:10.510 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:10.510 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:11.185 INFO:teuthology.orchestra.run.smithi112.stdout:generic/591 1s 2023-09-12T22:51:11.198 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/591 2023-09-12T22:51:11.198 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:11.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:11.362 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-09-12T22:51:12.036 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:12.049 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:12.050 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:12.053 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:12.053 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:13.086 INFO:teuthology.orchestra.run.smithi112.stdout:generic/592 [not run] xfs_io get_encpolicy doesn't support -t 2023-09-12T22:51:13.119 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/592 2023-09-12T22:51:13.119 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/592 2023-09-12T22:51:13.119 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:13.125 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:13.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:13.164 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-09-12T22:51:13.619 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:13.632 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:13.633 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:13.636 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:13.636 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:14.487 INFO:teuthology.orchestra.run.smithi112.stdout:generic/593 [not run] xfs_io get_encpolicy doesn't support -t 2023-09-12T22:51:14.527 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/593 2023-09-12T22:51:14.527 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/593 2023-09-12T22:51:14.528 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:14.533 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:14.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:14.575 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-09-12T22:51:15.033 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:15.045 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:15.046 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:15.049 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:15.049 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:15.585 INFO:teuthology.orchestra.run.smithi112.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T22:51:15.595 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/594 2023-09-12T22:51:15.595 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/594 2023-09-12T22:51:15.596 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:15.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:15.656 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-09-12T22:51:16.111 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:16.124 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:16.125 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:16.127 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:16.128 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:16.980 INFO:teuthology.orchestra.run.smithi112.stdout:generic/595 [not run] xfs_io get_encpolicy doesn't support -t 2023-09-12T22:51:17.025 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/595 2023-09-12T22:51:17.026 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/595 2023-09-12T22:51:17.026 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:17.031 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:17.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:17.073 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-09-12T22:51:17.528 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:17.541 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:17.542 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:17.544 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:17.544 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:18.141 INFO:teuthology.orchestra.run.smithi112.stdout:generic/596 [not run] file system doesn't support chattr +S 2023-09-12T22:51:18.151 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/596 2023-09-12T22:51:18.152 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/596 2023-09-12T22:51:18.152 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:18.158 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:18.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:18.207 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-09-12T22:51:18.667 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:18.680 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:18.681 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:18.683 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:18.684 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:19.821 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:51:19.826 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:51:20.037 INFO:teuthology.orchestra.run.smithi112.stdout:generic/597 2s 2023-09-12T22:51:20.050 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/597 2023-09-12T22:51:20.050 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:20.056 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:20.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:20.154 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-09-12T22:51:20.871 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:20.884 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:20.885 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:20.888 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:22.267 INFO:teuthology.orchestra.run.smithi112.stdout:generic/598 1s 2023-09-12T22:51:22.280 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/598 2023-09-12T22:51:22.280 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:22.286 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:22.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:22.410 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-09-12T22:51:23.128 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:23.141 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:23.142 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:23.144 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:23.145 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:23.829 INFO:teuthology.orchestra.run.smithi112.stdout:generic/599 [not run] ceph does not support shutdown 2023-09-12T22:51:23.858 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/599 2023-09-12T22:51:23.858 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/599 2023-09-12T22:51:23.858 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:23.864 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:23.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:23.907 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-09-12T22:51:24.373 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:24.385 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:24.386 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:24.389 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:24.389 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:24.900 INFO:teuthology.orchestra.run.smithi112.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T22:51:24.910 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/600 2023-09-12T22:51:24.910 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/600 2023-09-12T22:51:24.911 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:24.916 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:24.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:24.960 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-09-12T22:51:25.422 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:25.435 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:25.436 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:25.438 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:25.950 INFO:teuthology.orchestra.run.smithi112.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T22:51:25.960 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/601 2023-09-12T22:51:25.961 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/601 2023-09-12T22:51:25.961 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:25.967 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:26.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:26.011 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-09-12T22:51:26.470 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:26.482 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:26.484 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:26.486 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:26.486 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:27.522 INFO:teuthology.orchestra.run.smithi112.stdout:generic/602 [not run] xfs_io get_encpolicy doesn't support -t 2023-09-12T22:51:27.556 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/602 2023-09-12T22:51:27.556 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/602 2023-09-12T22:51:27.556 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:27.562 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:27.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:27.616 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-09-12T22:51:28.078 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:28.091 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:28.092 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:28.094 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:28.094 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:28.624 INFO:teuthology.orchestra.run.smithi112.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-12T22:51:28.634 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/603 2023-09-12T22:51:28.634 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/603 2023-09-12T22:51:28.635 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:28.640 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:28.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:28.686 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-09-12T22:51:29.148 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:29.161 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:29.162 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:29.165 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:29.165 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:36.183 INFO:teuthology.orchestra.run.smithi112.stdout:generic/604 7s 2023-09-12T22:51:36.196 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/604 2023-09-12T22:51:36.196 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:36.202 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:36.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:36.223 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-09-12T22:51:36.675 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:36.688 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:36.689 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:36.692 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:36.692 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:38.352 INFO:teuthology.orchestra.run.smithi112.stdout:generic/605 [not run] mount 172.21.15.112:6789:/scratch with dax=always failed 2023-09-12T22:51:38.362 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/605 2023-09-12T22:51:38.363 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/605 2023-09-12T22:51:38.363 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:38.369 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:38.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:38.408 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-09-12T22:51:39.220 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:39.233 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:39.234 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:39.236 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:39.237 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:39.882 INFO:teuthology.orchestra.run.smithi112.stdout:generic/606 [not run] mount 172.21.15.112:6789:/scratch with dax=always failed 2023-09-12T22:51:39.892 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/606 2023-09-12T22:51:39.892 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/606 2023-09-12T22:51:39.893 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:39.898 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:39.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:39.936 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-09-12T22:51:40.394 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:40.407 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:40.408 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:40.410 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:40.411 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:40.950 INFO:teuthology.orchestra.run.smithi112.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2023-09-12T22:51:40.960 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/607 2023-09-12T22:51:40.960 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/607 2023-09-12T22:51:40.960 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:40.966 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:41.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:41.124 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-09-12T22:51:41.785 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:41.797 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:41.798 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:41.801 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:41.801 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:42.451 INFO:teuthology.orchestra.run.smithi112.stdout:generic/608 [not run] mount 172.21.15.112:6789:/scratch with dax=always failed 2023-09-12T22:51:42.461 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/608 2023-09-12T22:51:42.461 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/608 2023-09-12T22:51:42.462 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:42.467 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:42.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:42.511 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-09-12T22:51:42.965 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:42.978 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:42.979 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:42.981 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:42.982 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:43.726 INFO:teuthology.orchestra.run.smithi112.stdout:generic/609 0s 2023-09-12T22:51:43.739 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/609 2023-09-12T22:51:43.740 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:43.745 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:43.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:43.895 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-09-12T22:51:44.561 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:44.574 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:44.576 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:44.578 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:44.578 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:45.242 INFO:teuthology.orchestra.run.smithi112.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-12T22:51:45.252 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/610 2023-09-12T22:51:45.252 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/610 2023-09-12T22:51:45.253 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:45.258 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:45.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:45.311 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-09-12T22:51:45.765 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:45.778 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:45.779 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:45.782 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:45.782 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:46.705 INFO:teuthology.orchestra.run.smithi112.stdout:generic/611 1s 2023-09-12T22:51:46.718 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/611 2023-09-12T22:51:46.718 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:46.724 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:46.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:46.746 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-09-12T22:51:47.200 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:47.213 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:47.214 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:47.216 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:47.216 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:47.815 INFO:teuthology.orchestra.run.smithi112.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T22:51:47.825 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/612 2023-09-12T22:51:47.825 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/612 2023-09-12T22:51:47.825 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:47.831 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:47.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:47.974 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-09-12T22:51:48.650 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:48.662 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:48.663 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:48.666 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:48.667 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:50.026 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:51:50.031 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:51:50.057 INFO:teuthology.orchestra.run.smithi112.stdout:generic/613 [not run] xfs_io get_encpolicy doesn't support -t 2023-09-12T22:51:50.092 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/613 2023-09-12T22:51:50.092 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/613 2023-09-12T22:51:50.093 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:50.099 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:50.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:50.141 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-09-12T22:51:50.640 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:50.653 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:50.654 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:50.657 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:50.657 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:51.366 INFO:teuthology.orchestra.run.smithi112.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2023-09-12T22:51:51.399 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/614 2023-09-12T22:51:51.399 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/614 2023-09-12T22:51:51.399 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:51:51.405 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:51:51.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:51:51.449 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-09-12T22:51:51.906 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:51:51.919 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:51:51.920 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:51:51.922 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:51:51.923 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:20.240 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:52:20.246 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:52:42.525 INFO:teuthology.orchestra.run.smithi112.stdout:generic/615 50s 2023-09-12T22:52:42.538 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/615 2023-09-12T22:52:42.539 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:52:42.544 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:42.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:52:42.567 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-09-12T22:52:43.028 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:52:43.040 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:52:43.041 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:52:43.043 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:52:43.044 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:43.567 INFO:teuthology.orchestra.run.smithi112.stdout:generic/616 [not run] kernel does not support IO_URING 2023-09-12T22:52:43.577 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/616 2023-09-12T22:52:43.577 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/616 2023-09-12T22:52:43.577 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:52:43.583 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:43.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:52:43.625 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-09-12T22:52:44.084 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:52:44.096 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:52:44.098 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:52:44.100 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:52:44.100 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:44.680 INFO:teuthology.orchestra.run.smithi112.stdout:generic/617 [not run] kernel does not support IO_URING 2023-09-12T22:52:44.690 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/617 2023-09-12T22:52:44.690 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/617 2023-09-12T22:52:44.691 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:52:44.696 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:44.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:52:44.750 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-09-12T22:52:45.204 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:52:45.217 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:52:45.218 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:52:45.221 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:52:45.221 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:46.161 INFO:teuthology.orchestra.run.smithi112.stdout:generic/618 1s 2023-09-12T22:52:46.174 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/618 2023-09-12T22:52:46.175 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:52:46.180 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:46.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:52:46.202 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-09-12T22:52:46.665 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:52:46.678 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:52:46.679 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:52:46.681 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:52:46.682 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:47.229 INFO:teuthology.orchestra.run.smithi112.stdout:generic/619 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-12T22:52:47.239 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/619 2023-09-12T22:52:47.240 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/619 2023-09-12T22:52:47.240 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:52:47.245 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:47.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:52:47.294 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-09-12T22:52:47.754 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:52:47.767 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:52:47.768 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:52:47.770 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:52:47.770 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:48.345 INFO:teuthology.orchestra.run.smithi112.stdout:generic/620 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T22:52:48.355 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/620 2023-09-12T22:52:48.355 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/620 2023-09-12T22:52:48.356 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:52:48.361 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:48.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:52:48.412 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-09-12T22:52:48.862 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:52:48.874 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:52:48.875 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:52:48.878 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:52:48.879 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:49.726 INFO:teuthology.orchestra.run.smithi112.stdout:generic/621 [not run] xfs_io get_encpolicy doesn't support -t 2023-09-12T22:52:49.764 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/621 2023-09-12T22:52:49.764 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/621 2023-09-12T22:52:49.765 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:52:49.770 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:49.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:52:49.813 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-09-12T22:52:50.268 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:52:50.281 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:52:50.282 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:52:50.284 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:52:50.284 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:50.356 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:52:50.361 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:52:50.976 INFO:teuthology.orchestra.run.smithi112.stdout:generic/622 [not run] ceph does not support shutdown 2023-09-12T22:52:51.004 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/622 2023-09-12T22:52:51.004 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/622 2023-09-12T22:52:51.004 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:52:51.010 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:51.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:52:51.048 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-09-12T22:52:51.543 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:52:51.556 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:52:51.557 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:52:51.560 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:52:51.560 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:52.243 INFO:teuthology.orchestra.run.smithi112.stdout:generic/623 [not run] ceph does not support shutdown 2023-09-12T22:52:52.279 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/623 2023-09-12T22:52:52.279 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/623 2023-09-12T22:52:52.280 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:52:52.285 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:52.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:52:52.332 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-09-12T22:52:52.792 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:52:52.805 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:52:52.806 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:52:52.808 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:52:52.809 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:53.320 INFO:teuthology.orchestra.run.smithi112.stdout:generic/624 [not run] fsverity utility required, skipped this test 2023-09-12T22:52:53.331 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/624 2023-09-12T22:52:53.331 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/624 2023-09-12T22:52:53.331 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:52:53.336 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:53.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:52:53.379 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-09-12T22:52:53.840 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:52:53.853 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:52:53.854 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:52:53.856 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:52:53.857 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:54.364 INFO:teuthology.orchestra.run.smithi112.stdout:generic/625 [not run] fsverity utility required, skipped this test 2023-09-12T22:52:54.374 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/625 2023-09-12T22:52:54.374 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/625 2023-09-12T22:52:54.374 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:52:54.380 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:54.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:52:54.427 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-09-12T22:52:54.882 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:52:54.895 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:52:54.896 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:52:54.898 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:52:54.898 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:55.463 INFO:teuthology.orchestra.run.smithi112.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2023-09-12T22:52:55.473 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/626 2023-09-12T22:52:55.473 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/626 2023-09-12T22:52:55.474 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:52:55.479 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:55.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:52:55.649 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-09-12T22:52:56.274 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:52:56.286 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:52:56.287 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:52:56.290 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:52:56.290 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:56.870 INFO:teuthology.orchestra.run.smithi112.stdout:generic/627 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T22:52:56.880 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/627 2023-09-12T22:52:56.881 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/627 2023-09-12T22:52:56.881 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:52:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:56.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:52:56.939 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-09-12T22:52:57.391 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:52:57.404 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:52:57.405 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:52:57.408 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:52:57.408 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:58.412 INFO:teuthology.orchestra.run.smithi112.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T22:52:58.448 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/628 2023-09-12T22:52:58.448 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/628 2023-09-12T22:52:58.448 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:52:58.457 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:58.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:52:58.573 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-09-12T22:52:59.028 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:52:59.040 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:52:59.041 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:52:59.044 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:52:59.044 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:59.593 INFO:teuthology.orchestra.run.smithi112.stdout:generic/629 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T22:52:59.603 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/629 2023-09-12T22:52:59.604 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/629 2023-09-12T22:52:59.604 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:52:59.610 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:52:59.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:52:59.654 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-09-12T22:53:00.109 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:53:00.122 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:53:00.123 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:53:00.126 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:53:00.126 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:00.859 INFO:teuthology.orchestra.run.smithi112.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-09-12T22:53:00.977 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/630 2023-09-12T22:53:00.978 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/630 2023-09-12T22:53:00.978 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:53:00.981 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:01.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:53:01.185 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-09-12T22:53:01.714 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:53:01.727 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:53:01.728 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:53:01.731 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:53:01.732 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:20.467 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:53:20.472 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:53:33.029 INFO:teuthology.orchestra.run.smithi112.stdout:generic/631 - output mismatch (see /tmp/tmp.X1XCSigEoUxfstests-dev/results//generic/631.out.bad) 2023-09-12T22:53:33.057 INFO:teuthology.orchestra.run.smithi112.stdout: --- tests/generic/631.out 2023-09-12 16:08:42.159805892 +0000 2023-09-12T22:53:33.057 INFO:teuthology.orchestra.run.smithi112.stdout: +++ /tmp/tmp.X1XCSigEoUxfstests-dev/results//generic/631.out.bad 2023-09-12 22:53:32.992840978 +0000 2023-09-12T22:53:33.057 INFO:teuthology.orchestra.run.smithi112.stdout: @@ -1,2 +1,4748 @@ 2023-09-12T22:53:33.057 INFO:teuthology.orchestra.run.smithi112.stdout: QA output created by 631 2023-09-12T22:53:33.058 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.058 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.058 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.058 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.058 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.059 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.059 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: mount: 2023-09-12T22:53:33.059 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.059 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.059 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.060 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.060 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.060 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.060 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.060 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.061 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.061 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.061 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf'cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-09-12T22:53:33.061 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.061 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.061 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.062 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.062 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.062 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.062 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.062 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.063 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.063 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.063 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.063 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.063 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.064 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.064 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.064 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.064 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.064 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.064 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.065 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.065 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.065 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.065 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.065 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.066 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.066 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.066 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.066 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.066 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.067 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.067 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.067 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.067 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.067 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.068 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.068 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.068 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.068 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.068 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.068 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.069 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.069 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.069 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.069 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.069 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.070 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.070 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.070 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.070 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.070 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.071 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.071 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.071 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.071 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.071 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.071 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directoryumount: 2023-09-12T22:53:33.072 INFO:teuthology.orchestra.run.smithi112.stdout: +/tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.072 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.072 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.072 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.072 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.073 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.073 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.073 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.073 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.074 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.074 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.074 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.074 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.075 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.075 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.075 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.075 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.075 INFO:teuthology.orchestra.run.smithi112.stdout: +/tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-09-12T22:53:33.076 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.076 INFO:teuthology.orchestra.run.smithi112.stdout: +/tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.076 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.076 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.076 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.077 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.077 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.077 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.077 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.077 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.078 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.078 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.078 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.078 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.078 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.079 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.079 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.079 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.079 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.079 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.080 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.080 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.080 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.080 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.080 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.081 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.081 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.081 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.081 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.081 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.082 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.082 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.082 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.082 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.082 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.083 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.083 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.083 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.083 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.083 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.084 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.084 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.084 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.084 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.084 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.085 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.085 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.085 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.085 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.085 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.085 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.086 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.086 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.086 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.086 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.087 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.087 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.087 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.087 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.087 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.087 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.088 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.088 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.088 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.088 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.088 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.089 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.089 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.089 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.089 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.089 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.090 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.090 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.090 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.090 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.090 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.091 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.091 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.091 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.091 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.091 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.092 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.092 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.092 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.092 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.092 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.093 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.093 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.093 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.093 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.093 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.094 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.094 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.097 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.097 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.098 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.098 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.098 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.098 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.098 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.099 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.099 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.099 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.099 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.099 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.100 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.100 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.100 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.100 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.100 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.100 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.101 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.101 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.102 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.102 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.103 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.103 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.103 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.103 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.104 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.104 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.104 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.105 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.105 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.105 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.105 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.106 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.106 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.106 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.107 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.107 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.107 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.108 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.108 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.108 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.109 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.109 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.109 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.110 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.110 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.110 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.110 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.110 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.111 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.111 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.111 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.111 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.112 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.112 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.112 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.112 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.112 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.113 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.113 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.113 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.113 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.114 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.114 INFO:teuthology.orchestra.run.smithi112.stdout: +: No such file or directory 2023-09-12T22:53:33.114 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.114 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.115 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.115 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.115 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.115 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.115 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.116 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.116 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.116 INFO:teuthology.orchestra.run.smithi112.stdout: +/tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.116 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.116 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.117 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.117 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.117 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.117 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.117 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.118 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.118 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.118 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.118 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.118 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.119 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-09-12T22:53:33.119 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.119 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.120 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.120 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.120 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.120 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.121 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.121 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.121 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.121 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.121 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.121 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.122 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.122 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.122 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.123 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.123 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.123 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.123 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.123 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.124 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.124 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.125 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.125 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.125 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.125 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.126 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.126 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.126 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.127 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.127 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.127 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.127 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.128 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.128 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.128 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.128 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.128 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.129 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: umount: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf'/tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted.: No such file or directory 2023-09-12T22:53:33.129 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.129 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.129 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.129 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.130 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.130 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.130 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.131 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.131 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.131 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.131 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.131 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.132 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.132 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.132 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.132 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.133 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.133 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.133 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.133 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.133 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-09-12T22:53:33.133 INFO:teuthology.orchestra.run.smithi112.stdout: +/tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.134 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.134 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.134 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.135 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.135 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.135 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.135 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.135 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.136 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.136 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.136 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.136 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.136 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.137 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.137 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.137 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.137 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.137 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.138 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.138 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.138 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.138 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.138 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.139 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.139 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.139 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.139 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.139 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.140 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.140 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.140 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.140 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.140 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.141 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.141 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.141 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.141 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.142 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.142 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.142 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.142 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.143 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.143 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.143 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.144 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.144 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.144 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.144 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.145 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.145 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.145 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.146 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.146 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.146 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.146 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.146 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.147 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.147 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.147 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.147 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.147 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.148 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.148 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.148 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.148 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.148 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.149 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.149 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.149 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.149 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.149 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.150 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.150 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.150 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.150 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.150 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.151 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.151 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.151 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.151 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.152 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.152 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.152 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.152 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.153 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.153 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.153 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.153 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.154 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.154 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.154 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.154 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.155 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.155 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.155 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.155 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.156 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.156 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.156 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.157 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.157 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.157 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.157 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.157 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.158 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.158 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.158 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.158 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.158 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.159 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.159 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.159 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.159 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.159 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.160 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.160 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.160 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.160 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.160 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.161 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.161 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.161 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.161 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.161 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.162 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.162 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.162 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.162 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.163 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.163 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.163 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.163 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.164 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.164 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.164 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.164 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.165 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.165 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.165 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.165 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.165 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.166 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.166 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.166 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.166 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.166 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.167 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.167 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.167 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.167 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.168 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.168 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directorytouch: 2023-09-12T22:53:33.168 INFO:teuthology.orchestra.run.smithi112.stdout: +cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.168 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.169 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.169 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.169 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.169 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.169 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.169 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.170 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.170 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.170 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.170 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.170 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-09-12T22:53:33.171 INFO:teuthology.orchestra.run.smithi112.stdout: +/tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.171 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.171 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.171 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.171 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.172 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.172 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.172 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.172 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.172 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.173 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.173 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.173 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.173 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.174 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.174 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.174 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.175 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.175 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.175 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.175 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.175 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.176 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.176 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.176 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.176 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.176 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.176 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.177 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.177 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.177 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.177 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.178 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.178 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.178 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.178 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.179 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.179 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.179 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.179 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.179 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.180 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.180 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.180 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.180 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.180 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.181 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.181 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.181 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.181 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.181 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.181 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.182 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.182 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.182 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.182 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.183 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.183 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.183 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.183 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.183 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.183 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.184 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.184 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.184 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.185 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.185 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.185 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.185 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.186 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.186 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.186 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.186 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.186 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.187 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.187 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.187 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.187 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.187 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.188 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.188 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: umount: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf'/tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.188 INFO:teuthology.orchestra.run.smithi112.stdout: +: No such file or directory 2023-09-12T22:53:33.188 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.189 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.189 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.189 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.189 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.189 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.190 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.190 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.190 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.190 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.190 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.191 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.191 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.191 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.191 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.191 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.191 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.192 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.192 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.192 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.192 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.192 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.193 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.193 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.193 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.193 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.193 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.193 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.194 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.194 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.194 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.195 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.195 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.195 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.195 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.196 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.196 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.196 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.196 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.196 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.197 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.197 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.197 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.202 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.202 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.203 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.203 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.203 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.203 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.203 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.204 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.204 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.204 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.204 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.204 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.205 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.205 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.205 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.205 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.206 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.206 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.206 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.206 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.207 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.207 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.207 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.207 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.207 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.208 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.208 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.208 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.208 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.208 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.209 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.209 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.209 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.209 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.209 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.210 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.210 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.210 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.210 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.210 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.211 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.211 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.211 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.211 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.211 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.212 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.212 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.212 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.212 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.212 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.213 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.213 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.213 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.213 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.213 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.214 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.214 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.214 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.214 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.214 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.214 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.215 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.215 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.215 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.215 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.215 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.216 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.216 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.216 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.217 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.217 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.217 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.218 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.218 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.218 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.219 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.219 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.219 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.219 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.220 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.220 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.220 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.220 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.220 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.221 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.221 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.221 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.221 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.221 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.222 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.222 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.222 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.222 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.223 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.223 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.223 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.223 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.223 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.223 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.224 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.224 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.224 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.224 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.225 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.225 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.225 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.225 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.225 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.226 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.226 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.226 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.226 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.227 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.227 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.227 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.227 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.227 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.228 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.228 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.228 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.228 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.228 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.229 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.229 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.230 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.230 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.230 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.231 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.231 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.231 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.232 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.232 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.232 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.233 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.233 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf'umount: : No such file or directory/tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.234 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.234 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.234 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.235 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.235 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.235 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.236 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.236 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.236 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.237 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.237 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.237 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.238 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.238 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.238 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.238 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.239 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.239 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.239 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.239 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.239 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.240 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.240 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.240 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.240 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.240 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.241 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.241 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.241 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.241 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.241 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.242 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.242 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.242 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.242 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.242 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.243 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.243 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.243 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.243 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.243 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.244 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.244 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.244 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.244 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.244 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.245 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.245 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.245 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.245 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.245 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.245 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.246 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.246 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.246 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.246 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.246 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.247 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.247 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.247 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.247 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.247 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.248 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.248 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.248 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.248 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.248 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.249 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.249 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.249 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.249 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.249 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.250 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.250 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.250 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.250 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.250 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.250 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.251 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.251 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.251 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.251 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.251 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.252 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.252 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.252 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.252 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.252 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.252 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.253 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.253 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.253 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.253 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.253 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.254 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.254 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.254 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.254 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.254 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.255 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.255 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.255 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.255 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.255 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.256 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.256 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.256 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.256 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.256 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.256 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.257 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.257 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.257 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.257 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.257 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.258 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.258 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.258 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.258 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.258 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.259 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.259 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.259 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.259 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.259 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.259 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.260 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.260 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.260 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.260 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.260 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.261 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.261 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.261 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.261 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.261 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.262 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.262 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.262 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.262 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.262 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.263 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.263 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.263 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.263 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.263 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.263 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.264 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.264 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.264 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.264 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.264 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.265 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.265 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.265 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.265 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.265 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.266 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.266 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.266 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.266 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.266 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.267 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.267 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.267 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.267 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.267 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.267 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.268 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.268 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.268 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.268 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.268 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.269 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.269 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.269 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.269 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.269 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.270 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.270 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.270 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.270 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.270 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.271 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.271 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.271 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.271 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.271 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.271 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.272 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.272 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.272 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.272 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.272 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.273 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.273 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.273 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.273 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.273 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.274 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.274 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.274 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.274 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.274 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.274 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.275 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.275 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.275 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.275 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.275 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.276 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.276 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.276 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.276 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.276 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.277 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.277 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.277 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.277 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.277 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.277 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.278 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.278 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.278 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.278 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.278 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.279 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.279 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.279 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.279 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.279 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.280 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.280 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.280 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.280 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.280 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.280 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.281 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.281 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.281 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.281 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.281 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.282 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.282 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.282 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.282 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.282 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.283 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.283 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.283 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.283 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.283 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.284 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.284 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.284 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.284 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.285 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.285 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.285 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.285 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.286 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.286 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.286 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.286 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.286 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.287 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf' 2023-09-12T22:53:33.287 INFO:teuthology.orchestra.run.smithi112.stdout: +: No such file or directory 2023-09-12T22:53:33.287 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.287 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.287 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.288 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.288 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.288 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.288 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.288 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.288 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.289 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.289 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.289 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.289 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.289 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.290 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.290 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.290 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.290 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.290 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.291 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.291 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.291 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.291 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.291 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.292 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.292 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.292 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.292 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.292 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.292 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.293 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.293 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.293 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.293 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.293 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.294 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.294 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.294 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.294 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.294 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.294 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.295 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.295 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.295 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.295 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.295 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.296 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.296 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.296 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.296 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.296 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.297 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.297 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.297 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.297 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.297 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.297 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.298 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.298 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.298 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.298 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.298 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.299 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.299 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.299 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.299 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.299 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.300 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.300 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.300 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.300 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.300 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.300 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: umount: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf'/tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted.: No such file or directory 2023-09-12T22:53:33.301 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.301 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.301 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.301 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.301 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.302 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.302 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.302 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.302 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.302 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.303 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.305 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.305 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.305 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.305 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.305 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.306 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.306 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.306 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.306 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.306 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.307 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.307 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.307 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.307 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.307 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.308 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.308 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.308 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.308 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.308 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.308 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.309 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.309 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.309 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.309 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.309 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.310 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.310 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.310 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.310 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.310 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.311 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.311 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.311 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.311 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.311 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.312 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.312 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.312 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.312 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.312 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.312 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.313 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.313 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.313 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.313 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.313 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.314 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.314 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.314 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.314 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.314 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.315 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.315 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.315 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.315 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.315 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.315 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.316 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.316 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.316 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-09-12T22:53:33.316 INFO:teuthology.orchestra.run.smithi112.stdout: +/tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.316 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-09-12T22:53:33.317 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.317 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.317 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.317 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.317 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.318 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.318 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.318 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.318 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.318 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.319 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.319 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.319 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.319 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.319 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.319 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.320 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.320 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.320 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.320 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.320 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.321 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.321 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.321 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.321 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.321 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.321 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.322 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.322 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.322 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.322 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.322 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.323 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.323 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.323 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.323 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.323 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.324 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.324 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.324 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.324 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.324 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.325 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: mv: mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-09-12T22:53:33.325 INFO:teuthology.orchestra.run.smithi112.stdout: +: No such file or directory 2023-09-12T22:53:33.325 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.325 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.325 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.325 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.326 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.326 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.326 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.326 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.326 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.327 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.327 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.327 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.327 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.327 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.328 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.328 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.328 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.328 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.328 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.329 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.329 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.329 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.329 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.329 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.329 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.330 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.330 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.330 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.330 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.330 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.331 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.331 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.331 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.331 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.331 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.332 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.332 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.332 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.332 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.332 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.333 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.333 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.333 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.333 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.333 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.334 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.334 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.334 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.334 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.334 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.334 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.335 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.335 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.335 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.335 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.335 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.336 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.336 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.336 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.336 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.336 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.337 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.337 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.337 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.337 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.337 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.337 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.338 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.338 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.338 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.338 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.338 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.339 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.339 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.339 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.339 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.339 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.340 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.340 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.340 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.340 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.340 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.340 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.341 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.341 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.341 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.341 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.341 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.342 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.342 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.342 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.342 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.342 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.343 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.343 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.343 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.343 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.343 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.343 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.344 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.344 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.344 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.344 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.344 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.345 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.345 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.345 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.345 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.345 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.345 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.346 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.346 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.346 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.346 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.347 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.347 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.347 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.347 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.347 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.347 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.348 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.348 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.348 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.348 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.348 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.349 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.349 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.349 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.349 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.349 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.350 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.350 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.350 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.350 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.350 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.351 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.351 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.351 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.351 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.351 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-09-12T22:53:33.351 INFO:teuthology.orchestra.run.smithi112.stdout: +/tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.352 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.352 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.352 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.352 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.352 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.353 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.353 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.353 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.353 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.353 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.353 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.354 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.354 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.354 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.354 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.354 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.355 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.355 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.355 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.355 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.355 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.356 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.356 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.356 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.356 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.356 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.356 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.357 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.357 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.357 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.357 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.357 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.358 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.358 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.358 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.358 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.358 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.359 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.359 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.359 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.359 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.359 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.360 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.360 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.360 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.360 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.360 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.361 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.361 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.361 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.361 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.361 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.362 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.362 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.362 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.362 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.362 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.362 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.363 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.363 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.363 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.363 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.363 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.364 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.364 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.364 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.364 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.364 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.365 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.365 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.365 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.365 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.365 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.365 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.366 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.366 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.366 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-09-12T22:53:33.366 INFO:teuthology.orchestra.run.smithi112.stdout: +/tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.366 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.367 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.367 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.367 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.367 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.367 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.368 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.368 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.368 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.368 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.368 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.368 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.369 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.369 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.369 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.369 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.369 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.370 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.370 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.370 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.370 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.370 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.371 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.371 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.371 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.371 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.371 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.372 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.372 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.372 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.372 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.372 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.373 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.373 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.373 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.373 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.373 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.374 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.374 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.374 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.374 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.374 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.375 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.375 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.375 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.375 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.375 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.376 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.376 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.376 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.376 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.376 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.377 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.377 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.377 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.377 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.377 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.377 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.378 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.378 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.378 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.378 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.379 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.379 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.379 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.379 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.379 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.380 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.380 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.380 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.380 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.380 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.380 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.381 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.381 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.381 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.381 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.381 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.382 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.382 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.382 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.382 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.382 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.383 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.383 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.383 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.383 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.383 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.384 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.384 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.384 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.384 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.384 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf'cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-09-12T22:53:33.385 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.385 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.385 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.385 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.385 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.385 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.386 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.386 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.386 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.386 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.386 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.387 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.387 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.387 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.387 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.388 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.388 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.388 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.388 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.388 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.388 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.389 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.389 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.389 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.389 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.389 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.390 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.390 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.390 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.390 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.390 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.391 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.391 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.391 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.391 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.391 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.392 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.392 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.392 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.392 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.392 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.393 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.393 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.393 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.393 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.393 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.393 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.394 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.394 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.394 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.394 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.394 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.395 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.395 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.395 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.395 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.395 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.396 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.396 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.396 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.396 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.396 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.397 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.397 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.397 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.397 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.397 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.398 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.398 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.398 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.398 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.398 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.399 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.399 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.399 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.399 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.399 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.400 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.400 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.400 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.400 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.400 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.401 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.401 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.401 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.401 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.401 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.402 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.402 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.402 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.402 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.402 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.403 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.403 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.403 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.403 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.403 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.404 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.404 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.404 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.404 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.404 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.404 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.405 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.405 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.405 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.405 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.405 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.406 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.406 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.406 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.406 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.406 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.407 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.407 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.407 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.407 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.407 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.408 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.408 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.408 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.408 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.408 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.409 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.409 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.409 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.409 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.409 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.410 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.410 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.410 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.410 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.410 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.411 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.411 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.411 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.411 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.411 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.412 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.412 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.412 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.412 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.412 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.413 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.413 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.413 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-09-12T22:53:33.413 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.413 INFO:teuthology.orchestra.run.smithi112.stdout: +/tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.414 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.414 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.414 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.414 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.414 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directorytouch: 2023-09-12T22:53:33.414 INFO:teuthology.orchestra.run.smithi112.stdout: +cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.415 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.415 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.415 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.415 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.415 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.416 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.416 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted.umount: 2023-09-12T22:53:33.416 INFO:teuthology.orchestra.run.smithi112.stdout: +/tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.416 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.416 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.417 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.417 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.417 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.417 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.417 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.417 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.418 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.419 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.420 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.421 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.422 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.423 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.424 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.425 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.426 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.428 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.429 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.430 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.446 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.446 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.446 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.446 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.446 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.452 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.452 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.452 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.452 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.452 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.454 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.454 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.454 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.454 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.454 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.455 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.455 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.455 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mv: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.455 INFO:teuthology.orchestra.run.smithi112.stdout: +cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.455 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.456 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.456 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.456 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.456 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.456 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.457 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.457 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.457 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.457 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.457 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.458 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.458 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.458 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.458 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.458 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.459 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.459 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.459 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.459 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.459 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.459 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.460 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.460 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.460 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.460 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.460 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.461 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.461 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.461 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.461 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.461 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.462 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.462 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.462 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.462 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.462 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.463 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.463 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.463 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.463 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.463 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.463 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.464 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.464 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.464 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.464 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.464 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.465 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.465 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.465 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.465 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.465 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.465 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.466 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.466 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.466 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.466 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.467 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.467 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.467 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.467 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.468 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.468 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.468 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.468 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.468 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.468 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.469 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.469 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.469 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.469 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.469 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.470 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.470 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.470 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.470 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.470 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.471 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.471 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.471 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.471 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.471 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.472 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.472 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.472 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.472 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.472 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.473 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.473 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.473 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.473 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.473 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.474 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.474 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.474 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.474 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.474 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.475 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.475 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.475 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.475 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted./tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.475 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.476 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.476 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.476 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.476 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.476 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.477 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.477 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.477 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.477 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.477 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.478 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.478 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.478 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.478 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.478 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.479 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.479 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.479 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.479 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.479 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf'cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-09-12T22:53:33.480 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.480 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.480 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.480 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.480 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.480 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.481 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.481 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.481 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.481 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.481 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.482 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.482 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.482 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.482 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.483 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.483 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.483 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.483 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.483 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.483 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.484 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.484 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.484 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.484 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.485 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.485 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.485 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.485 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.486 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.486 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.486 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.486 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.486 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.487 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.487 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.487 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.487 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.488 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.488 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.488 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.488 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.489 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.489 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.489 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.489 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.489 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.490 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.490 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.490 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.490 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.490 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.490 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.491 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.491 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.491 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.491 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.491 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.492 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.492 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.492 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.492 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.492 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.493 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.493 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.493 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.493 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.493 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.493 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.494 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.494 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.494 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.494 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.494 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.495 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.495 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.495 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.495 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.495 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.496 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.496 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.496 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.496 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.496 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.497 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.497 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.497 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.497 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.497 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.498 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.498 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.498 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.498 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.498 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.499 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.499 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.499 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.499 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.499 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.499 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.500 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.500 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.500 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.500 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.500 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.501 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.501 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.501 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.501 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.501 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.502 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.502 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.502 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.502 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.502 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: touch: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf' 2023-09-12T22:53:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: +: No such file or directory 2023-09-12T22:53:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-09-12T22:53:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.515 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.515 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.515 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.515 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.515 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.517 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.517 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.517 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.517 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.517 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.518 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.518 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.518 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.518 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.518 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.519 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.519 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.519 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.519 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.519 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.519 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.520 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.520 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.520 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.520 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.520 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.521 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.521 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: mv: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted.cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf' 2023-09-12T22:53:33.521 INFO:teuthology.orchestra.run.smithi112.stdout: +: No such file or directory 2023-09-12T22:53:33.521 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.521 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.522 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.522 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.522 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.522 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.522 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.523 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.523 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.523 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.523 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.523 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.524 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.524 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.524 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.524 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.524 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.525 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.525 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.525 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.525 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.525 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.525 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.526 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.526 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.526 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.526 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.527 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.527 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.527 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.527 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.527 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.527 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.528 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.528 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.528 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.528 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.528 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.529 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.529 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.529 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.529 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.529 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.530 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.530 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.530 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.530 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.531 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.531 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.531 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.531 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.531 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.532 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.532 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.532 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.532 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.532 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.532 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.533 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.533 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.533 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.533 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.533 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.534 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.534 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.534 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.534 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.534 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.535 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.535 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.535 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.535 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.535 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.536 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.536 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.536 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.536 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.536 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.536 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.537 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.537 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.537 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.537 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.537 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.538 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.538 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.538 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.538 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.538 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.539 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.539 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.539 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.539 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.539 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.540 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.540 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.540 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.540 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.540 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.541 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.541 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.541 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.541 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.541 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.541 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.542 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.542 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.542 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.542 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.542 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.543 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.543 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.543 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.543 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.543 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.543 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.544 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.544 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.544 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.544 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.544 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.545 INFO:teuthology.orchestra.run.smithi112.stdout: +: No such file or directory 2023-09-12T22:53:33.545 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.545 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.545 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.545 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.546 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.546 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.546 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.546 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.546 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.547 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.547 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.547 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.547 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.547 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.548 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.548 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.548 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.548 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.548 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.549 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.549 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.549 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.549 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.549 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.550 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.550 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.550 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.550 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.550 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.551 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.551 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.551 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.551 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.551 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.552 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.552 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.552 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.552 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.552 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.553 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.553 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.553 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.553 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.553 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.554 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.554 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.554 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.554 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.554 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.555 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.555 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.555 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.555 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.555 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.556 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.556 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.556 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.556 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.556 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.556 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.557 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.557 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.557 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.557 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.558 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.558 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.558 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.558 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.558 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.559 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.559 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.559 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.559 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.559 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.560 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.560 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.560 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.560 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.560 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.561 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.561 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.561 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.561 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.561 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.562 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.562 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.562 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.562 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.562 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.563 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.563 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.563 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.563 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.563 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.564 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.564 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.564 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.564 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.564 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.565 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.565 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.565 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.565 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.565 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.566 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.566 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.566 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.566 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.566 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf'cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-09-12T22:53:33.567 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.567 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.567 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.567 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.567 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.567 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.568 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.568 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.568 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.568 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.568 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.569 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.569 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-09-12T22:53:33.569 INFO:teuthology.orchestra.run.smithi112.stdout: +/tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.569 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.569 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.570 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.570 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.570 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.570 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.570 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.571 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.571 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.571 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-09-12T22:53:33.571 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.571 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.572 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.572 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.572 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.572 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.572 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.573 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.573 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.573 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.573 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.573 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.574 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.574 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.574 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.574 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.574 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.575 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.575 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.575 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.575 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.575 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.576 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.576 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.576 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.576 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.576 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.576 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.577 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.577 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.577 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.577 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.577 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.578 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.578 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.578 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.578 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.578 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.579 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.579 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.579 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.579 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.579 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.580 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.580 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.580 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.580 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.580 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.581 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.581 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.581 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.581 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.581 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.581 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.582 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.582 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.582 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.582 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.583 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.583 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.583 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.583 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.583 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.584 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.584 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.584 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.584 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.584 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.584 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.585 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.585 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.585 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.585 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.585 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.586 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.586 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-09-12T22:53:33.586 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.586 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.586 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.587 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.587 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.587 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.587 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.587 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.588 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.588 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.588 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.588 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.588 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.588 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.589 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.589 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.589 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.589 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.589 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.590 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.590 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.590 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.590 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.590 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.591 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.591 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.591 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.591 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.591 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.592 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.592 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted./tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.592 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.592 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.592 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.593 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.593 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.593 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.593 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.593 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.594 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.594 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.594 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.594 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.594 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.595 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.595 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.595 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.595 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.595 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.595 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.596 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.596 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.596 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.596 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.596 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.597 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.597 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.597 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.597 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.597 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.598 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.598 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.598 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.598 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.598 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.599 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.599 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.599 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.599 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.599 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.600 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.600 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.600 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.600 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.600 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.600 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.601 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.601 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.601 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.601 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.601 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.602 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.602 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.602 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.602 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.602 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.603 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.603 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.603 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.603 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.603 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.603 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.604 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.604 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.604 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.604 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.604 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.605 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.605 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.605 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.605 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.605 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.606 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.606 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.606 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.606 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.607 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.607 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.607 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.607 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.607 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.607 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.608 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.608 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.608 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.608 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.608 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.609 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-09-12T22:53:33.609 INFO:teuthology.orchestra.run.smithi112.stdout: +/tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.609 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.609 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.609 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.610 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.610 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.610 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.610 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.610 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.611 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.611 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.611 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.611 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.611 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.611 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.612 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.612 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.612 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.612 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.612 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.613 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.613 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.613 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.613 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.613 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.614 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.614 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.614 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.614 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.614 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.615 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.615 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.615 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.615 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.615 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.615 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.616 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.616 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.616 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.616 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.616 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.617 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.617 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.617 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.617 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.617 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.618 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.618 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.618 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.618 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.618 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.618 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.619 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.619 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.619 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.619 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.619 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.620 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.620 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.620 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.620 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.620 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.621 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.621 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.621 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.621 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.621 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.622 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.622 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.622 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.622 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.622 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.623 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.623 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.623 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.623 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.623 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.623 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.624 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.624 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.624 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.624 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.624 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.625 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.625 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.625 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.625 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.625 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.626 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.626 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.626 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.626 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.626 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.627 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.627 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.627 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.627 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.627 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.632 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.632 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.632 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.632 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2023-09-12T22:53:33.632 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.633 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.633 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.633 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.633 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.633 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2023-09-12T22:53:33.633 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.634 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.634 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.634 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.634 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.634 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.635 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.635 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.635 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.635 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.635 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.636 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.636 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.636 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.636 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.636 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.637 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.637 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.637 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.637 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.637 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.638 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.638 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.638 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.638 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.638 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.639 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.639 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.639 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.639 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.639 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.640 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.640 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.640 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.640 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.640 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.641 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.641 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.641 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.641 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.641 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.641 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.642 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.642 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.642 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.642 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.642 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.643 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.643 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.643 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.643 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.643 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.644 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.644 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.644 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.644 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.644 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.645 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.645 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.645 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.645 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.645 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.646 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.646 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.646 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.646 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.646 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.647 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.647 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.647 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.647 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.647 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.647 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.648 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.648 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.648 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.648 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.648 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.649 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.649 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.649 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.649 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.649 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.650 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.650 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.650 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.650 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.650 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.651 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.651 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.651 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.651 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.651 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.652 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.652 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.652 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.652 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.652 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.653 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.653 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.653 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.653 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.653 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.654 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.654 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.654 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.654 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.654 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.655 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.655 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.655 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.655 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.655 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.655 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-09-12T22:53:33.656 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.656 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.656 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf'cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-09-12T22:53:33.656 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.656 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.657 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.657 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.657 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.657 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf'cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-09-12T22:53:33.657 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.658 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.658 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted./tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.658 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.658 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.658 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.659 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.659 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.659 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.659 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.659 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.659 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.660 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.660 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.660 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.660 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.660 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.661 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.661 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.661 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.661 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.661 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.661 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.662 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.662 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.662 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.662 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.662 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.663 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.663 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.663 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.663 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.663 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.664 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.664 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.664 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.664 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.664 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.664 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.665 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.665 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.665 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.665 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.665 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.666 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.666 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.666 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.666 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.666 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.667 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.667 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.667 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.667 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.667 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.668 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.668 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.668 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.668 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.668 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.669 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.669 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.669 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.669 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.669 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.669 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.670 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.670 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.670 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.670 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.670 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.671 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.671 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.671 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.671 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.671 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.672 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.672 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.672 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directorytouch: 2023-09-12T22:53:33.672 INFO:teuthology.orchestra.run.smithi112.stdout: +cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.672 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.673 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.673 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.673 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.673 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.673 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.675 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.675 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.675 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.675 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.675 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.676 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.676 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.676 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.676 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.676 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.677 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.677 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.677 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.677 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.677 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.677 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.678 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.678 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.678 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.678 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.678 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.679 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.679 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.679 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.679 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.679 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.679 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.680 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.680 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.680 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.680 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.680 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.681 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.681 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.681 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.681 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.681 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.682 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.682 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.682 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.682 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.682 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.683 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.683 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.683 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.683 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.683 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.683 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.684 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.684 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.684 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.684 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.684 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.685 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.685 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.685 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.685 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.685 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.685 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.686 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.686 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.686 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.686 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.686 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.687 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.687 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.687 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.687 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.687 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.688 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.688 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.688 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.688 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.688 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.688 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.689 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.689 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.689 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.689 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.689 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.690 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.690 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.690 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.690 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.690 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.691 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.691 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.691 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.691 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.691 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.691 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.692 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.692 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.692 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.692 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.692 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.693 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.693 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.693 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.693 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.693 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.693 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.694 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.694 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.694 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.694 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.694 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.695 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.695 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.695 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.695 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.695 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.696 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.696 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.696 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.696 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.696 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.697 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.697 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.697 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.697 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.697 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.697 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.698 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.698 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.698 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.698 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.698 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.699 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.699 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.699 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.699 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.699 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.700 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.700 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.700 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.700 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.700 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.700 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.701 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.701 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.701 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.701 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.701 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.702 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.702 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.702 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.702 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.702 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.703 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.703 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.703 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.703 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.703 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.703 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.704 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.704 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.704 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.704 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.704 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.705 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.705 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.705 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.705 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.705 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.705 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.706 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.706 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.706 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.709 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.709 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.709 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.709 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.710 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.710 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.710 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.710 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.710 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.710 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.711 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.711 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.711 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.711 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.711 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.712 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.712 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.712 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.712 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.712 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.713 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.713 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.713 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.713 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.713 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.714 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.714 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.714 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.714 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.714 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.715 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.715 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.715 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.715 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.715 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.715 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.716 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.716 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.716 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.716 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.716 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.717 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.717 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.717 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.717 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.717 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.717 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.718 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.718 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.718 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.718 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.719 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.719 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.719 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.719 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.719 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.719 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.720 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.720 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.720 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.720 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.720 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.721 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.721 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.721 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.721 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.721 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.722 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.722 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.722 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.722 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.722 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.722 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.723 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.723 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.723 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.723 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.723 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.724 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.724 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.724 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.724 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.724 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.725 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.725 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.725 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.725 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.725 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.726 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.726 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: mv: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted.cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf' 2023-09-12T22:53:33.726 INFO:teuthology.orchestra.run.smithi112.stdout: +: No such file or directory 2023-09-12T22:53:33.726 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.726 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.726 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.727 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.727 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.727 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.727 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.727 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.728 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.728 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.728 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.728 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.728 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.729 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.729 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.729 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.729 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.729 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.730 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.730 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.730 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.730 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.730 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.731 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.731 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.731 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.731 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.731 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.731 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.732 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.732 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.732 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.732 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.732 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.733 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.733 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.733 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.733 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.733 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.734 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.734 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.734 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.734 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.734 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.735 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.735 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.735 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.735 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.735 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.735 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.736 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.736 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.736 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.736 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.736 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.737 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.737 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.737 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.737 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.737 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.737 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.738 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.738 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.738 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.738 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.738 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.739 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.739 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.739 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.739 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.739 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.740 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.740 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.740 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.740 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.740 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.741 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.741 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.741 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.741 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.741 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-09-12T22:53:33.742 INFO:teuthology.orchestra.run.smithi112.stdout: +/tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.742 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.742 INFO:teuthology.orchestra.run.smithi112.stdout: +: No such file or directory 2023-09-12T22:53:33.742 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.742 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.742 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.743 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.743 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.743 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.743 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.743 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.744 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.744 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.744 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.744 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.744 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.745 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.745 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.745 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.745 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.745 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.746 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.746 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.746 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.746 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.746 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.746 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.747 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.747 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.747 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.747 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.747 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.748 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.748 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.748 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.748 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.748 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.749 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.749 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.749 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.749 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.749 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.750 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.750 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.750 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.750 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.750 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.751 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.751 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.751 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.751 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.751 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.751 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.752 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.752 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.752 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.752 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.752 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.752 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.753 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.753 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.753 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.753 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.753 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.754 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.754 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.754 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.754 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.754 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.755 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.755 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.755 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.755 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.755 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.756 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.756 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.756 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.756 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.756 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.757 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.757 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.757 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.757 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.757 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.757 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.758 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.758 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.758 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.758 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.758 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.759 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.759 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.759 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.759 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.759 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.760 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.760 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.760 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.760 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.760 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.761 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.761 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.761 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.761 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.761 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.762 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.762 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.762 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.762 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.763 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.763 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.763 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.763 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.763 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.764 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.764 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.764 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.764 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.764 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.765 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.765 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.765 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.765 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.765 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.765 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.766 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.766 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.766 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.766 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.766 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.767 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.767 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.767 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.767 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.768 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.768 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.768 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.768 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.768 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.768 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.769 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.769 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.769 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.769 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.770 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.770 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.770 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.770 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.770 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.771 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.771 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.771 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.771 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.771 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.771 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.772 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.772 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.772 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.772 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.772 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.773 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.773 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.773 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.773 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.773 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.774 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.774 INFO:teuthology.orchestra.run.smithi112.stdout: +: No such file or directory 2023-09-12T22:53:33.774 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.774 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.774 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.775 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.775 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.775 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.775 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.775 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.775 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.776 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.776 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.776 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.776 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.776 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.777 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.777 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.777 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.777 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.777 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.777 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.778 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.778 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.778 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.778 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.778 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.779 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.779 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.779 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.779 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.779 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.780 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.780 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.780 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.780 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.780 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.781 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.781 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.781 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.781 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.781 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.781 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.782 INFO:teuthology.orchestra.run.smithi112.stdout: +: No such file or directory 2023-09-12T22:53:33.782 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.782 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.782 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.782 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.783 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.783 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.783 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.783 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.783 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.784 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.784 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.784 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.784 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.784 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.784 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.785 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.785 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.785 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.785 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.785 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.786 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.786 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.786 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.786 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.786 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.787 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.787 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.787 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.787 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.787 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.788 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.788 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.788 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.788 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.788 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.789 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.789 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.789 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.789 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.789 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.790 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.790 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.790 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.790 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.790 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.791 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.791 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.791 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.791 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.791 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.791 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.792 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted./tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.792 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.792 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.792 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.792 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.793 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.793 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.793 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.794 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.794 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.794 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.794 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.795 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.795 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.795 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.795 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.796 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.796 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.796 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.796 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.797 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.797 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.797 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.797 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.798 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.798 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.798 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.798 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.799 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.799 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.799 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.800 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.800 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.800 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.800 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.800 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.801 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.801 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.801 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.801 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.802 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.802 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.802 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.803 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.803 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.803 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.803 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.803 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.804 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.804 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.804 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.804 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.804 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.805 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.805 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.805 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.805 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.805 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.806 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.806 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.806 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.806 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.806 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.807 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.807 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.807 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.807 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.807 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.808 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.808 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.808 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.808 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.808 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.809 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.809 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.809 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.809 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.809 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.810 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.810 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.810 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.810 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.810 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.811 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.811 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.811 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.811 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.811 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.812 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.812 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.812 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.812 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.812 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.813 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.813 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.813 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.813 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.813 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.814 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.814 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.814 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.814 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.814 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.815 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.815 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.815 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.815 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.815 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.816 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.816 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.816 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.816 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.816 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.817 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.817 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.817 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.817 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.817 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.818 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.818 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.818 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.818 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.818 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.819 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.819 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.819 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.819 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.819 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.820 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.820 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.820 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.820 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.820 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.821 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.821 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.821 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.821 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.821 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.821 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.822 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.822 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.822 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.822 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.823 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.823 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.823 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.823 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.823 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.823 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.824 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.824 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.824 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.824 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.824 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.825 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.825 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.825 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.825 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.825 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.825 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.826 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.826 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.826 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.826 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.826 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.827 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.827 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.827 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.827 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.827 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.828 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.828 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.828 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.828 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.828 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.828 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.829 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.829 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.829 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.829 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.829 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.830 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.830 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.830 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.830 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.830 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.831 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.831 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.831 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.831 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.831 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.831 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.832 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.832 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.832 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.832 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.832 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.833 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.833 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.833 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.833 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.833 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.833 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.834 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.834 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.834 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.834 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.835 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.835 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.835 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.835 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.835 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.835 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.836 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.836 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.836 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.836 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.836 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.837 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.837 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.837 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.837 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.837 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.838 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.838 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.838 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.838 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.838 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.839 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.839 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.839 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.839 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.839 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.840 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.840 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.840 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.840 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.840 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.840 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.841 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.841 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.841 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.841 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.841 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.842 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.842 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.842 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.842 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.842 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.843 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.843 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.843 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.843 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.843 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.844 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.844 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.844 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.844 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.844 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.844 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.845 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.845 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.845 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.845 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.845 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.846 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.846 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.846 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.846 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.846 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.847 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.847 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.847 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.847 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.847 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.847 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.848 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.848 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.848 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.848 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.848 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.849 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.849 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.849 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.849 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.849 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.850 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.850 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.850 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.850 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.850 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.851 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.851 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.851 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.851 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.851 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.852 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.852 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.852 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.852 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.852 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.852 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.853 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.853 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.853 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.853 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.853 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.854 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.854 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.854 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.854 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.854 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.855 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.855 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.855 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.855 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.855 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.856 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.856 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.856 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.856 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.856 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.857 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.857 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.857 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.857 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.857 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.858 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.858 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.858 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.858 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.858 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.859 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.859 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.859 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.859 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.859 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.860 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.860 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.860 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.860 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.860 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.861 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.861 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.861 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.861 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.861 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.862 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.862 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.862 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.862 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.862 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.863 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.863 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.863 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.863 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.863 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.864 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.864 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.864 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.864 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.864 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.864 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.865 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.865 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.865 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.865 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.865 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.866 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.866 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.866 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.866 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.866 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.867 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.867 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.867 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.867 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.868 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.868 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.868 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.868 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.868 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.869 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.869 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.869 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.869 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.869 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.870 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.870 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.870 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.870 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.870 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.871 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.871 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.871 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.871 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.871 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.871 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.872 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.872 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.872 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.872 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.872 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.873 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.873 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.873 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.873 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.873 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.874 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.874 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.874 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.874 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.874 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.875 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.875 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.875 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.875 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.875 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.876 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted./tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.876 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.876 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.876 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.876 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.876 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.877 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.877 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.877 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.877 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.877 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.878 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.878 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.878 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.878 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.878 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.879 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.879 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.879 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.879 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.879 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.880 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.880 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.880 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.880 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.880 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.881 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.881 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.881 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.881 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.881 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.881 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.882 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.882 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.882 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.882 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.882 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.883 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.883 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.883 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.883 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.883 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.884 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.884 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.884 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.884 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.884 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.885 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.885 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.885 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.885 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.885 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.885 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.886 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.886 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.886 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.886 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.886 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.887 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.887 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.887 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.887 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.887 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.888 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.888 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.888 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.888 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.888 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.888 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.889 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.889 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.889 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.889 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.889 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.890 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.890 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.890 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.890 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.890 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.891 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.891 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.891 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.891 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.891 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.892 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.892 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.892 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.892 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.892 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.893 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.893 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.893 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.893 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.893 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.894 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.894 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.894 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.894 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.894 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.895 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.895 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.895 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.895 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.895 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.895 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.896 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.896 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.896 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.896 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.896 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.897 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.897 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.897 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.897 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.897 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.898 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.898 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.898 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.898 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.898 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.899 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.899 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.899 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.899 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.899 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.900 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.900 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.900 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.900 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.900 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.900 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.901 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.901 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.901 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.901 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.901 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.902 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.902 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.902 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.902 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.902 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.903 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.903 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.903 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.903 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.903 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.904 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.904 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.904 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.904 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.904 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.904 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.905 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.905 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.905 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.905 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.905 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.906 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.906 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.906 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.906 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.906 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.907 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.907 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.907 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.907 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.907 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.908 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.908 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.908 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.908 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.908 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.908 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.909 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.909 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.909 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.909 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.909 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.910 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.910 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.910 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.910 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.910 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.911 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.911 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.911 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.911 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.911 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.911 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.913 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.913 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.913 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.913 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.913 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.914 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.914 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.914 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.914 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.914 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.915 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.915 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.915 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.915 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.915 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.915 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.916 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.916 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.916 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.916 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.916 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.917 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.917 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.917 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.917 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.917 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.918 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.918 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.918 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.918 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.918 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.919 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.919 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.919 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.919 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.919 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.919 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.920 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.920 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.920 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.920 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.920 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.921 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.921 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.921 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.921 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.921 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.922 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.922 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.922 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.922 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.922 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.923 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.923 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.923 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.923 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.923 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.924 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.924 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.924 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.924 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.924 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.924 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.925 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.925 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.925 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.925 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.925 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.926 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.926 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.926 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.926 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.926 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.927 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.927 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.927 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.927 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.927 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.928 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.928 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.928 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.928 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.928 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.929 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.929 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.929 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.929 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.929 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.929 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.930 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.930 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.930 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.930 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-09-12T22:53:33.930 INFO:teuthology.orchestra.run.smithi112.stdout: +/tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.931 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-09-12T22:53:33.931 INFO:teuthology.orchestra.run.smithi112.stdout: +/tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.931 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.931 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.931 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.932 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.932 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.932 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.932 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.932 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.932 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.933 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.933 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.933 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf' 2023-09-12T22:53:33.933 INFO:teuthology.orchestra.run.smithi112.stdout: +: No such file or directory 2023-09-12T22:53:33.933 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.934 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.934 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.934 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.934 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.934 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.935 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.935 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.935 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.935 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.935 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.936 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.936 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.936 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.936 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.936 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.936 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.937 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.937 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.937 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.937 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.937 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.938 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.938 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.938 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.938 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.938 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.939 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.939 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.939 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.939 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.939 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.940 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.940 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.940 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.940 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.940 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.940 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.941 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.941 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.941 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.941 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.941 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.942 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.942 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.942 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.942 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.942 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.943 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.943 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.943 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.943 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.943 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.944 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.944 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.944 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.944 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.944 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.944 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.945 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.945 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.945 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.945 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.945 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.946 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.946 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.946 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.946 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.946 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.947 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.947 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.947 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.947 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.947 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.948 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.948 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.948 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.948 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.948 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.948 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.949 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.949 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.949 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.949 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.949 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.950 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.950 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.950 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.950 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.950 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.951 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.951 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.951 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.951 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.951 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.952 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.952 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.952 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.952 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.952 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.952 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.953 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.953 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.953 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.953 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.953 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.954 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.954 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.954 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.954 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.954 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.955 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.955 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.955 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.955 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.955 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.956 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.956 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.956 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.956 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.956 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.956 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.957 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.957 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.957 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.957 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted./tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.957 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.958 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.958 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.958 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.958 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.958 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.959 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.959 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.959 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.959 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.959 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.960 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.960 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.960 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.960 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.960 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.961 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.961 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.961 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.961 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.961 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.961 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.962 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.962 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.962 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.962 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.962 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.963 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.963 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.963 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.963 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.963 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.964 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.964 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.964 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.964 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.964 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.964 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.965 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.965 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.965 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.965 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.965 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.966 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.966 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.966 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.966 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.966 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.967 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.967 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.967 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.967 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.967 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.968 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.968 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.968 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.968 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.968 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.969 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.969 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.969 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.969 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.969 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.970 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.970 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.970 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.970 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.970 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.971 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.971 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.971 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: touch: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted.cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf' 2023-09-12T22:53:33.971 INFO:teuthology.orchestra.run.smithi112.stdout: +: No such file or directory 2023-09-12T22:53:33.971 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.972 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.972 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.972 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.972 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.972 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.972 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.973 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.973 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.973 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.973 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.973 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.974 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.974 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.974 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.974 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.974 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.975 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.975 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.975 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf' 2023-09-12T22:53:33.975 INFO:teuthology.orchestra.run.smithi112.stdout: +: No such file or directory 2023-09-12T22:53:33.975 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.976 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.976 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.976 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.976 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.976 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.976 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.977 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.977 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.977 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.977 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.977 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.978 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted./tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.978 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:33.978 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.978 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.978 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf' 2023-09-12T22:53:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: +: No such file or directory 2023-09-12T22:53:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf' 2023-09-12T22:53:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: +: No such file or directory 2023-09-12T22:53:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged4/etc/access.conf': No such file or directory 2023-09-12T22:53:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged4: not mounted. 2023-09-12T22:53:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: /tmp/tmp.IcsVAEpwo7scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged3/etc/access.conf': No such file or directory 2023-09-12T22:53:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged2/etc/access.conf': No such file or directory 2023-09-12T22:53:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged5/etc/access.conf': No such file or directory 2023-09-12T22:53:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged3: not mounted. 2023-09-12T22:53:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged2: not mounted. 2023-09-12T22:53:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged5: not mounted. 2023-09-12T22:53:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: +mount: mount: /tmp/tmp.IcsVAEpwo7scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.IcsVAEpwo7scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-12T22:53:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: + 2023-09-12T22:53:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: +mv: cannot stat '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged1/etc/access.conf': No such file or directory 2023-09-12T22:53:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: +touch: cannot touch '/tmp/tmp.IcsVAEpwo7scratch/merged0/etc/access.conf': No such file or directory 2023-09-12T22:53:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged1: not mounted. 2023-09-12T22:53:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: +umount: /tmp/tmp.IcsVAEpwo7scratch/merged0: not mounted. 2023-09-12T22:53:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: Silence is golden. 2023-09-12T22:53:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:34.013 INFO:teuthology.orchestra.run.smithi112.stdout:HINT: You _MAY_ be missing kernel fix: 2023-09-12T22:53:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: 6da1b4b1ab36 xfs: fix an ABBA deadlock in xfs_rename 2023-09-12T22:53:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:34.014 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/631 2023-09-12T22:53:34.014 INFO:teuthology.orchestra.run.smithi112.stdout:Failures: generic/631 2023-09-12T22:53:34.014 INFO:teuthology.orchestra.run.smithi112.stdout:Failed 1 of 1 tests 2023-09-12T22:53:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:34.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-12T22:53:34.016 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-12T22:53:34.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-12T22:53:34.017 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-09-12T22:53:34.480 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:53:34.493 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:53:34.494 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:53:34.496 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:53:34.496 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:36.479 INFO:teuthology.orchestra.run.smithi112.stdout:generic/632 2s 2023-09-12T22:53:36.493 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/632 2023-09-12T22:53:36.493 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:53:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:36.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:53:36.548 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-09-12T22:53:37.007 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:53:37.020 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:53:37.021 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:53:37.023 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:53:37.024 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:38.659 INFO:teuthology.orchestra.run.smithi112.stdout:generic/633 1s 2023-09-12T22:53:38.672 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/633 2023-09-12T22:53:38.672 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:53:38.678 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:38.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:53:38.848 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-09-12T22:53:39.557 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:53:39.569 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:53:39.570 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:53:39.573 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:53:39.573 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:41.065 INFO:teuthology.orchestra.run.smithi112.stdout:generic/634 2s 2023-09-12T22:53:41.078 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/634 2023-09-12T22:53:41.081 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:53:41.085 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:41.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:53:41.106 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-09-12T22:53:41.568 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:53:41.580 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:53:41.581 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:53:41.584 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:53:41.584 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:42.274 INFO:teuthology.orchestra.run.smithi112.stdout:generic/635 [not run] ceph does not support shutdown 2023-09-12T22:53:42.303 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/635 2023-09-12T22:53:42.303 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/635 2023-09-12T22:53:42.303 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:53:42.309 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:42.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:53:42.351 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-09-12T22:53:42.806 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:53:42.819 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:53:42.820 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:53:42.822 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:53:42.823 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:43.575 INFO:teuthology.orchestra.run.smithi112.stdout:generic/636 [not run] swapfiles are not supported 2023-09-12T22:53:43.585 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/636 2023-09-12T22:53:43.585 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/636 2023-09-12T22:53:43.586 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:53:43.591 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:43.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:53:43.638 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-09-12T22:53:44.093 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:53:44.105 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:53:44.106 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:53:44.109 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:53:44.109 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:45.044 INFO:teuthology.orchestra.run.smithi112.stdout:generic/637 1s 2023-09-12T22:53:45.057 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/637 2023-09-12T22:53:45.057 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:53:45.063 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:45.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:53:45.379 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-09-12T22:53:45.896 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:53:45.908 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:53:45.910 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:53:45.912 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:53:45.912 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:46.510 INFO:teuthology.orchestra.run.smithi112.stdout:generic/638 0s 2023-09-12T22:53:46.524 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/638 2023-09-12T22:53:46.524 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:53:46.529 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:46.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:53:46.583 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-09-12T22:53:47.033 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:53:47.046 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:53:47.047 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:53:47.050 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:53:47.050 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:47.753 INFO:teuthology.orchestra.run.smithi112.stdout:generic/639 0s 2023-09-12T22:53:47.766 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/639 2023-09-12T22:53:47.766 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:53:47.772 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:47.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:53:47.823 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-09-12T22:53:48.276 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:53:48.289 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:53:48.290 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:53:48.292 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:53:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:48.825 INFO:teuthology.orchestra.run.smithi112.stdout:generic/640 [not run] require 172.21.15.112:6789:/scratch to be valid block disk 2023-09-12T22:53:48.834 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/640 2023-09-12T22:53:48.835 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/640 2023-09-12T22:53:48.835 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:53:48.841 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:48.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:53:48.880 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-09-12T22:53:49.348 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:53:49.361 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:53:49.362 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:53:49.365 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:53:49.365 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:50.143 INFO:teuthology.orchestra.run.smithi112.stdout:generic/641 [not run] swapfiles are not supported 2023-09-12T22:53:50.153 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/641 2023-09-12T22:53:50.153 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/641 2023-09-12T22:53:50.153 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T22:53:50.159 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:50.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T22:53:50.204 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-09-12T22:53:50.657 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T22:53:50.670 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T22:53:50.671 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T22:53:50.674 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T22:53:50.674 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T22:53:53.242 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:53:53.248 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:54:23.366 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:54:23.372 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:54:53.472 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:54:53.481 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:55:24.630 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:55:24.635 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:55:54.786 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:55:54.792 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:56:26.051 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:56:26.057 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T22:56:26.210 INFO:tasks.ceph.mds.a.smithi112.stderr:2023-09-12T22:56:26.209+0000 7fc85dff9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 682552) UID: 0 2023-09-12T22:56:26.211 INFO:tasks.ceph.mds.c.smithi112.stderr:2023-09-12T22:56:26.210+0000 7f35a2bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 682552) UID: 0 2023-09-12T23:00:01.372 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:00:01.378 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:00:01.487 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T23:00:01.487+0000 7f05c55f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138188) UID: 0 2023-09-12T23:00:01.488 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T23:00:01.487+0000 7fd0eedf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138188) UID: 0 2023-09-12T23:00:01.489 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T23:00:01.487+0000 7f2623ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138188) UID: 0 2023-09-12T23:00:01.489 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T23:00:01.487+0000 7f858dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138188) UID: 0 2023-09-12T23:03:00.020 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:03:00.027 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:03:01.690 INFO:tasks.ceph.mds.a.smithi112.stderr:2023-09-12T23:03:01.689+0000 7fc85dff9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 682670) UID: 0 2023-09-12T23:03:01.690 INFO:tasks.ceph.mds.c.smithi112.stderr:2023-09-12T23:03:01.689+0000 7f35a2bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 682670) UID: 0 2023-09-12T23:03:26.941 INFO:teuthology.orchestra.run.smithi112.stdout:generic/642 576s 2023-09-12T23:03:26.956 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/642 2023-09-12T23:03:26.956 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T23:03:26.962 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T23:03:26.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T23:03:26.986 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-09-12T23:03:30.287 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T23:03:30.300 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T23:03:30.302 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T23:03:30.304 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T23:03:30.305 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T23:07:15.850 INFO:teuthology.orchestra.run.smithi112.stdout:generic/643 [not run] swapfiles are not supported 2023-09-12T23:07:15.869 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/643 2023-09-12T23:07:15.869 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/643 2023-09-12T23:07:15.870 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T23:07:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T23:07:15.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T23:07:15.924 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-09-12T23:07:16.435 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T23:07:16.448 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T23:07:16.449 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T23:07:16.452 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T23:07:16.452 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T23:07:17.140 INFO:teuthology.orchestra.run.smithi112.stdout:generic/644 1s 2023-09-12T23:07:17.153 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/644 2023-09-12T23:07:17.153 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T23:07:17.159 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T23:07:17.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T23:07:17.336 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-09-12T23:07:17.926 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:07:17.932 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:07:17.951 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T23:07:17.963 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T23:07:17.965 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T23:07:17.967 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T23:07:17.968 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T23:07:48.116 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:07:48.122 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:08:18.258 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:08:18.271 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:08:18.305 INFO:teuthology.orchestra.run.smithi112.stdout:generic/645 60s 2023-09-12T23:08:18.342 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/645 2023-09-12T23:08:18.342 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T23:08:18.360 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T23:08:18.463 INFO:tasks.ceph.mds.a.smithi112.stderr:2023-09-12T23:08:18.461+0000 7fc85dff9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 684335) UID: 0 2023-09-12T23:08:18.467 INFO:tasks.ceph.mds.c.smithi112.stderr:2023-09-12T23:08:18.464+0000 7f35a2bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 684335) UID: 0 2023-09-12T23:08:18.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T23:08:18.503 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-09-12T23:08:19.104 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T23:08:19.116 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T23:08:19.117 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T23:08:19.120 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T23:08:19.120 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T23:08:19.822 INFO:teuthology.orchestra.run.smithi112.stdout:generic/646 [not run] ceph does not support shutdown 2023-09-12T23:08:19.849 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/646 2023-09-12T23:08:19.849 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/646 2023-09-12T23:08:19.849 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T23:08:19.855 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T23:08:19.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T23:08:19.907 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-09-12T23:08:20.363 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T23:08:20.376 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T23:08:20.377 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T23:08:20.380 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T23:08:20.380 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T23:08:21.177 INFO:teuthology.orchestra.run.smithi112.stdout:generic/647 1s 2023-09-12T23:08:21.191 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/647 2023-09-12T23:08:21.191 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T23:08:21.197 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T23:08:21.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T23:08:21.348 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-09-12T23:08:22.064 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T23:08:22.077 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T23:08:22.078 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T23:08:22.080 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T23:08:22.080 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T23:08:23.189 INFO:teuthology.orchestra.run.smithi112.stdout:generic/648 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-12T23:08:23.237 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/648 2023-09-12T23:08:23.237 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/648 2023-09-12T23:08:23.238 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T23:08:23.247 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T23:08:23.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T23:08:23.309 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-09-12T23:08:23.769 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T23:08:23.782 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T23:08:23.783 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T23:08:23.785 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T23:08:23.785 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T23:08:24.396 INFO:teuthology.orchestra.run.smithi112.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph 2023-09-12T23:08:24.405 INFO:teuthology.orchestra.run.smithi112.stdout:Ran: generic/649 2023-09-12T23:08:24.406 INFO:teuthology.orchestra.run.smithi112.stdout:Not run: generic/649 2023-09-12T23:08:24.406 INFO:teuthology.orchestra.run.smithi112.stdout:Passed all 1 tests 2023-09-12T23:08:24.411 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T23:08:24.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-12T23:08:24.589 DEBUG:teuthology.orchestra.run.smithi112:> (cd /tmp/tmp.X1XCSigEoUxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-09-12T23:08:25.286 INFO:teuthology.orchestra.run.smithi112.stdout:FSTYP -- ceph 2023-09-12T23:08:25.298 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM -- Linux/x86_64 smithi112 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-09-12T23:08:25.299 INFO:teuthology.orchestra.run.smithi112.stdout:MKFS_OPTIONS -- 172.21.15.112:6789:/scratch 2023-09-12T23:08:25.301 INFO:teuthology.orchestra.run.smithi112.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBjjABloNDMJRAAi8PVuCy+aTW6CEp+qDcANg== -o context=system_u:object_r:root_t:s0 172.21.15.112:6789:/scratch /tmp/tmp.IcsVAEpwo7scratch 2023-09-12T23:08:25.301 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T23:08:53.598 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T23:08:53.588+0000 7f1949feb700 -1 bdev(0x55b1883f4380 /var/lib/ceph/osd/ceph-0/block) _sync_write pwritev error: (5) Input/output error 2023-09-12T23:08:53.617 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T23:08:53.608+0000 7f19507f8700 -1 bdev(0x55b1883f4380 /var/lib/ceph/osd/ceph-0/block) _aio_thread got r=-5 ((5) Input/output error) 2023-09-12T23:08:53.650 INFO:tasks.ceph.osd.0.smithi112.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6088-g2110e007/rpm/el8/BUILD/ceph-18.0.0-6088-g2110e007/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f19507f8700 time 2023-09-12T23:08:53.633866+0000 2023-09-12T23:08:53.650 INFO:tasks.ceph.osd.0.smithi112.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6088-g2110e007/rpm/el8/BUILD/ceph-18.0.0-6088-g2110e007/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-09-12T23:08:53.656 INFO:tasks.ceph.osd.0.smithi112.stderr: ceph version 18.0.0-6088-g2110e007 (2110e00747b31a0d73768c9e5229da18b26b8aa0) reef (dev) 2023-09-12T23:08:53.656 INFO:tasks.ceph.osd.0.smithi112.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55b183f64d4f] 2023-09-12T23:08:53.657 INFO:tasks.ceph.osd.0.smithi112.stderr: 2: (KernelDevice::_aio_thread()+0x1686) [0x55b184ba1fd6] 2023-09-12T23:08:53.657 INFO:tasks.ceph.osd.0.smithi112.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55b184ba79f1] 2023-09-12T23:08:53.657 INFO:tasks.ceph.osd.0.smithi112.stderr: 4: /lib64/libpthread.so.0(+0x81ca) [0x7f19674081ca] 2023-09-12T23:08:53.657 INFO:tasks.ceph.osd.0.smithi112.stderr: 5: clone() 2023-09-12T23:08:53.663 INFO:tasks.ceph.osd.0.smithi112.stderr:*** Caught signal (Aborted) ** 2023-09-12T23:08:53.663 INFO:tasks.ceph.osd.0.smithi112.stderr: in thread 7f19507f8700 thread_name:bstore_aio 2023-09-12T23:08:53.665 INFO:tasks.ceph.osd.0.smithi112.stderr: ceph version 18.0.0-6088-g2110e007 (2110e00747b31a0d73768c9e5229da18b26b8aa0) reef (dev) 2023-09-12T23:08:53.665 INFO:tasks.ceph.osd.0.smithi112.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f1967412cf0] 2023-09-12T23:08:53.665 INFO:tasks.ceph.osd.0.smithi112.stderr: 2: gsignal() 2023-09-12T23:08:53.666 INFO:tasks.ceph.osd.0.smithi112.stderr: 3: abort() 2023-09-12T23:08:53.666 INFO:tasks.ceph.osd.0.smithi112.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x55b183f64e0f] 2023-09-12T23:08:53.666 INFO:tasks.ceph.osd.0.smithi112.stderr: 5: (KernelDevice::_aio_thread()+0x1686) [0x55b184ba1fd6] 2023-09-12T23:08:53.666 INFO:tasks.ceph.osd.0.smithi112.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55b184ba79f1] 2023-09-12T23:08:53.667 INFO:tasks.ceph.osd.0.smithi112.stderr: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f19674081ca] 2023-09-12T23:08:53.667 INFO:tasks.ceph.osd.0.smithi112.stderr: 8: clone() 2023-09-12T23:08:53.669 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T23:08:53.656+0000 7f19507f8700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6088-g2110e007/rpm/el8/BUILD/ceph-18.0.0-6088-g2110e007/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f19507f8700 time 2023-09-12T23:08:53.633866+0000 2023-09-12T23:08:53.669 INFO:tasks.ceph.osd.0.smithi112.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6088-g2110e007/rpm/el8/BUILD/ceph-18.0.0-6088-g2110e007/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-09-12T23:08:53.669 INFO:tasks.ceph.osd.0.smithi112.stderr: 2023-09-12T23:08:53.670 INFO:tasks.ceph.osd.0.smithi112.stderr: ceph version 18.0.0-6088-g2110e007 (2110e00747b31a0d73768c9e5229da18b26b8aa0) reef (dev) 2023-09-12T23:08:53.670 INFO:tasks.ceph.osd.0.smithi112.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55b183f64d4f] 2023-09-12T23:08:53.670 INFO:tasks.ceph.osd.0.smithi112.stderr: 2: (KernelDevice::_aio_thread()+0x1686) [0x55b184ba1fd6] 2023-09-12T23:08:53.670 INFO:tasks.ceph.osd.0.smithi112.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55b184ba79f1] 2023-09-12T23:08:53.670 INFO:tasks.ceph.osd.0.smithi112.stderr: 4: /lib64/libpthread.so.0(+0x81ca) [0x7f19674081ca] 2023-09-12T23:08:53.671 INFO:tasks.ceph.osd.0.smithi112.stderr: 5: clone() 2023-09-12T23:08:53.671 INFO:tasks.ceph.osd.0.smithi112.stderr: 2023-09-12T23:08:53.674 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-09-12T23:08:53.673+0000 7f19507f8700 -1 *** Caught signal (Aborted) ** 2023-09-12T23:08:53.674 INFO:tasks.ceph.osd.0.smithi112.stderr: in thread 7f19507f8700 thread_name:bstore_aio 2023-09-12T23:08:53.674 INFO:tasks.ceph.osd.0.smithi112.stderr: 2023-09-12T23:08:53.675 INFO:tasks.ceph.osd.0.smithi112.stderr: ceph version 18.0.0-6088-g2110e007 (2110e00747b31a0d73768c9e5229da18b26b8aa0) reef (dev) 2023-09-12T23:08:53.675 INFO:tasks.ceph.osd.0.smithi112.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f1967412cf0] 2023-09-12T23:08:53.675 INFO:tasks.ceph.osd.0.smithi112.stderr: 2: gsignal() 2023-09-12T23:08:53.675 INFO:tasks.ceph.osd.0.smithi112.stderr: 3: abort() 2023-09-12T23:08:53.675 INFO:tasks.ceph.osd.0.smithi112.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x55b183f64e0f] 2023-09-12T23:08:53.676 INFO:tasks.ceph.osd.0.smithi112.stderr: 5: (KernelDevice::_aio_thread()+0x1686) [0x55b184ba1fd6] 2023-09-12T23:08:53.676 INFO:tasks.ceph.osd.0.smithi112.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55b184ba79f1] 2023-09-12T23:08:53.676 INFO:tasks.ceph.osd.0.smithi112.stderr: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f19674081ca] 2023-09-12T23:08:53.676 INFO:tasks.ceph.osd.0.smithi112.stderr: 8: clone() 2023-09-12T23:08:53.676 INFO:tasks.ceph.osd.0.smithi112.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-09-12T23:08:53.677 INFO:tasks.ceph.osd.0.smithi112.stderr: 2023-09-12T23:08:53.972 INFO:tasks.ceph.osd.0.smithi112.stderr: -147> 2023-09-12T23:08:53.588+0000 7f1949feb700 -1 bdev(0x55b1883f4380 /var/lib/ceph/osd/ceph-0/block) _sync_write pwritev error: (5) Input/output error 2023-09-12T23:08:53.972 INFO:tasks.ceph.osd.0.smithi112.stderr: -132> 2023-09-12T23:08:53.608+0000 7f19507f8700 -1 bdev(0x55b1883f4380 /var/lib/ceph/osd/ceph-0/block) _aio_thread got r=-5 ((5) Input/output error) 2023-09-12T23:08:53.972 INFO:tasks.ceph.osd.0.smithi112.stderr: -14> 2023-09-12T23:08:53.656+0000 7f19507f8700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6088-g2110e007/rpm/el8/BUILD/ceph-18.0.0-6088-g2110e007/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f19507f8700 time 2023-09-12T23:08:53.633866+0000 2023-09-12T23:08:53.973 INFO:tasks.ceph.osd.0.smithi112.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6088-g2110e007/rpm/el8/BUILD/ceph-18.0.0-6088-g2110e007/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-09-12T23:08:53.973 INFO:tasks.ceph.osd.0.smithi112.stderr: 2023-09-12T23:08:53.973 INFO:tasks.ceph.osd.0.smithi112.stderr: ceph version 18.0.0-6088-g2110e007 (2110e00747b31a0d73768c9e5229da18b26b8aa0) reef (dev) 2023-09-12T23:08:53.973 INFO:tasks.ceph.osd.0.smithi112.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55b183f64d4f] 2023-09-12T23:08:53.973 INFO:tasks.ceph.osd.0.smithi112.stderr: 2: (KernelDevice::_aio_thread()+0x1686) [0x55b184ba1fd6] 2023-09-12T23:08:53.974 INFO:tasks.ceph.osd.0.smithi112.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55b184ba79f1] 2023-09-12T23:08:53.974 INFO:tasks.ceph.osd.0.smithi112.stderr: 4: /lib64/libpthread.so.0(+0x81ca) [0x7f19674081ca] 2023-09-12T23:08:53.974 INFO:tasks.ceph.osd.0.smithi112.stderr: 5: clone() 2023-09-12T23:08:53.974 INFO:tasks.ceph.osd.0.smithi112.stderr: 2023-09-12T23:08:53.974 INFO:tasks.ceph.osd.0.smithi112.stderr: 0> 2023-09-12T23:08:53.673+0000 7f19507f8700 -1 *** Caught signal (Aborted) ** 2023-09-12T23:08:53.975 INFO:tasks.ceph.osd.0.smithi112.stderr: in thread 7f19507f8700 thread_name:bstore_aio 2023-09-12T23:08:53.975 INFO:tasks.ceph.osd.0.smithi112.stderr: 2023-09-12T23:08:53.975 INFO:tasks.ceph.osd.0.smithi112.stderr: ceph version 18.0.0-6088-g2110e007 (2110e00747b31a0d73768c9e5229da18b26b8aa0) reef (dev) 2023-09-12T23:08:53.975 INFO:tasks.ceph.osd.0.smithi112.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f1967412cf0] 2023-09-12T23:08:53.975 INFO:tasks.ceph.osd.0.smithi112.stderr: 2: gsignal() 2023-09-12T23:08:53.976 INFO:tasks.ceph.osd.0.smithi112.stderr: 3: abort() 2023-09-12T23:08:53.976 INFO:tasks.ceph.osd.0.smithi112.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x55b183f64e0f] 2023-09-12T23:08:53.976 INFO:tasks.ceph.osd.0.smithi112.stderr: 5: (KernelDevice::_aio_thread()+0x1686) [0x55b184ba1fd6] 2023-09-12T23:08:53.976 INFO:tasks.ceph.osd.0.smithi112.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55b184ba79f1] 2023-09-12T23:08:53.976 INFO:tasks.ceph.osd.0.smithi112.stderr: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f19674081ca] 2023-09-12T23:08:53.976 INFO:tasks.ceph.osd.0.smithi112.stderr: 8: clone() 2023-09-12T23:08:53.977 INFO:tasks.ceph.osd.0.smithi112.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-09-12T23:08:53.977 INFO:tasks.ceph.osd.0.smithi112.stderr: 2023-09-12T23:08:54.072 INFO:tasks.ceph.osd.0.smithi112.stderr: -908> 2023-09-12T23:08:53.588+0000 7f1949feb700 -1 bdev(0x55b1883f4380 /var/lib/ceph/osd/ceph-0/block) _sync_write pwritev error: (5) Input/output error 2023-09-12T23:08:54.073 INFO:tasks.ceph.osd.0.smithi112.stderr: -893> 2023-09-12T23:08:53.608+0000 7f19507f8700 -1 bdev(0x55b1883f4380 /var/lib/ceph/osd/ceph-0/block) _aio_thread got r=-5 ((5) Input/output error) 2023-09-12T23:08:54.073 INFO:tasks.ceph.osd.0.smithi112.stderr: -775> 2023-09-12T23:08:53.656+0000 7f19507f8700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6088-g2110e007/rpm/el8/BUILD/ceph-18.0.0-6088-g2110e007/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f19507f8700 time 2023-09-12T23:08:53.633866+0000 2023-09-12T23:08:54.073 INFO:tasks.ceph.osd.0.smithi112.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6088-g2110e007/rpm/el8/BUILD/ceph-18.0.0-6088-g2110e007/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-09-12T23:08:54.074 INFO:tasks.ceph.osd.0.smithi112.stderr: 2023-09-12T23:08:54.074 INFO:tasks.ceph.osd.0.smithi112.stderr: ceph version 18.0.0-6088-g2110e007 (2110e00747b31a0d73768c9e5229da18b26b8aa0) reef (dev) 2023-09-12T23:08:54.074 INFO:tasks.ceph.osd.0.smithi112.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55b183f64d4f] 2023-09-12T23:08:54.074 INFO:tasks.ceph.osd.0.smithi112.stderr: 2: (KernelDevice::_aio_thread()+0x1686) [0x55b184ba1fd6] 2023-09-12T23:08:54.074 INFO:tasks.ceph.osd.0.smithi112.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55b184ba79f1] 2023-09-12T23:08:54.075 INFO:tasks.ceph.osd.0.smithi112.stderr: 4: /lib64/libpthread.so.0(+0x81ca) [0x7f19674081ca] 2023-09-12T23:08:54.075 INFO:tasks.ceph.osd.0.smithi112.stderr: 5: clone() 2023-09-12T23:08:54.075 INFO:tasks.ceph.osd.0.smithi112.stderr: 2023-09-12T23:08:54.075 INFO:tasks.ceph.osd.0.smithi112.stderr: -761> 2023-09-12T23:08:53.673+0000 7f19507f8700 -1 *** Caught signal (Aborted) ** 2023-09-12T23:08:54.076 INFO:tasks.ceph.osd.0.smithi112.stderr: in thread 7f19507f8700 thread_name:bstore_aio 2023-09-12T23:08:54.076 INFO:tasks.ceph.osd.0.smithi112.stderr: 2023-09-12T23:08:54.076 INFO:tasks.ceph.osd.0.smithi112.stderr: ceph version 18.0.0-6088-g2110e007 (2110e00747b31a0d73768c9e5229da18b26b8aa0) reef (dev) 2023-09-12T23:08:54.076 INFO:tasks.ceph.osd.0.smithi112.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f1967412cf0] 2023-09-12T23:08:54.076 INFO:tasks.ceph.osd.0.smithi112.stderr: 2: gsignal() 2023-09-12T23:08:54.077 INFO:tasks.ceph.osd.0.smithi112.stderr: 3: abort() 2023-09-12T23:08:54.077 INFO:tasks.ceph.osd.0.smithi112.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x55b183f64e0f] 2023-09-12T23:08:54.077 INFO:tasks.ceph.osd.0.smithi112.stderr: 5: (KernelDevice::_aio_thread()+0x1686) [0x55b184ba1fd6] 2023-09-12T23:08:54.077 INFO:tasks.ceph.osd.0.smithi112.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55b184ba79f1] 2023-09-12T23:08:54.077 INFO:tasks.ceph.osd.0.smithi112.stderr: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f19674081ca] 2023-09-12T23:08:54.078 INFO:tasks.ceph.osd.0.smithi112.stderr: 8: clone() 2023-09-12T23:08:54.078 INFO:tasks.ceph.osd.0.smithi112.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-09-12T23:08:54.078 INFO:tasks.ceph.osd.0.smithi112.stderr: 2023-09-12T23:08:55.651 INFO:tasks.ceph.osd.0.smithi112.stderr:daemon-helper: command failed with exit status 5 2023-09-12T23:09:03.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-09-12T23:09:10.152 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~7s 2023-09-12T23:09:16.764 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~13s 2023-09-12T23:09:23.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~20s 2023-09-12T23:09:29.990 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~26s 2023-09-12T23:09:36.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~33s 2023-09-12T23:09:43.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~40s 2023-09-12T23:09:49.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~46s 2023-09-12T23:09:56.440 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~53s 2023-09-12T23:10:03.052 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~60s 2023-09-12T23:10:09.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~66s 2023-09-12T23:10:16.277 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~73s 2023-09-12T23:10:22.889 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~79s 2023-09-12T23:10:29.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~86s 2023-09-12T23:10:36.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~93s 2023-09-12T23:10:42.726 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~99s 2023-09-12T23:10:49.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~106s 2023-09-12T23:10:55.954 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~112s 2023-09-12T23:11:02.568 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~119s 2023-09-12T23:11:09.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~126s 2023-09-12T23:11:15.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~132s 2023-09-12T23:11:22.404 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~139s 2023-09-12T23:11:29.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~146s 2023-09-12T23:11:35.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~152s 2023-09-12T23:11:42.242 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~159s 2023-09-12T23:11:48.855 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~165s 2023-09-12T23:11:55.467 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~172s 2023-09-12T23:12:02.079 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~179s 2023-09-12T23:12:08.692 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~185s 2023-09-12T23:12:15.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~192s 2023-09-12T23:12:21.917 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~198s 2023-09-12T23:12:28.530 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~205s 2023-09-12T23:12:35.143 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~212s 2023-09-12T23:12:36.310 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:12:36.316 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:12:36.439 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T23:12:36.438+0000 7f05c55f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138627) UID: 0 2023-09-12T23:12:36.439 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T23:12:36.438+0000 7fd0eedf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138627) UID: 0 2023-09-12T23:12:36.440 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T23:12:36.438+0000 7f2623ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138627) UID: 0 2023-09-12T23:12:36.440 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T23:12:36.438+0000 7f858dbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138627) UID: 0 2023-09-12T23:12:41.755 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~218s 2023-09-12T23:12:48.368 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~225s 2023-09-12T23:12:54.980 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~231s 2023-09-12T23:13:01.593 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~238s 2023-09-12T23:13:08.205 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~245s 2023-09-12T23:13:14.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~251s 2023-09-12T23:13:21.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~258s 2023-09-12T23:13:28.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~265s 2023-09-12T23:13:34.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~271s 2023-09-12T23:13:41.267 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~278s 2023-09-12T23:13:47.880 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~284s 2023-09-12T23:13:54.492 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~291s 2023-09-12T23:14:01.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~298s 2023-09-12T23:14:07.721 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~304s 2023-09-12T23:14:07.721 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-09-12T23:14:07.722 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T23:14:07.755 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T23:14:08.026 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T23:14:08.026 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T23:14:08.225 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-12T23:14:10.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.027+0000 7fbdb619d700 1 -- 172.21.15.112:0/1778631367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdb006e100 msgr2=0x7fbdb00aec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:10.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.027+0000 7fbdb619d700 1 --2- 172.21.15.112:0/1778631367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdb006e100 0x7fbdb00aec50 secure :-1 s=READY pgs=3014 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009f90 tx=0x7fbda800b330 comp rx=0 tx=0).stop 2023-09-12T23:14:10.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.027+0000 7fbdb619d700 1 -- 172.21.15.112:0/1778631367 shutdown_connections 2023-09-12T23:14:10.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.027+0000 7fbdb619d700 1 --2- 172.21.15.112:0/1778631367 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbdb00af190 0x7fbdb00c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:10.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.027+0000 7fbdb619d700 1 --2- 172.21.15.112:0/1778631367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdb006e100 0x7fbdb00aec50 unknown :-1 s=CLOSED pgs=3014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:10.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.027+0000 7fbdb619d700 1 -- 172.21.15.112:0/1778631367 >> 172.21.15.112:0/1778631367 conn(0x7fbdb00c9c50 msgr2=0x7fbdb00ca030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T23:14:10.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.035+0000 7fbdb619d700 1 -- 172.21.15.112:0/1778631367 shutdown_connections 2023-09-12T23:14:10.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.039+0000 7fbdb619d700 1 -- 172.21.15.112:0/1778631367 wait complete. 2023-09-12T23:14:10.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.046+0000 7fbdb619d700 1 Processor -- start 2023-09-12T23:14:10.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.047+0000 7fbdb619d700 1 -- start start 2023-09-12T23:14:10.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.050+0000 7fbdb619d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbdb006e100 0x7fbdb00c0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T23:14:10.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.051+0000 7fbdb619d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdb00af190 0x7fbdb00c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T23:14:10.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.051+0000 7fbdb619d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdb00c9740 0x7fbdb0098d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T23:14:10.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.051+0000 7fbdb519b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbdb006e100 0x7fbdb00c0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T23:14:10.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.052+0000 7fbdb519b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbdb006e100 0x7fbdb00c0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.112:46744/0 (socket says 172.21.15.112:46744) 2023-09-12T23:14:10.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.053+0000 7fbdb599c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdb00c9740 0x7fbdb0098d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T23:14:10.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.053+0000 7fbdb599c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdb00c9740 0x7fbdb0098d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48316/0 (socket says 172.21.15.112:48316) 2023-09-12T23:14:10.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.054+0000 7fbdb619d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb015ae50 con 0x7fbdb00c9740 2023-09-12T23:14:10.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.054+0000 7fbdb519b700 1 -- 172.21.15.112:0/3901051896 learned_addr learned my addr 172.21.15.112:0/3901051896 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T23:14:10.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.055+0000 7fbdb619d700 1 -- 172.21.15.112:0/3901051896 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb00c57e0 con 0x7fbdb00af190 2023-09-12T23:14:10.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.055+0000 7fbdb619d700 1 -- 172.21.15.112:0/3901051896 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb015a890 con 0x7fbdb006e100 2023-09-12T23:14:10.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.058+0000 7fbdb599c700 1 -- 172.21.15.112:0/3901051896 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbdb006e100 msgr2=0x7fbdb00c0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:10.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.058+0000 7fbdb599c700 1 --2- 172.21.15.112:0/3901051896 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbdb006e100 0x7fbdb00c0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:10.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.058+0000 7fbdb599c700 1 -- 172.21.15.112:0/3901051896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdb00af190 msgr2=0x7fbdb00c4510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-12T23:14:10.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.059+0000 7fbdb599c700 1 --2- 172.21.15.112:0/3901051896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdb00af190 0x7fbdb00c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:10.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.059+0000 7fbdb599c700 1 -- 172.21.15.112:0/3901051896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda8009c40 con 0x7fbdb00c9740 2023-09-12T23:14:10.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.060+0000 7fbdb599c700 1 --2- 172.21.15.112:0/3901051896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdb00c9740 0x7fbdb0098d50 secure :-1 s=READY pgs=3015 cs=0 l=1 rev1=1 crypto rx=0x7fbdac00d750 tx=0x7fbdac00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T23:14:10.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.062+0000 7fbda5ffb700 1 -- 172.21.15.112:0/3901051896 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac004220 con 0x7fbdb00c9740 2023-09-12T23:14:10.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.062+0000 7fbda5ffb700 1 -- 172.21.15.112:0/3901051896 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbdac004470 con 0x7fbdb00c9740 2023-09-12T23:14:10.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.062+0000 7fbda5ffb700 1 -- 172.21.15.112:0/3901051896 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac004a90 con 0x7fbdb00c9740 2023-09-12T23:14:10.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.062+0000 7fbdb619d700 1 -- 172.21.15.112:0/3901051896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb00c5a30 con 0x7fbdb00c9740 2023-09-12T23:14:10.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.063+0000 7fbdb619d700 1 -- 172.21.15.112:0/3901051896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb009a250 con 0x7fbdb00c9740 2023-09-12T23:14:10.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.069+0000 7fbdb619d700 1 -- 172.21.15.112:0/3901051896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd900052e0 con 0x7fbdb00c9740 2023-09-12T23:14:10.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.089+0000 7fbda5ffb700 1 -- 172.21.15.112:0/3901051896 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fbdac00f690 con 0x7fbdb00c9740 2023-09-12T23:14:10.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.091+0000 7fbda5ffb700 1 --2- 172.21.15.112:0/3901051896 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbd9406a650 0x7fbd9406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T23:14:10.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.091+0000 7fbda5ffb700 1 -- 172.21.15.112:0/3901051896 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbdac0892d0 con 0x7fbdb00c9740 2023-09-12T23:14:10.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.099+0000 7fbdb519b700 1 --2- 172.21.15.112:0/3901051896 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbd9406a650 0x7fbd9406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T23:14:10.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.101+0000 7fbdb519b700 1 --2- 172.21.15.112:0/3901051896 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbd9406a650 0x7fbd9406cb10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fbda0004740 tx=0x7fbda0001120 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T23:14:10.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.115+0000 7fbda5ffb700 1 -- 172.21.15.112:0/3901051896 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fbdac054760 con 0x7fbdb00c9740 2023-09-12T23:14:10.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.611+0000 7fbdb619d700 1 -- 172.21.15.112:0/3901051896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd90005150 con 0x7fbdb00c9740 2023-09-12T23:14:10.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.613+0000 7fbda5ffb700 1 -- 172.21.15.112:0/3901051896 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16994 (secure 0 0 0) 0x7fbdac005c20 con 0x7fbdb00c9740 2023-09-12T23:14:10.616 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-09-12T23:14:10.617 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":42,"fsid":"81d9ebed-ec6c-4564-a5d4-cdbd74c977f8","created":"2023-09-12T16:06:33.923989+0000","modified":"2023-09-12T23:08:56.489687+0000","last_up_change":"2023-09-12T23:08:55.436075+0000","last_in_change":"2023-09-12T16:06:39.066319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-12T16:06:48.871680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.690000057220459,"score_stable":7.690000057220459,"optimal_score":0.12999999523162842,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-12T16:08:30.428559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.2400000095367432,"score_stable":1.2400000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.0900000333786011,"raw_score_stable":1.0900000333786011,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-12T16:08:31.564145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6100000143051147,"score_stable":1.6100000143051147,"optimal_score":0.87999999523162842,"raw_score_acting":1.4199999570846558,"raw_score_stable":1.4199999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26d92e63-11c1-4be7-84c0-b5973546558a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":41,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6809","nonce":3024311046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6811","nonce":3024311046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6815","nonce":3024311046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3024311046},{"type":"v1","addr":"172.21.15.112:6813","nonce":3024311046}]},"public_addr":"172.21.15.112:6809/3024311046","cluster_addr":"172.21.15.112:6811/3024311046","heartbeat_back_addr":"172.21.15.112:6815/3024311046","heartbeat_front_addr":"172.21.15.112:6813/3024311046","state":["exists"]},{"osd":1,"uuid":"24385b53-0ebf-442a-9a0b-87541ddb2f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6801","nonce":3868819689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6803","nonce":3868819689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6807","nonce":3868819689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3868819689},{"type":"v1","addr":"172.21.15.112:6805","nonce":3868819689}]},"public_addr":"172.21.15.112:6801/3868819689","cluster_addr":"172.21.15.112:6803/3868819689","heartbeat_back_addr":"172.21.15.112:6807/3868819689","heartbeat_front_addr":"172.21.15.112:6805/3868819689","state":["exists","up"]},{"osd":2,"uuid":"1fd88ecf-11ea-4529-8850-b27f84ae1b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6817","nonce":3849733449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6819","nonce":3849733449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6823","nonce":3849733449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3849733449},{"type":"v1","addr":"172.21.15.112:6821","nonce":3849733449}]},"public_addr":"172.21.15.112:6817/3849733449","cluster_addr":"172.21.15.112:6819/3849733449","heartbeat_back_addr":"172.21.15.112:6823/3849733449","heartbeat_front_addr":"172.21.15.112:6821/3849733449","state":["exists","up"]},{"osd":3,"uuid":"4cf53ec1-9e6a-4054-9619-68a7d74fbabc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6825","nonce":2420650766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6827","nonce":2420650766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6831","nonce":2420650766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2420650766},{"type":"v1","addr":"172.21.15.112:6829","nonce":2420650766}]},"public_addr":"172.21.15.112:6825/2420650766","cluster_addr":"172.21.15.112:6827/2420650766","heartbeat_back_addr":"172.21.15.112:6831/2420650766","heartbeat_front_addr":"172.21.15.112:6829/2420650766","state":["exists","up"]},{"osd":4,"uuid":"b77bd503-67d8-4f01-ba08-66933e090370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6807","nonce":490270140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6811","nonce":490270140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6815","nonce":490270140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":490270140},{"type":"v1","addr":"172.21.15.144:6813","nonce":490270140}]},"public_addr":"172.21.15.144:6807/490270140","cluster_addr":"172.21.15.144:6811/490270140","heartbeat_back_addr":"172.21.15.144:6815/490270140","heartbeat_front_addr":"172.21.15.144:6813/490270140","state":["exists","up"]},{"osd":5,"uuid":"01c2b3dd-58b5-48f0-99d4-384140635112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6801","nonce":498990310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6803","nonce":498990310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6810","nonce":498990310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":498990310},{"type":"v1","addr":"172.21.15.144:6806","nonce":498990310}]},"public_addr":"172.21.15.144:6801/498990310","cluster_addr":"172.21.15.144:6803/498990310","heartbeat_back_addr":"172.21.15.144:6810/498990310","heartbeat_front_addr":"172.21.15.144:6806/498990310","state":["exists","up"]},{"osd":6,"uuid":"87add6c2-cd9d-4f27-9b2e-a0f3e0b85c6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6825","nonce":2931281424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6827","nonce":2931281424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6831","nonce":2931281424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2931281424},{"type":"v1","addr":"172.21.15.144:6829","nonce":2931281424}]},"public_addr":"172.21.15.144:6825/2931281424","cluster_addr":"172.21.15.144:6827/2931281424","heartbeat_back_addr":"172.21.15.144:6831/2931281424","heartbeat_front_addr":"172.21.15.144:6829/2931281424","state":["exists","up"]},{"osd":7,"uuid":"ceb9c8b6-6fd8-4cc4-a4b6-a196b77c9545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6817","nonce":4212271840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6819","nonce":4212271840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6823","nonce":4212271840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4212271840},{"type":"v1","addr":"172.21.15.144:6821","nonce":4212271840}]},"public_addr":"172.21.15.144:6817/4212271840","cluster_addr":"172.21.15.144:6819/4212271840","heartbeat_back_addr":"172.21.15.144:6823/4212271840","heartbeat_front_addr":"172.21.15.144:6821/4212271840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.345503+0000","dead_epoch":41},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.194769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.445502+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.667472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.365161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.446236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.684833+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-12T16:06:44.643309+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.7","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-12T23:14:10.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.619+0000 7fbd9b7fe700 1 -- 172.21.15.112:0/3901051896 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbd9406a650 msgr2=0x7fbd9406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:10.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.619+0000 7fbd9b7fe700 1 --2- 172.21.15.112:0/3901051896 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbd9406a650 0x7fbd9406cb10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fbda0004740 tx=0x7fbda0001120 comp rx=0 tx=0).stop 2023-09-12T23:14:10.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.619+0000 7fbd9b7fe700 1 -- 172.21.15.112:0/3901051896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdb00c9740 msgr2=0x7fbdb0098d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:10.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.619+0000 7fbd9b7fe700 1 --2- 172.21.15.112:0/3901051896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdb00c9740 0x7fbdb0098d50 secure :-1 s=READY pgs=3015 cs=0 l=1 rev1=1 crypto rx=0x7fbdac00d750 tx=0x7fbdac00da60 comp rx=0 tx=0).stop 2023-09-12T23:14:10.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.620+0000 7fbd9b7fe700 1 -- 172.21.15.112:0/3901051896 shutdown_connections 2023-09-12T23:14:10.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.620+0000 7fbd9b7fe700 1 --2- 172.21.15.112:0/3901051896 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fbd9406a650 0x7fbd9406cb10 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:10.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.620+0000 7fbd9b7fe700 1 --2- 172.21.15.112:0/3901051896 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbdb006e100 0x7fbdb00c0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:10.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.620+0000 7fbd9b7fe700 1 --2- 172.21.15.112:0/3901051896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdb00c9740 0x7fbdb0098d50 unknown :-1 s=CLOSED pgs=3015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:10.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.620+0000 7fbd9b7fe700 1 --2- 172.21.15.112:0/3901051896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdb00af190 0x7fbdb00c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:10.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.620+0000 7fbd9b7fe700 1 -- 172.21.15.112:0/3901051896 >> 172.21.15.112:0/3901051896 conn(0x7fbdb00c9c50 msgr2=0x7fbdb0070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T23:14:10.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.622+0000 7fbd9b7fe700 1 -- 172.21.15.112:0/3901051896 shutdown_connections 2023-09-12T23:14:10.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:10.622+0000 7fbd9b7fe700 1 -- 172.21.15.112:0/3901051896 wait complete. 2023-09-12T23:14:10.654 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-12T16:06:48.871680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 7.690000057220459, 'score_stable': 7.690000057220459, 'optimal_score': 0.12999999523162842, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-12T16:08:30.428559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.2400000095367432, 'score_stable': 1.2400000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.090000033378601, 'raw_score_stable': 1.090000033378601, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-09-12T16:08:31.564145+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6100000143051147, 'score_stable': 1.6100000143051147, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.4199999570846558, 'raw_score_stable': 1.4199999570846558, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-12T23:14:10.655 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-12T23:14:11.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.460+0000 7f5024fff700 1 -- 172.21.15.112:0/3217835093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50180e3290 msgr2=0x7f5018053960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:11.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.460+0000 7f5024fff700 1 --2- 172.21.15.112:0/3217835093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50180e3290 0x7f5018053960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5020068510 tx=0x7f502004ea00 comp rx=0 tx=0).stop 2023-09-12T23:14:11.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.464+0000 7f5024fff700 1 -- 172.21.15.112:0/3217835093 shutdown_connections 2023-09-12T23:14:11.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.464+0000 7f5024fff700 1 --2- 172.21.15.112:0/3217835093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f501804fe90 0x7f50180e6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:11.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.464+0000 7f5024fff700 1 --2- 172.21.15.112:0/3217835093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50180e3290 0x7f5018053960 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:11.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.464+0000 7f5024fff700 1 --2- 172.21.15.112:0/3217835093 >> v2:172.21.15.112:3300/0 conn(0x7f501803a7a0 0x7f501804f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:11.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.464+0000 7f5024fff700 1 -- 172.21.15.112:0/3217835093 >> 172.21.15.112:0/3217835093 conn(0x7f5018054b80 msgr2=0x7f5018054f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T23:14:11.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.466+0000 7f5024fff700 1 -- 172.21.15.112:0/3217835093 shutdown_connections 2023-09-12T23:14:11.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.466+0000 7f5024fff700 1 -- 172.21.15.112:0/3217835093 wait complete. 2023-09-12T23:14:11.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.469+0000 7f5024fff700 1 Processor -- start 2023-09-12T23:14:11.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.469+0000 7f5024fff700 1 -- start start 2023-09-12T23:14:11.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.471+0000 7f5024fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f501803a7a0 0x7f50180358a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T23:14:11.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.471+0000 7f5024fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f501804fe90 0x7f50180e3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T23:14:11.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.471+0000 7f501e59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f501803a7a0 0x7f50180358a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T23:14:11.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.471+0000 7f501e59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f501803a7a0 0x7f50180358a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.112:58136/0 (socket says 172.21.15.112:58136) 2023-09-12T23:14:11.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.472+0000 7f501e59c700 1 -- 172.21.15.112:0/4187450831 learned_addr learned my addr 172.21.15.112:0/4187450831 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T23:14:11.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.472+0000 7f501dd9b700 1 --2- 172.21.15.112:0/4187450831 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f501804fe90 0x7f50180e3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T23:14:11.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.472+0000 7f5024fff700 1 --2- 172.21.15.112:0/4187450831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50180e3290 0x7f501804bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T23:14:11.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.473+0000 7f501ed9d700 1 --2- 172.21.15.112:0/4187450831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50180e3290 0x7f501804bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T23:14:11.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.473+0000 7f5024fff700 1 -- 172.21.15.112:0/4187450831 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50180e4980 con 0x7f50180e3290 2023-09-12T23:14:11.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.473+0000 7f5024fff700 1 -- 172.21.15.112:0/4187450831 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501804d370 con 0x7f501803a7a0 2023-09-12T23:14:11.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.474+0000 7f5024fff700 1 -- 172.21.15.112:0/4187450831 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501804d650 con 0x7f501804fe90 2023-09-12T23:14:11.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.475+0000 7f501e59c700 1 -- 172.21.15.112:0/4187450831 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f501804fe90 msgr2=0x7f50180e3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:11.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.475+0000 7f501e59c700 1 --2- 172.21.15.112:0/4187450831 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f501804fe90 0x7f50180e3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:11.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.475+0000 7f501e59c700 1 -- 172.21.15.112:0/4187450831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50180e3290 msgr2=0x7f501804bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:11.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.475+0000 7f501e59c700 1 --2- 172.21.15.112:0/4187450831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50180e3290 0x7f501804bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:11.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.475+0000 7f501e59c700 1 -- 172.21.15.112:0/4187450831 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502004e870 con 0x7f501803a7a0 2023-09-12T23:14:11.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.475+0000 7f501ed9d700 1 --2- 172.21.15.112:0/4187450831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50180e3290 0x7f501804bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-12T23:14:11.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.479+0000 7f501e59c700 1 --2- 172.21.15.112:0/4187450831 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f501803a7a0 0x7f50180358a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5020068ce0 tx=0x7f50200739a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T23:14:11.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.480+0000 7f500effd700 1 -- 172.21.15.112:0/4187450831 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020099070 con 0x7f501803a7a0 2023-09-12T23:14:11.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.481+0000 7f500effd700 1 -- 172.21.15.112:0/4187450831 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5020067c10 con 0x7f501803a7a0 2023-09-12T23:14:11.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.481+0000 7f5024fff700 1 -- 172.21.15.112:0/4187450831 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501804d930 con 0x7f501803a7a0 2023-09-12T23:14:11.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.481+0000 7f5024fff700 1 -- 172.21.15.112:0/4187450831 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5018035de0 con 0x7f501803a7a0 2023-09-12T23:14:11.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.483+0000 7f500effd700 1 -- 172.21.15.112:0/4187450831 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020072940 con 0x7f501803a7a0 2023-09-12T23:14:11.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.483+0000 7f500effd700 1 -- 172.21.15.112:0/4187450831 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f5020068040 con 0x7f501803a7a0 2023-09-12T23:14:11.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.486+0000 7f500effd700 1 --2- 172.21.15.112:0/4187450831 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f500006a6d0 0x7f500006cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T23:14:11.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.486+0000 7f501dd9b700 1 --2- 172.21.15.112:0/4187450831 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f500006a6d0 0x7f500006cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T23:14:11.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.488+0000 7f500effd700 1 -- 172.21.15.112:0/4187450831 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5020102780 con 0x7f501803a7a0 2023-09-12T23:14:11.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.488+0000 7f501dd9b700 1 --2- 172.21.15.112:0/4187450831 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f500006a6d0 0x7f500006cb90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f501804cfc0 tx=0x7f5014009260 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T23:14:11.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.488+0000 7f500cff9700 1 -- 172.21.15.112:0/4187450831 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50040052e0 con 0x7f501803a7a0 2023-09-12T23:14:11.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.501+0000 7f500effd700 1 -- 172.21.15.112:0/4187450831 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f50200cdc10 con 0x7f501803a7a0 2023-09-12T23:14:11.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:11.897+0000 7f500cff9700 1 -- 172.21.15.112:0/4187450831 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5004005b10 con 0x7f501803a7a0 2023-09-12T23:14:12.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:12.344+0000 7f500effd700 1 -- 172.21.15.112:0/4187450831 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f502008d070 con 0x7f501803a7a0 2023-09-12T23:14:12.349 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-09-12T23:14:12.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:12.350+0000 7f5024fff700 1 -- 172.21.15.112:0/4187450831 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f500006a6d0 msgr2=0x7f500006cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:12.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:12.350+0000 7f5024fff700 1 --2- 172.21.15.112:0/4187450831 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f500006a6d0 0x7f500006cb90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f501804cfc0 tx=0x7f5014009260 comp rx=0 tx=0).stop 2023-09-12T23:14:12.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:12.350+0000 7f5024fff700 1 -- 172.21.15.112:0/4187450831 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f501803a7a0 msgr2=0x7f50180358a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:12.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:12.350+0000 7f5024fff700 1 --2- 172.21.15.112:0/4187450831 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f501803a7a0 0x7f50180358a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5020068ce0 tx=0x7f50200739a0 comp rx=0 tx=0).stop 2023-09-12T23:14:12.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:12.351+0000 7f5024fff700 1 -- 172.21.15.112:0/4187450831 shutdown_connections 2023-09-12T23:14:12.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:12.351+0000 7f5024fff700 1 --2- 172.21.15.112:0/4187450831 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7f500006a6d0 0x7f500006cb90 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:12.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:12.351+0000 7f5024fff700 1 --2- 172.21.15.112:0/4187450831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50180e3290 0x7f501804bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:12.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:12.351+0000 7f5024fff700 1 --2- 172.21.15.112:0/4187450831 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f501803a7a0 0x7f50180358a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:12.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:12.351+0000 7f5024fff700 1 --2- 172.21.15.112:0/4187450831 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f501804fe90 0x7f50180e3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:12.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:12.351+0000 7f5024fff700 1 -- 172.21.15.112:0/4187450831 >> 172.21.15.112:0/4187450831 conn(0x7f5018054b80 msgr2=0x7f5018036b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T23:14:12.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:12.351+0000 7f5024fff700 1 -- 172.21.15.112:0/4187450831 shutdown_connections 2023-09-12T23:14:12.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:12.352+0000 7f5024fff700 1 -- 172.21.15.112:0/4187450831 wait complete. 2023-09-12T23:14:12.472 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-12T23:14:13.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.252+0000 7fb979d9d700 1 -- 172.21.15.112:0/3283644764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb96c0e7940 msgr2=0x7fb96c04f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:13.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.252+0000 7fb979d9d700 1 --2- 172.21.15.112:0/3283644764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb96c0e7940 0x7fb96c04f2f0 secure :-1 s=READY pgs=3017 cs=0 l=1 rev1=1 crypto rx=0x7fb97404fb80 tx=0x7fb9740679e0 comp rx=0 tx=0).stop 2023-09-12T23:14:13.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.257+0000 7fb979d9d700 1 -- 172.21.15.112:0/3283644764 shutdown_connections 2023-09-12T23:14:13.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.257+0000 7fb979d9d700 1 --2- 172.21.15.112:0/3283644764 >> v2:172.21.15.144:3300/0 conn(0x7fb96c0eb7b0 0x7fb96c053780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:13.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.257+0000 7fb979d9d700 1 --2- 172.21.15.112:0/3283644764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb96c0e7940 0x7fb96c04f2f0 unknown :-1 s=CLOSED pgs=3017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:13.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.257+0000 7fb979d9d700 1 -- 172.21.15.112:0/3283644764 >> 172.21.15.112:0/3283644764 conn(0x7fb96c054ca0 msgr2=0x7fb96c055080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T23:14:13.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.257+0000 7fb979d9d700 1 -- 172.21.15.112:0/3283644764 shutdown_connections 2023-09-12T23:14:13.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.257+0000 7fb979d9d700 1 -- 172.21.15.112:0/3283644764 wait complete. 2023-09-12T23:14:13.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.263+0000 7fb979d9d700 1 Processor -- start 2023-09-12T23:14:13.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.263+0000 7fb979d9d700 1 -- start start 2023-09-12T23:14:13.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.266+0000 7fb979d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb96c0e7940 0x7fb96c038760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T23:14:13.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.271+0000 7fb978d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb96c0e7940 0x7fb96c038760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T23:14:13.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.272+0000 7fb978d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb96c0e7940 0x7fb96c038760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48364/0 (socket says 172.21.15.112:48364) 2023-09-12T23:14:13.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.272+0000 7fb978d9b700 1 -- 172.21.15.112:0/1260608530 learned_addr learned my addr 172.21.15.112:0/1260608530 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T23:14:13.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.272+0000 7fb979d9d700 1 --2- 172.21.15.112:0/1260608530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb96c0eb350 0x7fb96c18a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T23:14:13.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.272+0000 7fb979d9d700 1 --2- 172.21.15.112:0/1260608530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb96c0eb7b0 0x7fb96c18ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T23:14:13.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.273+0000 7fb979d9d700 1 -- 172.21.15.112:0/1260608530 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c0deed0 con 0x7fb96c0e7940 2023-09-12T23:14:13.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.273+0000 7fb979d9d700 1 -- 172.21.15.112:0/1260608530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c0e0eb0 con 0x7fb96c0eb350 2023-09-12T23:14:13.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.273+0000 7fb973fff700 1 --2- 172.21.15.112:0/1260608530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb96c0eb350 0x7fb96c18a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T23:14:13.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.273+0000 7fb97959c700 1 --2- 172.21.15.112:0/1260608530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb96c0eb7b0 0x7fb96c18ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T23:14:13.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.273+0000 7fb979d9d700 1 -- 172.21.15.112:0/1260608530 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c0e1ea0 con 0x7fb96c0eb7b0 2023-09-12T23:14:13.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.276+0000 7fb978d9b700 1 -- 172.21.15.112:0/1260608530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb96c0eb7b0 msgr2=0x7fb96c18ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:13.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.276+0000 7fb978d9b700 1 --2- 172.21.15.112:0/1260608530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb96c0eb7b0 0x7fb96c18ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:13.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.276+0000 7fb978d9b700 1 -- 172.21.15.112:0/1260608530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb96c0eb350 msgr2=0x7fb96c18a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:13.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.276+0000 7fb978d9b700 1 --2- 172.21.15.112:0/1260608530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb96c0eb350 0x7fb96c18a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:13.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.276+0000 7fb978d9b700 1 -- 172.21.15.112:0/1260608530 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c006250 con 0x7fb96c0e7940 2023-09-12T23:14:13.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.277+0000 7fb978d9b700 1 --2- 172.21.15.112:0/1260608530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb96c0e7940 0x7fb96c038760 secure :-1 s=READY pgs=3018 cs=0 l=1 rev1=1 crypto rx=0x7fb974064080 tx=0x7fb974066e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T23:14:13.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.278+0000 7fb9717fa700 1 -- 172.21.15.112:0/1260608530 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb974098070 con 0x7fb96c0e7940 2023-09-12T23:14:13.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.279+0000 7fb9717fa700 1 -- 172.21.15.112:0/1260608530 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb974066f90 con 0x7fb96c0e7940 2023-09-12T23:14:13.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.279+0000 7fb979d9d700 1 -- 172.21.15.112:0/1260608530 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96c0e10e0 con 0x7fb96c0e7940 2023-09-12T23:14:13.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.284+0000 7fb979d9d700 1 -- 172.21.15.112:0/1260608530 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96c0e16a0 con 0x7fb96c0e7940 2023-09-12T23:14:13.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.289+0000 7fb9717fa700 1 -- 172.21.15.112:0/1260608530 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb974067c10 con 0x7fb96c0e7940 2023-09-12T23:14:13.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.289+0000 7fb9717fa700 1 -- 172.21.15.112:0/1260608530 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fb974067e30 con 0x7fb96c0e7940 2023-09-12T23:14:13.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.292+0000 7fb9717fa700 1 --2- 172.21.15.112:0/1260608530 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb95806a6a0 0x7fb95806cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T23:14:13.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.292+0000 7fb9717fa700 1 -- 172.21.15.112:0/1260608530 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb974101ab0 con 0x7fb96c0e7940 2023-09-12T23:14:13.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.293+0000 7fb973fff700 1 --2- 172.21.15.112:0/1260608530 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb95806a6a0 0x7fb95806cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T23:14:13.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.294+0000 7fb95effd700 1 -- 172.21.15.112:0/1260608530 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9500052f0 con 0x7fb96c0e7940 2023-09-12T23:14:13.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.293+0000 7fb973fff700 1 --2- 172.21.15.112:0/1260608530 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb95806a6a0 0x7fb95806cb60 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb96c053f80 tx=0x7fb968007f20 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T23:14:13.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:13.313+0000 7fb9717fa700 1 -- 172.21.15.112:0/1260608530 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb9740ccfa0 con 0x7fb96c0e7940 2023-09-12T23:14:14.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:14.344+0000 7fb95effd700 1 -- 172.21.15.112:0/1260608530 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb950005b20 con 0x7fb96c0e7940 2023-09-12T23:14:14.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:14.349+0000 7fb9717fa700 1 -- 172.21.15.112:0/1260608530 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb97408d0a0 con 0x7fb96c0e7940 2023-09-12T23:14:14.351 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-09-12T23:14:14.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:14.366+0000 7fb95effd700 1 -- 172.21.15.112:0/1260608530 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb95806a6a0 msgr2=0x7fb95806cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:14.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:14.366+0000 7fb95effd700 1 --2- 172.21.15.112:0/1260608530 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb95806a6a0 0x7fb95806cb60 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb96c053f80 tx=0x7fb968007f20 comp rx=0 tx=0).stop 2023-09-12T23:14:14.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:14.367+0000 7fb95effd700 1 -- 172.21.15.112:0/1260608530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb96c0e7940 msgr2=0x7fb96c038760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:14.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:14.367+0000 7fb95effd700 1 --2- 172.21.15.112:0/1260608530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb96c0e7940 0x7fb96c038760 secure :-1 s=READY pgs=3018 cs=0 l=1 rev1=1 crypto rx=0x7fb974064080 tx=0x7fb974066e60 comp rx=0 tx=0).stop 2023-09-12T23:14:14.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:14.369+0000 7fb95effd700 1 -- 172.21.15.112:0/1260608530 shutdown_connections 2023-09-12T23:14:14.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:14.369+0000 7fb95effd700 1 --2- 172.21.15.112:0/1260608530 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb95806a6a0 0x7fb95806cb60 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:14.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:14.369+0000 7fb95effd700 1 --2- 172.21.15.112:0/1260608530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb96c0eb7b0 0x7fb96c18ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:14.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:14.369+0000 7fb95effd700 1 --2- 172.21.15.112:0/1260608530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb96c0e7940 0x7fb96c038760 unknown :-1 s=CLOSED pgs=3018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:14.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:14.369+0000 7fb95effd700 1 --2- 172.21.15.112:0/1260608530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb96c0eb350 0x7fb96c18a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:14.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:14.369+0000 7fb95effd700 1 -- 172.21.15.112:0/1260608530 >> 172.21.15.112:0/1260608530 conn(0x7fb96c054ca0 msgr2=0x7fb96c0396c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T23:14:14.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:14.370+0000 7fb95effd700 1 -- 172.21.15.112:0/1260608530 shutdown_connections 2023-09-12T23:14:14.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:14.371+0000 7fb95effd700 1 -- 172.21.15.112:0/1260608530 wait complete. 2023-09-12T23:14:14.462 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-12T23:14:15.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.593+0000 7fb823fff700 1 -- 172.21.15.112:0/4270726822 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb824072070 msgr2=0x7fb824157950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:15.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.593+0000 7fb823fff700 1 --2- 172.21.15.112:0/4270726822 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb824072070 0x7fb824157950 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb818009910 tx=0x7fb818009c20 comp rx=0 tx=0).stop 2023-09-12T23:14:15.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.596+0000 7fb823fff700 1 -- 172.21.15.112:0/4270726822 shutdown_connections 2023-09-12T23:14:15.597 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.596+0000 7fb823fff700 1 --2- 172.21.15.112:0/4270726822 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb824072070 0x7fb824157950 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:15.597 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.596+0000 7fb823fff700 1 -- 172.21.15.112:0/4270726822 >> 172.21.15.112:0/4270726822 conn(0x7fb8240af120 msgr2=0x7fb8240af530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T23:14:15.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.603+0000 7fb823fff700 1 -- 172.21.15.112:0/4270726822 shutdown_connections 2023-09-12T23:14:15.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.605+0000 7fb823fff700 1 -- 172.21.15.112:0/4270726822 wait complete. 2023-09-12T23:14:15.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.615+0000 7fb823fff700 1 Processor -- start 2023-09-12T23:14:15.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.617+0000 7fb823fff700 1 -- start start 2023-09-12T23:14:15.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.622+0000 7fb823fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb824072070 0x7fb8240b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T23:14:15.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.623+0000 7fb823fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb824072940 0x7fb8241fe600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T23:14:15.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.625+0000 7fb822ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb824072070 0x7fb8240b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T23:14:15.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.625+0000 7fb822ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb824072070 0x7fb8240b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.112:58162/0 (socket says 172.21.15.112:58162) 2023-09-12T23:14:15.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.628+0000 7fb8227fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb824072940 0x7fb8241fe600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T23:14:15.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.628+0000 7fb8227fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb824072940 0x7fb8241fe600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48376/0 (socket says 172.21.15.112:48376) 2023-09-12T23:14:15.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.628+0000 7fb823fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8240cb890 0x7fb8241ff840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T23:14:15.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.628+0000 7fb823fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb824151e70 con 0x7fb824072940 2023-09-12T23:14:15.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.628+0000 7fb823fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8241ff670 con 0x7fb824072070 2023-09-12T23:14:15.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.628+0000 7fb823fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8241feb40 con 0x7fb8240cb890 2023-09-12T23:14:15.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.629+0000 7fb8237fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8240cb890 0x7fb8241ff840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T23:14:15.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.629+0000 7fb822ffd700 1 -- 172.21.15.112:0/21905377 learned_addr learned my addr 172.21.15.112:0/21905377 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T23:14:15.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.631+0000 7fb8227fc700 1 -- 172.21.15.112:0/21905377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8240cb890 msgr2=0x7fb8241ff840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:15.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.631+0000 7fb8227fc700 1 --2- 172.21.15.112:0/21905377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8240cb890 0x7fb8241ff840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:15.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.631+0000 7fb8227fc700 1 -- 172.21.15.112:0/21905377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb824072070 msgr2=0x7fb8240b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:15.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.631+0000 7fb8227fc700 1 --2- 172.21.15.112:0/21905377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb824072070 0x7fb8240b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:15.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.632+0000 7fb8227fc700 1 -- 172.21.15.112:0/21905377 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8180095f0 con 0x7fb824072940 2023-09-12T23:14:15.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.633+0000 7fb8227fc700 1 --2- 172.21.15.112:0/21905377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb824072940 0x7fb8241fe600 secure :-1 s=READY pgs=3020 cs=0 l=1 rev1=1 crypto rx=0x7fb818014000 tx=0x7fb81800bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T23:14:15.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.635+0000 7fb80b7fe700 1 -- 172.21.15.112:0/21905377 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb818009ee0 con 0x7fb824072940 2023-09-12T23:14:15.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.635+0000 7fb823fff700 1 -- 172.21.15.112:0/21905377 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8241fedd0 con 0x7fb824072940 2023-09-12T23:14:15.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.636+0000 7fb823fff700 1 -- 172.21.15.112:0/21905377 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8241ff390 con 0x7fb824072940 2023-09-12T23:14:15.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.639+0000 7fb823fff700 1 -- 172.21.15.112:0/21905377 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb824151fb0 con 0x7fb824072940 2023-09-12T23:14:15.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.677+0000 7fb80b7fe700 1 -- 172.21.15.112:0/21905377 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb818003ba0 con 0x7fb824072940 2023-09-12T23:14:15.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.684+0000 7fb80b7fe700 1 -- 172.21.15.112:0/21905377 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81800f460 con 0x7fb824072940 2023-09-12T23:14:15.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.685+0000 7fb80b7fe700 1 -- 172.21.15.112:0/21905377 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fb818004830 con 0x7fb824072940 2023-09-12T23:14:15.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.692+0000 7fb80b7fe700 1 --2- 172.21.15.112:0/21905377 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb81006a6d0 0x7fb81006cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T23:14:15.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.693+0000 7fb80b7fe700 1 -- 172.21.15.112:0/21905377 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb81808aa40 con 0x7fb824072940 2023-09-12T23:14:15.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.694+0000 7fb80b7fe700 1 -- 172.21.15.112:0/21905377 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb8180b6a50 con 0x7fb824072940 2023-09-12T23:14:15.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.696+0000 7fb822ffd700 1 --2- 172.21.15.112:0/21905377 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb81006a6d0 0x7fb81006cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T23:14:15.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:15.697+0000 7fb822ffd700 1 --2- 172.21.15.112:0/21905377 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb81006a6d0 0x7fb81006cb90 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb814001b20 tx=0x7fb814009040 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T23:14:16.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:16.190+0000 7fb823fff700 1 -- 172.21.15.112:0/21905377 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb824151fb0 con 0x7fb824072940 2023-09-12T23:14:16.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:16.194+0000 7fb80b7fe700 1 -- 172.21.15.112:0/21905377 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb824151fb0 con 0x7fb824072940 2023-09-12T23:14:16.198 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-09-12T23:14:16.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:16.200+0000 7fb8097fa700 1 -- 172.21.15.112:0/21905377 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb81006a6d0 msgr2=0x7fb81006cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:16.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:16.200+0000 7fb8097fa700 1 --2- 172.21.15.112:0/21905377 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb81006a6d0 0x7fb81006cb90 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb814001b20 tx=0x7fb814009040 comp rx=0 tx=0).stop 2023-09-12T23:14:16.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:16.200+0000 7fb8097fa700 1 -- 172.21.15.112:0/21905377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb824072940 msgr2=0x7fb8241fe600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:16.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:16.200+0000 7fb8097fa700 1 --2- 172.21.15.112:0/21905377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb824072940 0x7fb8241fe600 secure :-1 s=READY pgs=3020 cs=0 l=1 rev1=1 crypto rx=0x7fb818014000 tx=0x7fb81800bfd0 comp rx=0 tx=0).stop 2023-09-12T23:14:16.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:16.201+0000 7fb8097fa700 1 -- 172.21.15.112:0/21905377 shutdown_connections 2023-09-12T23:14:16.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:16.201+0000 7fb8097fa700 1 --2- 172.21.15.112:0/21905377 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fb81006a6d0 0x7fb81006cb90 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:16.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:16.201+0000 7fb8097fa700 1 --2- 172.21.15.112:0/21905377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8240cb890 0x7fb8241ff840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:16.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:16.201+0000 7fb8097fa700 1 --2- 172.21.15.112:0/21905377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb824072070 0x7fb8240b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:16.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:16.201+0000 7fb8097fa700 1 --2- 172.21.15.112:0/21905377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb824072940 0x7fb8241fe600 unknown :-1 s=CLOSED pgs=3020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:16.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:16.201+0000 7fb8097fa700 1 -- 172.21.15.112:0/21905377 >> 172.21.15.112:0/21905377 conn(0x7fb8240af120 msgr2=0x7fb824159800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T23:14:16.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:16.201+0000 7fb8097fa700 1 -- 172.21.15.112:0/21905377 shutdown_connections 2023-09-12T23:14:16.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:16.202+0000 7fb8097fa700 1 -- 172.21.15.112:0/21905377 wait complete. 2023-09-12T23:14:16.243 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-12T23:14:17.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.101+0000 7fee5b3ff700 1 -- 172.21.15.112:0/1973344371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee5406e7c0 msgr2=0x7fee540cc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:17.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.101+0000 7fee5b3ff700 1 --2- 172.21.15.112:0/1973344371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee5406e7c0 0x7fee540cc100 secure :-1 s=READY pgs=3021 cs=0 l=1 rev1=1 crypto rx=0x7fee4c01c440 tx=0x7fee4c01c750 comp rx=0 tx=0).stop 2023-09-12T23:14:17.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.103+0000 7fee5b3ff700 1 -- 172.21.15.112:0/1973344371 shutdown_connections 2023-09-12T23:14:17.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.103+0000 7fee5b3ff700 1 --2- 172.21.15.112:0/1973344371 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee5406e3e0 0x7fee540c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:17.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.103+0000 7fee5b3ff700 1 --2- 172.21.15.112:0/1973344371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee5406e7c0 0x7fee540cc100 unknown :-1 s=CLOSED pgs=3021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:17.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.103+0000 7fee5b3ff700 1 -- 172.21.15.112:0/1973344371 >> 172.21.15.112:0/1973344371 conn(0x7fee540cd1e0 msgr2=0x7fee540cd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T23:14:17.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.104+0000 7fee5b3ff700 1 -- 172.21.15.112:0/1973344371 shutdown_connections 2023-09-12T23:14:17.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.104+0000 7fee5b3ff700 1 -- 172.21.15.112:0/1973344371 wait complete. 2023-09-12T23:14:17.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.109+0000 7fee5b3ff700 1 Processor -- start 2023-09-12T23:14:17.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.110+0000 7fee5b3ff700 1 -- start start 2023-09-12T23:14:17.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.112+0000 7fee5b3ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee5406e3e0 0x7fee54098470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T23:14:17.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.113+0000 7fee5b3ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee540cc640 0x7fee5409a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T23:14:17.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.113+0000 7fee5919b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee5406e3e0 0x7fee54098470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T23:14:17.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.113+0000 7fee5919b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee5406e3e0 0x7fee54098470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.112:54288/0 (socket says 172.21.15.112:54288) 2023-09-12T23:14:17.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.114+0000 7fee5919b700 1 -- 172.21.15.112:0/4261454145 learned_addr learned my addr 172.21.15.112:0/4261454145 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-09-12T23:14:17.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.114+0000 7fee5899a700 1 --2- 172.21.15.112:0/4261454145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee540cc640 0x7fee5409a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T23:14:17.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.115+0000 7fee5b3ff700 1 --2- 172.21.15.112:0/4261454145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee5414a6c0 0x7fee540b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T23:14:17.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.116+0000 7fee5999c700 1 --2- 172.21.15.112:0/4261454145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee5414a6c0 0x7fee540b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T23:14:17.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.116+0000 7fee5b3ff700 1 -- 172.21.15.112:0/4261454145 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee54099410 con 0x7fee5414a6c0 2023-09-12T23:14:17.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.116+0000 7fee5b3ff700 1 -- 172.21.15.112:0/4261454145 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee540aff20 con 0x7fee540cc640 2023-09-12T23:14:17.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.117+0000 7fee5b3ff700 1 -- 172.21.15.112:0/4261454145 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee54098b70 con 0x7fee5406e3e0 2023-09-12T23:14:17.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.118+0000 7fee5919b700 1 -- 172.21.15.112:0/4261454145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee540cc640 msgr2=0x7fee5409a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:17.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.118+0000 7fee5919b700 1 --2- 172.21.15.112:0/4261454145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee540cc640 0x7fee5409a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:17.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.118+0000 7fee5919b700 1 -- 172.21.15.112:0/4261454145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee5414a6c0 msgr2=0x7fee540b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:17.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.118+0000 7fee5919b700 1 --2- 172.21.15.112:0/4261454145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee5414a6c0 0x7fee540b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:17.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.118+0000 7fee5919b700 1 -- 172.21.15.112:0/4261454145 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c009d00 con 0x7fee5406e3e0 2023-09-12T23:14:17.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.118+0000 7fee5999c700 1 --2- 172.21.15.112:0/4261454145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee5414a6c0 0x7fee540b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-12T23:14:17.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.119+0000 7fee5919b700 1 --2- 172.21.15.112:0/4261454145 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee5406e3e0 0x7fee54098470 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fee5000c940 tx=0x7fee5000cc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T23:14:17.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.120+0000 7fee49ffb700 1 -- 172.21.15.112:0/4261454145 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50004220 con 0x7fee5406e3e0 2023-09-12T23:14:17.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.121+0000 7fee49ffb700 1 -- 172.21.15.112:0/4261454145 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fee50004470 con 0x7fee5406e3e0 2023-09-12T23:14:17.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.121+0000 7fee5b3ff700 1 -- 172.21.15.112:0/4261454145 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee54098e50 con 0x7fee5406e3e0 2023-09-12T23:14:17.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.122+0000 7fee5b3ff700 1 -- 172.21.15.112:0/4261454145 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee5414ab70 con 0x7fee5406e3e0 2023-09-12T23:14:17.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.129+0000 7fee49ffb700 1 -- 172.21.15.112:0/4261454145 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50007b20 con 0x7fee5406e3e0 2023-09-12T23:14:17.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.130+0000 7fee49ffb700 1 -- 172.21.15.112:0/4261454145 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fee50007d40 con 0x7fee5406e3e0 2023-09-12T23:14:17.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.141+0000 7fee3f7fe700 1 -- 172.21.15.112:0/4261454145 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee340052e0 con 0x7fee5406e3e0 2023-09-12T23:14:17.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.143+0000 7fee49ffb700 1 --2- 172.21.15.112:0/4261454145 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fee4006a840 0x7fee4006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-12T23:14:17.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.145+0000 7fee5899a700 1 --2- 172.21.15.112:0/4261454145 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fee4006a840 0x7fee4006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-12T23:14:17.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.147+0000 7fee5899a700 1 --2- 172.21.15.112:0/4261454145 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fee4006a840 0x7fee4006cd00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fee4c01c390 tx=0x7fee4c004b40 comp rx=0 tx=0).ready entity=mgr.4176 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-12T23:14:17.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.147+0000 7fee49ffb700 1 -- 172.21.15.112:0/4261454145 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fee50088440 con 0x7fee5406e3e0 2023-09-12T23:14:17.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.154+0000 7fee49ffb700 1 -- 172.21.15.112:0/4261454145 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fee50053930 con 0x7fee5406e3e0 2023-09-12T23:14:17.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.824+0000 7fee3f7fe700 1 -- 172.21.15.112:0/4261454145 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fee34005590 con 0x7fee5406e3e0 2023-09-12T23:14:17.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.825+0000 7fee49ffb700 1 -- 172.21.15.112:0/4261454145 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7fee50056f50 con 0x7fee5406e3e0 2023-09-12T23:14:17.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.834+0000 7fee5b3ff700 1 -- 172.21.15.112:0/4261454145 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fee4006a840 msgr2=0x7fee4006cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:17.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.834+0000 7fee5b3ff700 1 --2- 172.21.15.112:0/4261454145 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fee4006a840 0x7fee4006cd00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fee4c01c390 tx=0x7fee4c004b40 comp rx=0 tx=0).stop 2023-09-12T23:14:17.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.834+0000 7fee5b3ff700 1 -- 172.21.15.112:0/4261454145 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee5406e3e0 msgr2=0x7fee54098470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-12T23:14:17.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.834+0000 7fee5b3ff700 1 --2- 172.21.15.112:0/4261454145 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee5406e3e0 0x7fee54098470 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fee5000c940 tx=0x7fee5000cc50 comp rx=0 tx=0).stop 2023-09-12T23:14:17.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.834+0000 7fee5b3ff700 1 -- 172.21.15.112:0/4261454145 shutdown_connections 2023-09-12T23:14:17.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.835+0000 7fee5b3ff700 1 --2- 172.21.15.112:0/4261454145 >> [v2:172.21.15.112:6832/1000013333,v1:172.21.15.112:6833/1000013333] conn(0x7fee4006a840 0x7fee4006cd00 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:17.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.835+0000 7fee5b3ff700 1 --2- 172.21.15.112:0/4261454145 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee5406e3e0 0x7fee54098470 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:17.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.835+0000 7fee5b3ff700 1 --2- 172.21.15.112:0/4261454145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee5414a6c0 0x7fee540b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:17.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.835+0000 7fee5b3ff700 1 --2- 172.21.15.112:0/4261454145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee540cc640 0x7fee5409a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-12T23:14:17.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.835+0000 7fee5b3ff700 1 -- 172.21.15.112:0/4261454145 >> 172.21.15.112:0/4261454145 conn(0x7fee540cd1e0 msgr2=0x7fee5415e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-12T23:14:17.839 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.836+0000 7fee5b3ff700 1 -- 172.21.15.112:0/4261454145 shutdown_connections 2023-09-12T23:14:17.839 INFO:teuthology.orchestra.run.smithi112.stderr:2023-09-12T23:14:17.837+0000 7fee5b3ff700 1 -- 172.21.15.112:0/4261454145 wait complete. 2023-09-12T23:14:17.845 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2023-09-12T23:14:17.896 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-12T23:14:17.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T23:14:17.897 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-09-12T23:14:18.199 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-09-12T23:14:18.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T23:14:18.200 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-12T23:14:18.449 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-09-12T23:14:18.449 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T23:14:18.622 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345492k,nr_inodes=4086373,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=39,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3274996k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 172.21.15.112:6789:/test /tmp/tmp.pXerGKKTHMtest ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=81d9ebed-ec6c-4564-a5d4-cdbd74c977f8,acl 0 0 2023-09-12T23:14:18.622 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-09-12T23:14:18.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T23:14:18.623 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-09-12T23:14:18.831 INFO:teuthology.orchestra.run.smithi112.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-09-12T23:14:18.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-12T23:14:18.834 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T23:14:18.834 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T23:14:18.998 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345512k,nr_inodes=4086378,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-09-12T23:14:18.999 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-09-12T23:14:18.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T23:14:18.999 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-12T23:14:19.095 INFO:teuthology.orchestra.run.smithi144.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-09-12T23:14:19.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-12T23:14:19.096 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-09-12T23:14:19.096 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-12T23:14:19.178 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345512k,nr_inodes=4086378,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-09-12T23:14:19.178 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-09-12T23:14:19.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-12T23:14:19.179 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-09-12T23:14:19.255 INFO:teuthology.orchestra.run.smithi144.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-09-12T23:14:19.255 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-12T23:14:20.866 INFO:tasks.ceph.osd.1:Sent signal 15 2023-09-12T23:14:20.868 INFO:tasks.ceph.osd.2:Sent signal 15 2023-09-12T23:14:20.868 INFO:tasks.ceph.osd.3:Sent signal 15 2023-09-12T23:14:20.868 INFO:tasks.ceph.osd.4:Sent signal 15 2023-09-12T23:14:20.869 INFO:tasks.ceph.osd.5:Sent signal 15 2023-09-12T23:14:20.869 INFO:tasks.ceph.osd.6:Sent signal 15 2023-09-12T23:14:20.870 INFO:tasks.ceph.osd.7:Sent signal 15 2023-09-12T23:14:20.870 INFO:tasks.ceph.mds.a:Sent signal 15 2023-09-12T23:14:20.871 INFO:tasks.ceph.mds.c:Sent signal 15 2023-09-12T23:14:20.871 INFO:tasks.ceph.mds.b:Sent signal 15 2023-09-12T23:14:20.871 INFO:tasks.ceph.mds.d:Sent signal 15 2023-09-12T23:14:20.872 INFO:tasks.ceph.mon.a:Sent signal 15 2023-09-12T23:14:20.872 INFO:tasks.ceph.mon.b:Sent signal 15 2023-09-12T23:14:20.873 INFO:tasks.ceph.mon.c:Sent signal 15 2023-09-12T23:14:20.873 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-09-12T23:14:20.873 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-09-12T23:14:20.874 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T23:14:20.869+0000 7f49c5bf9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 116100) UID: 0 2023-09-12T23:14:20.874 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T23:14:20.869+0000 7f49c5bf9700 -1 osd.1 42 *** Got signal Terminated *** 2023-09-12T23:14:20.875 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-09-12T23:14:20.869+0000 7f49c5bf9700 -1 osd.1 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-12T23:14:20.875 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T23:14:20.870+0000 7fed0e9f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 116105) UID: 0 2023-09-12T23:14:20.875 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T23:14:20.870+0000 7fed0e9f9700 -1 osd.2 42 *** Got signal Terminated *** 2023-09-12T23:14:20.876 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-09-12T23:14:20.870+0000 7fed0e9f9700 -1 osd.2 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-12T23:14:20.876 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T23:14:20.869+0000 7fb9131f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 116112) UID: 0 2023-09-12T23:14:20.876 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T23:14:20.869+0000 7fb9131f9700 -1 osd.3 42 *** Got signal Terminated *** 2023-09-12T23:14:20.877 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-09-12T23:14:20.869+0000 7fb9131f9700 -1 osd.3 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-12T23:14:20.877 INFO:tasks.ceph.mds.a.smithi112.stderr:2023-09-12T23:14:20.871+0000 7fc85dff9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 132770) UID: 0 2023-09-12T23:14:20.877 INFO:tasks.ceph.mds.a.smithi112.stderr:2023-09-12T23:14:20.872+0000 7fc85dff9700 -1 mds.a *** got signal Terminated *** 2023-09-12T23:14:20.878 INFO:tasks.ceph.mds.c.smithi112.stderr:2023-09-12T23:14:20.871+0000 7f35a2bf9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 132771) UID: 0 2023-09-12T23:14:20.878 INFO:tasks.ceph.mds.c.smithi112.stderr:2023-09-12T23:14:20.871+0000 7f35a2bf9700 -1 mds.c *** got signal Terminated *** 2023-09-12T23:14:20.878 INFO:tasks.ceph.mon.a.smithi112.stderr:2023-09-12T23:14:20.873+0000 7f16671ff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 114763) UID: 0 2023-09-12T23:14:20.879 INFO:tasks.ceph.mon.a.smithi112.stderr:2023-09-12T23:14:20.873+0000 7f16671ff700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-09-12T23:14:20.885 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T23:14:20.884+0000 7fd0eedf9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 115374) UID: 0 2023-09-12T23:14:20.885 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T23:14:20.884+0000 7fd0eedf9700 -1 osd.5 42 *** Got signal Terminated *** 2023-09-12T23:14:20.886 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-09-12T23:14:20.884+0000 7fd0eedf9700 -1 osd.5 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-12T23:14:20.886 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T23:14:20.884+0000 7f858dbf9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 115377) UID: 0 2023-09-12T23:14:20.887 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T23:14:20.884+0000 7f858dbf9700 -1 osd.6 42 *** Got signal Terminated *** 2023-09-12T23:14:20.887 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-09-12T23:14:20.884+0000 7f858dbf9700 -1 osd.6 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-12T23:14:20.887 INFO:tasks.ceph.mon.b.smithi144.stderr:2023-09-12T23:14:20.884+0000 7f6b1f1ff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 114646) UID: 0 2023-09-12T23:14:20.887 INFO:tasks.ceph.mon.b.smithi144.stderr:2023-09-12T23:14:20.884+0000 7f6b1f1ff700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-09-12T23:14:20.888 INFO:tasks.ceph.mds.b.smithi144.stderr:2023-09-12T23:14:20.884+0000 7fc1b63f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 123394) UID: 0 2023-09-12T23:14:20.888 INFO:tasks.ceph.mds.b.smithi144.stderr:2023-09-12T23:14:20.884+0000 7fc1b63f9700 -1 mds.b *** got signal Terminated *** 2023-09-12T23:14:20.889 INFO:tasks.ceph.mds.d.smithi144.stderr:2023-09-12T23:14:20.884+0000 7ff5411f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 123395) UID: 0 2023-09-12T23:14:20.889 INFO:tasks.ceph.mds.d.smithi144.stderr:2023-09-12T23:14:20.884+0000 7ff5411f9700 -1 mds.d *** got signal Terminated *** 2023-09-12T23:14:20.890 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T23:14:20.886+0000 7f05c55f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 115370) UID: 0 2023-09-12T23:14:20.890 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T23:14:20.886+0000 7f05c55f9700 -1 osd.4 42 *** Got signal Terminated *** 2023-09-12T23:14:20.890 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-09-12T23:14:20.886+0000 7f05c55f9700 -1 osd.4 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-12T23:14:20.890 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T23:14:20.886+0000 7f2623ff9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 115378) UID: 0 2023-09-12T23:14:20.891 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T23:14:20.886+0000 7f2623ff9700 -1 osd.7 42 *** Got signal Terminated *** 2023-09-12T23:14:20.891 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-09-12T23:14:20.886+0000 7f2623ff9700 -1 osd.7 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-12T23:14:20.892 INFO:tasks.ceph.mon.c.smithi144.stderr:2023-09-12T23:14:20.884+0000 7ff2b57ff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 114648) UID: 0 2023-09-12T23:14:20.892 INFO:tasks.ceph.mon.c.smithi144.stderr:2023-09-12T23:14:20.884+0000 7ff2b57ff700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-09-12T23:14:20.958 INFO:tasks.ceph.mon.a.smithi112.stderr:2023-09-12T23:14:20.957+0000 7f16619f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-12T23:14:21.094 INFO:tasks.ceph.mgr.x.smithi144.stderr:daemon-helper: command crashed with signal 15 2023-09-12T23:15:49.130 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:15:49.136 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:16:19.315 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:16:19.322 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:16:49.506 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:16:49.516 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:17:19.784 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:17:19.790 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:17:50.009 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:17:50.020 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:18:20.242 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:18:20.251 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:18:50.445 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:18:50.455 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:19:20.837 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:19:20.847 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:19:51.161 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:19:51.167 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:20:21.368 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:20:21.375 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:20:51.682 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:20:51.694 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:21:21.978 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:21:21.989 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:21:52.233 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:21:52.242 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:22:22.453 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:22:22.465 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:22:52.671 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:22:52.681 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:23:22.976 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:23:22.986 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:23:53.225 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:23:53.233 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:24:23.414 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:24:23.421 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:24:53.701 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:24:53.709 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:25:23.968 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:25:23.975 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:25:54.225 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:25:54.237 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:26:24.514 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:26:24.519 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:26:54.706 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:26:54.718 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:27:24.919 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:27:24.926 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:27:55.157 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:27:55.166 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:28:25.359 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:28:25.369 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:28:55.542 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:28:55.553 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:29:25.767 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:29:25.774 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:29:55.997 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:29:56.008 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:30:26.209 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:30:26.220 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:30:56.460 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:30:56.470 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:31:26.840 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:31:26.852 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:31:57.188 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:31:57.198 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:32:27.467 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:32:27.477 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:32:57.714 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:32:57.725 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:33:27.939 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:33:27.950 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:33:58.170 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:33:58.179 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:34:28.410 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:34:28.420 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:34:58.706 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:34:58.716 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:35:28.912 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:35:28.922 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:35:59.121 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:35:59.133 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:36:29.367 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:36:29.412 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:36:59.706 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:36:59.717 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:37:30.029 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:37:30.038 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:38:00.227 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:38:00.235 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:38:30.440 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:38:30.455 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:39:00.696 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:39:00.702 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:39:30.941 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:39:30.948 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:40:01.149 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:40:01.156 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:40:31.439 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:40:31.449 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:41:01.632 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:41:01.642 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:41:32.079 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:41:32.086 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:42:02.342 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:42:02.349 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:42:32.658 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:42:32.669 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:43:02.905 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:43:02.915 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:43:33.136 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:43:33.147 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:44:03.418 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:44:03.427 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:44:33.672 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:44:33.682 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:45:03.946 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:45:03.957 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:45:34.253 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:45:34.259 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:46:04.458 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:46:04.465 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:46:34.657 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:46:34.663 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:47:04.840 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:47:04.851 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:47:35.042 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:47:35.053 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:48:05.330 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:48:05.341 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:48:35.697 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:48:35.707 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:49:05.934 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:49:05.941 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:49:36.133 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:49:36.140 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:50:06.432 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:50:06.443 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:50:36.661 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:50:36.671 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:51:06.903 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:51:06.915 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:51:37.118 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:51:37.124 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:52:07.320 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:52:07.330 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:52:37.506 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:52:37.515 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:53:07.735 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:53:07.745 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:53:38.001 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:53:38.008 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:54:08.322 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:54:08.332 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:54:38.575 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:54:38.583 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:55:08.765 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:55:08.776 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:55:39.098 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:55:39.110 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:56:09.339 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:56:09.346 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:56:39.605 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:56:39.616 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:57:09.910 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:57:09.920 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:57:40.142 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:57:40.148 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:58:10.345 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:58:10.356 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:58:40.609 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:58:40.620 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:59:10.851 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:59:10.858 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:59:41.200 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-12T23:59:41.210 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:00:11.455 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:00:11.463 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:00:41.729 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:00:41.738 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:01:12.068 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:01:12.078 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:01:42.307 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:01:42.315 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:02:12.589 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:02:12.597 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:02:42.825 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:02:42.836 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:03:13.134 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:03:13.142 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:03:43.345 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:03:43.356 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:04:13.546 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:04:13.553 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:04:43.767 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:04:43.777 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:05:13.999 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:05:14.010 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:05:44.248 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:05:44.258 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:06:14.479 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:06:14.490 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:06:44.713 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:06:44.719 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:07:14.910 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:07:14.921 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:07:45.156 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:07:45.163 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:08:15.427 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:08:15.437 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:08:45.672 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:08:45.684 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:09:15.937 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:09:15.943 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:09:46.078 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:09:46.090 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:10:16.402 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:10:16.408 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:10:46.611 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:10:46.621 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:11:17.061 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:11:17.075 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:11:47.387 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:11:47.398 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:12:17.640 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:12:17.651 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:12:47.902 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:12:47.914 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:13:18.218 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:13:18.224 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:13:48.455 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:13:48.466 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:14:18.784 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:14:18.792 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:14:49.007 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:14:49.017 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:15:19.266 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:15:19.277 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:15:49.557 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:15:49.567 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:16:19.749 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:16:19.757 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:16:49.961 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:16:49.972 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:17:20.147 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:17:20.158 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:17:50.439 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:17:50.449 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:18:20.901 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:18:20.912 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:18:51.152 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:18:51.163 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:19:21.459 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:19:21.466 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:19:51.711 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:19:51.723 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:20:21.953 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:20:21.960 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:20:52.201 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:20:52.208 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:21:22.388 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:21:22.398 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:21:52.572 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:21:52.582 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:22:22.786 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:22:22.798 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:22:53.034 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:22:53.044 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:23:23.214 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:23:23.221 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:23:53.434 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:23:53.442 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:24:23.644 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:24:23.654 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:24:53.804 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:24:53.810 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:25:23.987 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:25:23.997 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:25:54.178 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:25:54.189 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:26:24.476 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:26:24.485 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:26:54.933 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:26:54.940 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:27:25.130 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:27:25.139 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:27:55.344 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:27:55.357 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:28:25.600 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:28:25.609 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:28:55.924 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:28:55.935 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:29:26.226 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:29:26.233 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:29:56.725 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:29:56.732 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:30:26.941 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:30:26.947 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:30:57.071 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:30:57.077 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:31:27.258 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:31:27.265 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:31:57.455 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:31:57.466 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:32:27.754 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:32:27.765 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:32:58.046 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:32:58.053 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:33:28.333 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:33:28.347 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:33:58.650 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:33:58.660 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:34:28.786 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:34:28.792 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:34:58.918 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:34:58.929 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:35:29.168 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:35:29.175 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:35:59.339 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:35:59.350 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:36:29.581 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:36:29.590 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:36:59.760 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:36:59.766 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:37:29.964 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:37:29.974 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:38:00.102 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:38:00.111 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:38:30.296 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:38:30.302 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:39:00.409 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:39:00.417 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:39:30.622 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:39:30.633 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:40:00.880 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:40:00.898 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:40:31.179 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:40:31.190 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:41:01.469 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:41:01.475 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:41:31.586 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:41:31.593 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:42:01.888 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:42:01.896 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:42:32.102 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:42:32.109 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:43:02.364 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:43:02.371 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:43:32.598 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:43:32.604 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:44:02.801 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:44:02.812 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:44:33.085 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:44:33.096 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:45:03.330 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:45:03.341 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:45:33.581 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:45:33.589 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:46:03.728 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:46:03.742 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:46:33.973 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:46:33.984 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:47:04.283 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:47:04.290 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:47:34.596 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:47:34.606 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:48:04.783 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:48:04.793 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:48:35.075 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:48:35.086 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:49:05.379 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:49:05.391 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:49:35.654 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:49:35.665 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:50:05.926 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:50:05.937 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:50:36.117 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:50:36.128 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:51:06.295 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:51:06.303 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:51:36.646 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:51:36.653 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:52:06.877 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:52:06.883 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:52:37.073 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:52:37.078 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:53:07.263 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:53:07.270 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:53:37.492 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:53:37.501 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:54:07.693 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:54:07.703 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:54:37.870 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:54:37.881 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:55:08.112 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:55:08.120 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:55:38.320 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:55:38.331 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:56:08.548 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:56:08.558 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:56:38.795 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:56:38.803 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:57:09.018 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:57:09.029 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:57:39.260 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:57:39.267 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:58:09.558 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:58:09.569 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:58:39.829 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:58:39.837 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:59:10.371 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:59:10.376 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:59:40.525 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T00:59:40.534 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:00:10.695 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:00:10.701 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:00:40.934 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:00:40.945 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:01:11.252 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:01:11.259 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:01:41.547 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:01:41.560 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:02:11.889 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:02:11.897 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:02:42.120 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:02:42.127 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:03:12.334 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:03:12.341 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:03:42.607 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:03:42.618 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:04:12.938 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:04:12.944 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:04:43.161 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:04:43.168 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:05:13.421 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:05:13.432 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:05:43.680 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:05:43.690 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:06:13.895 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:06:13.901 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:06:44.060 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:06:44.071 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:07:14.287 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:07:14.297 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:07:44.482 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:07:44.489 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:08:14.699 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:08:14.705 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:08:44.919 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:08:44.927 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:09:15.214 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:09:15.224 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:09:45.512 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:09:45.520 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:10:15.818 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:10:15.825 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:10:46.032 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:10:46.039 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:11:16.347 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:11:16.354 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:11:46.587 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:11:46.594 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:12:16.873 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:12:16.878 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:12:47.060 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:12:47.071 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:13:17.381 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:13:17.390 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:13:47.658 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:13:47.665 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:14:17.883 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:14:17.889 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:14:48.097 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:14:48.108 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:15:18.346 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:15:18.353 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:15:48.577 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:15:48.588 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:16:18.825 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:16:18.835 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:16:49.021 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:16:49.027 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:17:19.199 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:17:19.209 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:17:49.378 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:17:49.388 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:18:19.573 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:18:19.583 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:18:49.785 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:18:49.795 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:19:19.980 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:19:19.988 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:19:50.142 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:19:50.147 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:20:20.313 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:20:20.324 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:20:50.562 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:20:50.569 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:21:20.744 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:21:20.755 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:21:51.066 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:21:51.073 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:22:21.288 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:22:21.295 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:22:51.510 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:22:51.516 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:23:21.700 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:23:21.712 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:23:51.956 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:23:51.962 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:24:22.157 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:24:22.168 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:24:52.435 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:24:52.446 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:25:22.640 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:25:22.650 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:25:52.949 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:25:52.956 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:26:23.163 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:26:23.170 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:26:53.383 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:26:53.389 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:27:23.605 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:27:23.612 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:27:53.798 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:27:53.831 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:28:24.063 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:28:24.087 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:28:54.240 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:28:54.250 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:29:24.456 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:29:24.465 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:29:54.688 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:29:54.696 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:30:24.928 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:30:24.936 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:30:55.216 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:30:55.226 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:31:25.478 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:31:25.489 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:31:55.745 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:31:55.756 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:32:25.994 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:32:26.004 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:32:56.306 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:32:56.317 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:33:26.631 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:33:26.641 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:33:56.844 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:33:56.855 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:34:27.148 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:34:27.158 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:34:57.390 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:34:57.400 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:35:27.612 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:35:27.619 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:35:57.809 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:35:57.816 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:36:28.033 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:36:28.044 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:36:58.367 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:36:58.373 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:37:28.618 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:37:28.628 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:37:58.848 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:37:58.859 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:38:29.165 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:38:29.174 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:38:59.359 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:38:59.369 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:39:29.546 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:39:29.557 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:39:59.861 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:39:59.868 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:40:30.103 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:40:30.109 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:41:00.283 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:41:00.292 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:41:30.516 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:41:30.522 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:42:00.692 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:42:00.703 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:42:30.947 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:42:30.958 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:43:01.286 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:43:01.297 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:43:31.568 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:43:31.579 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:44:01.754 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:44:01.760 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:44:32.046 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:44:32.053 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:45:02.352 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:45:02.363 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:45:32.616 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:45:32.626 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:46:02.839 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:46:02.849 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:46:33.058 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:46:33.069 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:47:03.265 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:47:03.273 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:47:33.565 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:47:33.571 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:48:03.796 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:48:03.811 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:48:34.128 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:48:34.137 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:49:04.414 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:49:04.423 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:49:34.638 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:49:34.645 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:50:04.914 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:50:04.922 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:50:35.193 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:50:35.202 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:51:05.441 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:51:05.450 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:51:35.695 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:51:35.706 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:52:05.946 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:52:05.955 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:52:36.259 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:52:36.265 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:53:06.368 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:53:06.379 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:53:36.687 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:53:36.698 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:54:06.994 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:54:07.005 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:54:37.201 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:54:37.211 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:55:07.406 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:55:07.413 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:55:37.642 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:55:37.653 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:56:07.893 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:56:07.900 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:56:38.182 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:56:38.193 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:57:08.435 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:57:08.446 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:57:38.685 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:57:38.697 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:58:08.821 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:58:08.832 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:58:39.068 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:58:39.075 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:59:09.298 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:59:09.303 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:59:39.471 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T01:59:39.477 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:00:09.774 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:00:09.782 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:00:39.955 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:00:39.962 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:01:10.114 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:01:10.121 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:01:40.309 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:01:40.317 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:02:10.523 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:02:10.534 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:02:40.871 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:02:40.879 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:03:11.186 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:03:11.194 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:03:41.390 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:03:41.397 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:04:11.594 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:04:11.602 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:04:41.820 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:04:41.831 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:05:12.035 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:05:12.046 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:05:42.374 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:05:42.384 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:06:12.663 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:06:12.674 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:06:42.960 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:06:42.970 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:07:13.158 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:07:13.165 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:07:43.362 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:07:43.374 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:08:13.610 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:08:13.619 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:08:43.810 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:08:43.821 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:09:14.098 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:09:14.109 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:09:44.388 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:09:44.399 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:10:14.694 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:10:14.705 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:10:44.950 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:10:44.961 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:11:15.281 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:11:15.289 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:11:45.730 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:11:45.741 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:12:15.985 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:12:15.996 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:12:46.300 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:12:46.308 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:13:16.530 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:13:16.541 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:13:46.779 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:13:46.790 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:14:17.068 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:14:17.078 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:14:47.358 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:14:47.369 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:15:17.613 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:15:17.620 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:15:47.853 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:15:47.859 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:16:17.997 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:16:18.004 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:16:48.170 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:16:48.179 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:17:18.320 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:17:18.330 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:17:48.494 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:17:48.500 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:18:18.642 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:18:18.653 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:18:48.838 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:18:48.844 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:19:18.968 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:19:18.975 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:19:49.138 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:19:49.147 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:20:19.311 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:20:19.317 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:20:49.520 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:20:49.526 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:21:19.717 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:21:19.724 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:21:50.016 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:21:50.023 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:22:20.287 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:22:20.294 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:22:50.519 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:22:50.527 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:23:20.706 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:23:20.717 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:23:50.923 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:23:50.931 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:24:21.070 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:24:21.077 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:24:51.268 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:24:51.276 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:25:21.466 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:25:21.473 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:25:51.637 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:25:51.642 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:26:21.749 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:26:21.755 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:26:51.880 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:26:51.886 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:27:22.031 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:27:22.038 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:27:52.162 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:27:52.172 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:28:22.391 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:28:22.404 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:28:52.555 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:28:52.561 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:29:22.803 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:29:22.810 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:29:53.113 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:29:53.123 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:30:23.256 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:30:23.264 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:30:53.516 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:30:53.523 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:31:23.747 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:31:23.757 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:31:53.936 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:31:53.941 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:32:24.227 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:32:24.237 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:32:54.446 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:32:54.456 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:33:24.763 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:33:24.774 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:33:55.001 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:33:55.012 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:34:25.207 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:34:25.217 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:34:55.412 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:34:55.421 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:35:25.637 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:35:25.648 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:35:55.977 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:35:55.984 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:36:26.173 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:36:26.181 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:36:56.479 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:36:56.494 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:37:26.844 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:37:26.854 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:37:57.117 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:37:57.127 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:38:27.346 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:38:27.357 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:38:57.688 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:38:57.699 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:39:28.010 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:39:28.020 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:39:58.324 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:39:58.331 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:40:28.495 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:40:28.505 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:40:58.711 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:40:58.723 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:41:29.159 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:41:29.169 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:41:59.354 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:41:59.361 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:42:29.670 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:42:29.682 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:42:59.995 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:43:00.004 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:43:30.255 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:43:30.265 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:44:00.497 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:44:00.504 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:44:30.803 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:44:30.811 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:45:01.008 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:45:01.016 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:45:31.317 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:45:31.325 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:46:01.573 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:46:01.580 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:46:31.712 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:46:31.722 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:47:01.893 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:47:01.899 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:47:32.057 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:47:32.068 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:48:02.262 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:48:02.272 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:48:32.554 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:48:32.564 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:49:02.762 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:49:02.767 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:49:32.940 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:49:32.947 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:50:03.246 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:50:03.254 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:50:33.578 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:50:33.585 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:51:03.751 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:51:03.757 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:51:33.956 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:51:33.963 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:52:04.169 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:52:04.175 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:52:34.337 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:52:34.347 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:53:04.584 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:53:04.590 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:53:34.760 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:53:34.771 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:54:05.285 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:54:05.295 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:54:35.518 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:54:35.525 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:55:05.779 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:55:05.785 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:55:35.976 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:55:35.987 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:56:06.192 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:56:06.203 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:56:36.432 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:56:36.446 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:57:06.680 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:57:06.690 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:57:36.889 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:57:36.899 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:58:07.137 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:58:07.144 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:58:37.471 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:58:37.478 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:59:07.783 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:59:07.796 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:59:38.084 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T02:59:38.091 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:00:08.355 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:00:08.363 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:00:38.544 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:00:38.556 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:01:08.792 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:01:08.799 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:01:38.976 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:01:38.985 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:02:09.151 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:02:09.161 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:02:39.368 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:02:39.374 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:03:09.479 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:03:09.491 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:03:39.697 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:03:39.707 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:04:09.936 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:04:09.947 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:04:40.124 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:04:40.135 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:05:10.345 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:05:10.351 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:05:40.559 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:05:40.569 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:06:10.741 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:06:10.752 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:06:40.973 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:06:40.979 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:07:11.158 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:07:11.165 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:07:41.402 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:07:41.413 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:08:11.590 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:08:11.599 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:08:41.819 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:08:41.829 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:09:12.144 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:09:12.154 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:09:42.447 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:09:42.455 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:10:12.663 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:10:12.669 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:10:42.865 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:10:42.872 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:11:13.072 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:11:13.083 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:11:43.280 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:11:43.289 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:12:13.495 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:12:13.502 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:12:43.688 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:12:43.699 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:13:13.933 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:13:13.943 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:13:44.094 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:13:44.105 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:14:14.344 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:14:14.354 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:14:44.530 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:14:44.541 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:15:14.773 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:15:14.782 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:15:45.005 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:15:45.012 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:16:15.265 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:16:15.279 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:16:45.515 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:16:45.522 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:17:15.738 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:17:15.749 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:17:45.986 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:17:45.993 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:18:16.206 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:18:16.217 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:18:46.525 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:18:46.535 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:19:16.744 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:19:16.755 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:19:47.243 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:19:47.249 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:20:17.453 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:20:17.464 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:20:47.717 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:20:47.728 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:21:17.958 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:21:17.964 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:21:48.165 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:21:48.171 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:22:18.340 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:22:18.347 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:22:48.543 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:22:48.555 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:23:19.074 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:23:19.081 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:23:49.306 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:23:49.319 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:24:19.552 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:24:19.563 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:24:49.776 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:24:49.786 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:25:19.969 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:25:19.976 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:25:50.180 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:25:50.187 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:26:20.411 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:26:20.418 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:26:50.625 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:26:50.632 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:27:20.814 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:27:20.821 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:27:51.012 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:27:51.023 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:28:21.206 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:28:21.216 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:28:51.440 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:28:51.450 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:29:21.644 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:29:21.654 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:29:51.909 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:29:51.919 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:30:22.142 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:30:22.152 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:30:52.448 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:30:52.459 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:31:22.667 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:31:22.678 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:31:52.968 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:31:52.977 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:32:23.177 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:32:23.187 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:32:53.379 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:32:53.389 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:33:23.644 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:33:23.937 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:33:54.132 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:33:54.138 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:34:24.369 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:34:24.376 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:34:54.695 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:34:54.704 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:35:25.177 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:35:25.187 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:35:55.481 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:35:55.492 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:36:25.795 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:36:25.801 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:36:55.967 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:36:55.978 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:37:26.283 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:37:26.294 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:37:56.614 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:37:56.629 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:38:26.945 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:38:26.958 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:38:57.159 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:38:57.166 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:39:27.432 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:39:27.437 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:39:57.605 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:39:57.612 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:40:27.919 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:40:27.925 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:40:58.111 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:40:58.121 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:41:28.414 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:41:28.421 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:41:58.684 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:41:58.690 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:42:28.864 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:42:28.872 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:42:59.154 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:42:59.162 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:43:29.421 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:43:29.428 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:43:59.652 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:43:59.659 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:44:29.872 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:44:29.878 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:45:00.069 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:45:00.080 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:45:30.362 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:45:30.369 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:46:00.634 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:46:00.641 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:46:30.821 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:46:30.832 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:47:01.063 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:47:01.074 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:47:31.277 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:47:31.284 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:48:01.507 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:48:01.514 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:48:31.699 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:48:31.710 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:49:01.911 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:49:01.919 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T03:49:22.417 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-09-13T03:49:22.446 DEBUG:teuthology.task.console_log:Killing console logger for smithi112 2023-09-13T03:49:22.447 DEBUG:teuthology.task.console_log:Killing console logger for smithi144 2023-09-13T03:49:22.447 DEBUG:teuthology.exit:Finished running handlers